{"id":469,"date":"2023-01-04T12:36:16","date_gmt":"2023-01-04T18:36:16","guid":{"rendered":"https:\/\/janajm.com?p=469"},"modified":"2023-01-04T13:10:57","modified_gmt":"2023-01-04T19:10:57","slug":"chatgpt-context-is-king","status":"publish","type":"post","link":"https:\/\/janajm.com\/chatgpt-context-is-king\/","title":{"rendered":"Context is king: A prediction about the future of ChatGPT and other AI chatbots."},"content":{"rendered":"

On November 30, 2022, OpenAI<\/a> launched ChatGPT<\/a>, or what is arguably the most advanced AI chatbot that has ever been made available to the public.1<\/a><\/sup>\u00a0It hit 1 million users just 4 days later.2<\/a><\/sup><\/p>\n

The days following its launch were marked by a wave of screenshots across social media showcasing ChatGPT\u2019s capabilities.<\/p>\n

\"\"<\/a><\/div><\/div>\n
\"\"<\/a><\/div>
<\/div>\n
\"\"<\/a><\/div><\/div>\n
\"\"<\/a><\/div>
<\/div>\n

It is, undeniably, an incredible technology with any number of use cases<\/a>. Yet so is a lot of technology in the AI space. What made ChatGPT strike a chord in ways that similar technologies haven\u2019t was likely some combination of the following 3 factors:<\/p>\n

    \n
  1. Unlike much of the latest work in AI, ChatGPT is freely3<\/a><\/sup> available to the public.<\/li>\n
  2. Unlike other similar technologies, ChatGPT is available to the public in a way that\u2019s simultaneously easy-to-implement and, once implemented, user-friendly. Accessing it doesn\u2019t require users to download any software, navigate a GitHub repository, or reach out to the authors of a study for access to their code, and using ChatGPT doesn’t require any expert knowledge or specialized skillsets.<\/li>\n
  3. ChatGPT benefits from at least one aspect of what economists have termed \u2018the network effect<\/a>,\u2019 which describes the phenomenon whereby a service becomes better or more valuable as the number of people using that service increases. In the case of ChatGPT, this took shape in the form of users learning how best to use the technology from other users sharing how they<\/i> had used the technology, which in turn encouraged more users to use it (and on and on and on).<\/li>\n<\/ol>\n

    Things move quickly in this space, though, and there are already those who have begun looking beyond ChatGPT’s current form in anticipation of what future iterations of the technology might be able to offer. There are rumours<\/a>, for example, that GPT-4 \u2014 the successor to GPT-3, of which ChatGPT is a variant \u2014 will feature 100 trillion parameters, but others<\/a> have challenged<\/a> this claim.4<\/a><\/sup><\/p>\n

    Regardless of their exact specs, the most common improvements \u2014 whether to ChatGPT or to similar technologies in the future \u2014 are likely to be increases in what might be termed \u2018reference material.\u2019 Future iterations of AI chatbots will, for example, be able to discuss a wider range of material, to cover that material at greater depth, and to feature more recent material than what is presently available.<\/p>\n

    I predict that while these kinds of improvements will undoubtedly be useful, they won\u2019t be the breakthrough innovation that leads to mainstream adoption of ChatGPT or to major leaps in user benefit. Rather, the breakthrough innovation for AI chatbots will be an increase in what I\u2019m calling \u2018contextual capability<\/strong>.\u2019\u00a0Conceptually, contextual capability represents a complex set of processes which could be expressed in many different ways. For the sake of simplicity, however, I\u2019ll break this concept down to just three primary ‘levels.’<\/p>\n

    The first level of contextual capability<\/strong> is invisible to the user, as it represents things like the amount of training data and the number of parameters that an AI chatbot was developed on and can therefore utilize in preparing its responses. ChatGPT performs exceptionally well on this level. For now, perhaps its primary shortcoming on this level is the fact that, at the time of this writing, its training data only goes up to June of 2021<\/a>\u2060<\/sup>. As a result, it can\u2019t refer to, describe, or otherwise engage with events or developments that took place beyond that point in time.<\/p>\n

    Large models are not particularly impressive, novel, or distinct simply by virtue of their size, however.<\/p>\n

    \"\"<\/a><\/p>\n

    Rather, it\u2019s with the second level of contextual capability that things really start to get interesting. The second level of contextual capability<\/strong> represents the ability of an AI chatbot to take in a certain level of context from a prompt and produce a response that takes into account all of that context. Or, in the words of ChatGPT:<\/p>\n

    \"\"<\/p>\n

    If you’ve been following along with ChatGPT since its launch, you might have noticed that many of the most compelling examples of ChatGPT’s responses have been the result of the most context-heavy prompts. We can demonstrate this by comparing ChatGPT\u2019s responses to the following prompts.<\/p>\n

    1.<\/p>\n

    \"\"
    \n\"\"<\/p>\n

    2.<\/p>\n

    \"\"
    \n\"\"<\/p>\n

    3.<\/p>\n

    \"\"
    \n\"\"<\/p>\n

    Here\u2019s another example.<\/p>\n

    1.<\/p>\n

    \"\"<\/p>\n

    2.<\/p>\n

    \"\"<\/p>\n

    3.<\/p>\n

    \"\"
    \n\"\"<\/p>\n

    There are a few issues with ChatGPT\u2019s responses to the above prompts. But, for the moment, let\u2019s focus on how its responses become increasingly more compelling as more and more context is added to the prompt.<\/p>\n

    This leads us to the third level of contextual capability<\/strong>, which might be termed \u2018the world-building level.\u2019 This level represents the extent to which ChatGPT is able to take in a user\u2019s contextual variables (as presented to it through prompts), produce a response that takes into account those variables, and then store both the user-provided prompts and its own responses to those prompts for the remainder of the session.<\/p>\n

    As an example of what this looks like in practice, let\u2019s return to our song about Phineas, the anxious goose. ChatGPT has already provided us with a wonderful response to our initial prompt, but we\u2019d like to remain in the world of Phineas and his goose-related troubles for just a little while longer. Perhaps we\u2019re a songwriter who has been tasked with writing an album about Phineas, and as a result we need more material than just the one song. Let\u2019s see what we can do.<\/p>\n

    1.<\/p>\n

    \"\"
    \n\"\"<\/p>\n

    2.<\/p>\n

    \"\"
    \n\"\"<\/p>\n

    3.<\/p>\n

    \"\"<\/p>\n

    4.<\/p>\n

    \"\"
    \n\"\"<\/p>\n

    Truly, it\u2019s remarkable what ChatGPT has been able to produce in response to these follow-up prompts in world-building. And yet, as we can see, ChatGPT hasn\u2019t quite fulfilled the requirements of the third level of contextual capability. Remember, for example, that Phineas and Greta met in the winter, not in the spring. It doesn\u2019t make sense, moreover, that they would be flying south in the spring, as springtime is when they would be returning north.<\/p>\n

    When we point out these errors to ChatGPT, it\u2019s able to produce a more accurate revision:<\/p>\n

    \"\"
    \n\"\"<\/p>\n

    In fulfilling the third level of contextual capability, however, the question is not whether ChatGPT can correct its responses with our feedback. The question is whether ChatGPT can take in our initial contextual variables, produce a response that takes into account those variables, and then store both our variable-containing prompts and its responses to those prompts for the remainder of the session as we add to or otherwise change our initial variables. Already, as we have seen, ChatGPT is able to do this to some extent. But I predict that future iterations of this technology will be significantly more adept at doing so.<\/p>\n

    In the FAQ for ChatGPT, OpenAI states<\/a> that ChatGPT \u201cis able to remember what the user has said earlier in the conversation \u2026 up to approximately 3000 words (or 4000 tokens)\u201d in the past. \u201cAny information beyond that,\u201d they explain, \u201cis not stored,\u201d and \u201cChatGPT is not able to access past conversations to inform its responses.\u201d This functionality of third-level contextual capability, in other words, has already been built into the model, which indicates that it was seen to be a sufficiently valuable feature by its developers. In a model of this scale and complexity, that certainly wasn\u2019t a given, as it would have required considerable resources of time and expertise to build out. With the above response, moreover, there is the suggestion that those who are working on further improving ChatGPT recognize that its capabilities in this regard are currently somewhat lacking relative to what its users would ideally like for it to be able to do.<\/p>\n

    The reason why future improvements in contextual capability will be important in establishing ChatGPT as a breakthrough innovation is suggested both by the above question and by OpenAI\u2019s response. Let\u2019s return to them both now, this time in their full extent. See if you can spot it:<\/p>\n

    \"\"<\/p>\n

    It comes down to one key word: remember<\/i>.<\/p>\n

    The act of remembering is a practice that\u2019s unique to living organisms. Humans, for example, will remember to pick up the dry cleaning on their way home from work. (Or, at least, they\u2019ll try to.) A dog will remember the sound of their name and perk up when it\u2019s called. Even cells \u2014 the smallest unit of an organism \u2014 are capable<\/a> of remembering. But computers? Computers don\u2019t remember things. Computers store information. With the right prompts, computers are able to retrieve and then present that information to their users.<\/p>\n

    Why, then, would OpenAI use the term \u2018remember\u2019 to describe what ChatGPT is capable of doing? I suspect that, in part, it\u2019s a gesture towards a future in which ChatGPT has undergone significant improvements in contextual capability.<\/p>\n

    Think of it this way: you meet a friend for coffee, and you have so much to talk about that you end up staying out with them for hours. At the end of that conversation, your friend will still remember things that you said to them at the beginning of the conversation. They might not remember every single detail, but even weeks or months later they will still remember enough about your conversation to be able to both refer back to and build upon what you shared \u2014 and you\u2019ll be able to do the same for them. That conversation, in other words, will have entered into the world-building of your friendship.<\/p>\n

    Now, think of the possibilities involved in having even a fraction of that level of contextual capability with an AI chatbot. It won’t need to remember weeks\u2019 or months\u2019 worth of contextual variables in that way that your friend does. Imagine, for example, if ChatGPT could simply remember the contextual variables from an interaction that spanned the entirety of a single day. My sense is that this functionality is coming, and that it will be here sooner than we might expect.<\/p>\n

    In the near future, you’ll boot up ChatGPT at the beginning of your workday, during which time you’ll initiate your world-building for the day\u2019s tasks with a series of context-heavy prompts that will include any domain-specific or organizational-specific variables it will need to know in order to assist you in those tasks. (e.g., \u201cWith this iteration of the project, we\u2019re optimizing for cost efficiency.\u201d) From there, you’ll keep interacting with ChatGPT over the course of the day as you work to complete your tasks, and all throughout your exchanges it will remember each update or addition to the initial set of contextual variables you provided.<\/p>\n

    It will be like working not just with an expert in your field, but with an expert in your specific subfield of your field who also happens to be working the same job \u2014 at the same company, with the same team, and on the same project \u2014 as you.<\/p>\n

    \n
    \n

    1 <\/sup>The New York Times<\/em> has called it<\/a> “the best artificial intelligence chatbot ever released to the general public.”\u21a9<\/a><\/p>\n

    2 <\/sup>It\u2019s worth noting that, in order to gain access to ChatGPT, users have to supply not only an email address but also an active phone number. This, in turn, makes the fact of ChatGPT hitting the 1-million-user mark so quickly all the more remarkable.\u21a9<\/a><\/p>\n

    3 <\/sup>This is likely to change in future iterations of ChatGPT, as OpenAI has suggested<\/a>.\u21a9<\/a><\/p>\n

    4 <\/sup>See also this post<\/a> on language model scaling.\u21a9<\/a><\/p>\n

    Featured image: Suzuki Kiitsu’s “Morning Glories”<\/a> (c. 1800)<\/p>\n<\/div>\n

    \n

    Jana M. Perkins<\/strong> is a computational social scientist. An award-winning scholar, her research has been federally funded by the Social Sciences and Humanities Research Council of Canada since 2019. She is the founder of Women of Letters<\/em><\/a>, a longform interview series celebrating women\u2019s paths to professional success. Together with Miranda Dunham-Hickman, she is co-authoring a book<\/a> that will be published by Routledge.<\/p>\n

    To learn more about Perkins and her latest work, visit janajm.com<\/a> or follow her on Bluesky<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

    It will be like working not just with an expert in your field, but with an expert in your specific subfield of your field who also happens to be working the same job as you.<\/p>\n","protected":false},"author":1,"featured_media":470,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-469","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/janajm.com\/rest\/wp\/v2\/posts\/469","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/janajm.com\/rest\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/janajm.com\/rest\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/janajm.com\/rest\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/janajm.com\/rest\/wp\/v2\/comments?post=469"}],"version-history":[{"count":58,"href":"https:\/\/janajm.com\/rest\/wp\/v2\/posts\/469\/revisions"}],"predecessor-version":[{"id":610,"href":"https:\/\/janajm.com\/rest\/wp\/v2\/posts\/469\/revisions\/610"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/janajm.com\/rest\/wp\/v2\/media\/470"}],"wp:attachment":[{"href":"https:\/\/janajm.com\/rest\/wp\/v2\/media?parent=469"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/janajm.com\/rest\/wp\/v2\/categories?post=469"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/janajm.com\/rest\/wp\/v2\/tags?post=469"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}