How AI like ChatGPT picks the next word

How AI like ChatGPT picks the next word

AI writes one word at a time.

A language model gives every word it knows a chance of coming next. From "The sky is", GPT-2 gives "the" 15.2% and "blue" 8.6%. It adds a likely word, reads the longer sentence again, and goes round. One step later, "limit" gets 94.5%.

Send it to someone who thinks AI looks answers up.

#ai #llm #chatgpt #machinelearning #howitworks #technology