6. Generative AI

Traditional ML usually predicts a category or number. Generative AI creates new content:

  • Text
  • Images
  • Audio
  • Video
  • Code

A Large Language Model (LLM) is a deep-learning model trained on enormous amounts of text. It generates output by predicting likely sequences of tokens.

A token is a small unit of text. It may be a complete word, part of a word, punctuation, or another textual unit.

An LLM does not query a database of perfectly stored answers in the way SQL does. It generates a statistically likely response based on learned patterns and supplied context. That is why an LLM can produce a fluent but incorrect answer.

PreviousNext