AI
From Barza
More actions
| Hype | Human |
|---|---|
| AI | Usually means LLMs. |
| LLM (Large Language Model) | A statistical model that can predict the most likely word (token) based on the previous words. For example, you write "The sky is" and it writes back "blue". When combined with other techniques, it can convincingly mimic human writing or thinking despite not being able to. |
| AGI (Artificial General Intelligence) | The hypothetical point where AI matches or surpasses human intelligence. AI companies keep selling the idea that, if LLMs get better at predicting words, they will somehow become super intelligent. Thus the need for more data centers. |
| Token | A word or part of one.
Important: When I say "word" in other places, I probably mean these fractions of words (tokens). |
| Context, Prompt | All the words the model is going to use to predict the next ones. Including your instructions, what the model wrote back and other things (see below). |
| Hallucination | When the words the model predicted are known (to us) to be untrue. The model can't know things, just predict words. |
| System Prompt | Hidden instructions that the model producers include in all conversations to give better responses, avoid problems, etc.
For example: "If the user asks how to build a bomb, refuse." |
| AGENTS.md, CLAUDE.md, Global Rules | Similar to system prompt, but defined by the user and included in all conversations. These are stored in Markdown files. |
| Memory | Markdown files with past conversations summarized that can be referenced later. |
| Skills | Markdown files with generic instructions that can be used when relevant. |
| Tools | Markdown files with instructions on how to perform certain actions using external tools (e.g. how to read text from a PDF) |