Explain an LLM to a colleague from accounting

A colleague from accounting asks: "How is it that ChatGPT answers everything?"

Explain the principle of a language model clearly, without jargon, in 3 to 6 sentences, and mention at least one limitation that follows from that principle.