III. Lo Scrittoio

ArticlesNotes from the scriptorium

· 13 min

Hallucinations in language models

How a language model can give you a good explanation of something that never happened, and what you can do to spot it.

· 12 min

How language models work

An explanation without the math: how a language model guesses its way forward one word at a time, what attention really is, and why it can sound convincing even when it is wrong.

· 5 min

How Claude Skills work

Skills are self-contained instruction sets Claude loads on demand. What they’re made of, how they load in layers, and why they turn Claude into a specialist in your field.

· 11 min

How tokens work in language models

Why can’t ChatGPT count the letters in “strawberry”? The answer is tokens: the pieces of text the model actually reads, never the letters themselves.

· 9 min

Hyperparameters in the prompting process

Temperature and Top P are usually explained as “randomness”. What they actually do to the words a model chooses between, and why temperature 0 doesn’t always give the best answers.

· 8 min

Prompt engineering: It’s not about instructions, it’s about context

Why language models don’t follow instructions the way a computer follows code, and why good prompting is about building the right context.

[ NEW ARTICLES ]

Get the next article by email.

I write about AI and language models. Leave your email address and get notified when a new English article is published.

Free. Unsubscribe in any email. Via follow.it. Opens in a new tab.

About subscribing and privacy

By clicking “Notify me”, you request email notifications about new English articles. Your address is sent to follow.it, which handles subscriptions and delivery. Follow its instructions to complete your subscription. Emails may include ads from follow.it. Privacy at follow.it. Prefer RSS?