#llm

Anthropic's own explainer on its Claude text watermark, a version of Google DeepMind's SynthID-Text: it doesn't add hidden characters but instead uses a key plus preceding context to bias which random number settles low-stakes word choices, leaving a pattern detectable only to someone with the key. Covers why it doesn't affect output quality, why it's sparser on factual text and code, why it's implemented across major AI providers under the EU AI Act, and its detection limitations.

Linear Digressions breaks down the mechanism behind Anthropic's Claude text watermark, based on Google DeepMind's SynthID Text (Nature, 2024): rather than tagging output or hiding invisible characters, it biases token-by-token sampling via a tournament-style selection driven by random functions seeded from a private key, leaving a statistical signature that accumulates over many tokens without changing the overall output distribution. Also covers why detection reliability depends on text length and entropy, and how heavy editing weakens the signal.

Hadley Wickham's write-up of a useR! 2025 talk covering three practical LLM use cases in R with the ellmer package: extracting unstructured data (text, images) into structured rectangles, tool calling to give LLMs read/write access to the world (and how that composes into agents), and where LLMs give clear coding wins (translation between languages/formats, and lowering the activation energy to try things). Also covers common LLM failure modes (letter counting, arithmetic) and concerns around cost, environment, privacy, and concentration of power.

Wikipedia overview of the "stochastic parrot" metaphor, coined in a 2021 AI ethics paper by Timnit Gebru, Emily M. Bender, and colleagues, which frames large language models as systems that statistically mimic text without genuine understanding. Covers the Gebru–Google firing controversy and the ongoing debate between skeptics and researchers like Geoffrey Hinton who argue understanding emerges from prediction at scale.

Applies Jevons Paradox to AI inference — per-token costs dropped 1000x since 2022 but total spend is up 10x because usage exploded. The key insight is that agent costs grow quadratically with turns, not linearly, because each step feeds the full conversation history back as context.

Hadley Wickham refines the agent definition by clarifying that tools run in the harness, not the model — and uses math as the concrete example. LLMs are confidently wrong at arithmetic, but harnesses can supply a calculator tool. Also covers how web chat harnesses quietly provide web search, page fetch, memory, and image generation.

Hadley Wickham demystifies coding agents (Claude Code, Cursor, Codex) by building a minimal one in R with ellmer. The core is just six tools — read file, write file, edit file, list files, search, run command — plus a system prompt. Also covers path safety and why a targeted edit tool beats full file rewrites.

Hadley Wickham builds up the definition of an agent from first principles — conversations, turns, tools, harnesses — landing on "an LLM in a harness that calls tools repeatedly in a loop." A clear technical explainer for a term that's everywhere but rarely unpacked.

Great bottom-up explainer. Hadley's definition ("LLM in a harness, calling tools in a loop") is more detailed than Simon Willison's earlier "runs tools in a loop to achieve a goal" (https://simonwillison.net/2025/Sep/18/agents/) — interesting to see how the concept has accumulated vocabulary as the field matures.

Simon Willison's commentary on an Axios piece — the best behind-the-scenes account of the US government export control story that took Fable and Mythos offline.

via Understanding AI Text Watermarking

via Intelligence as a Commodity...