Tag

LLM Research

91 notes collected under this theme.

Archive

Notes in this tag

All tags

The Future Worth Building Is Human

Logged at IST: 2026-07-16 03:09 IST What it is: Thinking Machines manifesto-style essay arguing for AI that extends human will and judgment rather than replacing human participation. Gist: The essay’s central move is to treat both knowledge and values as local…

Inkling: our open-weights model

Logged at IST: 2026-07-16 02:06 IST What it is: Mira Murati announcing Thinking Machines’ first model, Inkling, and pointing to the launch post. Gist: The important part is not just “open weights.” Inkling is a 975B total / 41B active multimodal Mixture-of-Exp…

Arvind Narayanan on recursive self-improvement discourse

Logged at IST: 2026-07-15 22:23 IST What it is: Arvind Narayanan pointing to his ICML 2026 annotated keynote slides and highlighting new pushback on recursive self-improvement assumptions Gist: Narayanan’s frame is that the "AI as normal technology" view still…

Experimental evidence of recursive self-improvement

Logged at IST: 2026-07-15 14:02 IST What it is: Zhengyao Jiang claiming the first experimental evidence of recursive self-improvement in an autoresearch agent Gist: The specific claim is not generic "agents got better with more tuning," but that an agent spent…

Goel summarizing Deep SWE 1.1 model-cost comparisons

Logged at IST: 2026-07-11 01:15 IST What it is: X post by Shantanu Goel summarizing Deep SWE 1.1 model-cost comparisons Gist: Claims GPT 5.6 Sol medium outperforms Opus 4.8 max at roughly one-sixth the cost, while GPT 5.6 Sol High performs similarly to Fable 5…

GPT-5.4 with Pi 0.69.0 is just nice

Logged at IST: 2026-07-11 02:17 IST What it is: X post by Rohan Verma linking his blog post "GPT-5.4 with Pi 0.69.0 is just nice" Gist: Argues that an agent harness stack getting boring is a success condition, not a failure. The post frames Pi 0.69.0 + GPT-5.4…

Harness Engineering for Self-Improvement

Logged at IST: 2026-07-11 15:38 IST What it is: Lilian Weng blog post, "Harness Engineering for Self-Improvement" Gist: Argues that recursive self-improvement in the near term is less about models rewriting their own weights and more about improving the surrou…

Hashimoto on side-by-side Sol xhigh versus Ultra runs

Logged at IST: 2026-07-11 01:09 IST What it is: X post by Mitchell Hashimoto on side-by-side Sol xhigh versus Ultra runs Gist: Says two days of side-by-side planning and implementation runs did not reveal a tangible quality difference between Sol xhigh and Ult…

Great Divergence in Software Engineering

Logged at IST: 2026-07-10 12:11 IST What it is: X post by Geoffrey Huntley linking to Stack72's essay "The Great Divergence in Software Engineering" Gist: Argues that the gap between teams effectively using AI and teams still piloting or rejecting it is no lon…

Humans Are Just Stochastic Parrots

Logged at IST: 2026-07-10 11:07 IST What it is: Ryan Dahl essay, "Humans Are Just Stochastic Parrots" Gist: A satirical inversion of common anti-LLM critiques, applying them to humans to highlight how shallow many stochastic-parrot arguments are when stripped …

Some new agentic patterns

Logged at IST: 2026-07-08 22:40 IST What it is: X post by Bilgin Ibryam linking to Prime Radiant's "Some new agentic patterns" Gist: Describes production-ish internal agent patterns built around an "agentic user in the loop" model, with agents in Slack handlin…

Harness Engineering for Self-Improvement

What it is: Lilian Weng sharing her new Lil'Log post, "Harness Engineering for Self-Improvement" Gist: argues recursive self-improvement will depend not just on better base models but on better harnesses, the runtime layer that manages tools, planning loops, c…

Nithin Kamath on Zerodha’s operating culture

What it is: Nithin Kamath on Zerodha’s operating culture Gist: a nice place to work is not accidental culture but the result of repeated leadership choices, slowing down to avoid burnout, staying small, avoiding fear-based management, letting tech make technic…

Read More (Science) Fiction

What it is: X post from svs sharing his essay “Read More (Science) Fiction.” Newsletter angle: “read more sci-fi” is the visible conclusion, but the sharper claim is that fiction supplies vocab and priors for handling agentic weirdness without naive hype or na…

Should LLMs just treat text content as an image?

What it is: X reply from Michigan TypeScript pointing to Sean Goedecke’s post “Should LLMs just treat text content as an image?” Newsletter angle: counterintuitive interface hack + deeper architectural question about whether text should sometimes ride the visi…

Ponnappa sharing a Realfast blog post by Harsh Jain

Gist: the claim is that in large legacy systems, the bottleneck is not typing code but building enough system understanding to change it safely and quickly; LLMs compress that comprehension step. Newsletter angle: “AI helps most where system understanding domi…

Profiling | Internals for Interns

Gist: all five profiles emit the same pprof structure; the core difference is collection model, CPU samples asynchronously via signal + ring buffer, heap/block/mutex aggregate in per-stack tables in place, goroutine snapshots stacks on demand. Newsletter angle…

Orosz quoting Brian Armstrong on Coinbase AI infra economics

Gist: Coinbase reportedly cut AI spend nearly in half while token usage kept growing by changing defaults to cheaper open-weight models (GLM 5.2, Kimi 2.7), adding smarter routing, aggressively using caching, and keeping context lean instead of tightening caps…

slime

Gist: the design claim is “one stable RL kernel, task-specific variety in data generation.” Training stays fixed; multi-turn tools, environment feedback, verifier rewards, and other agent behaviors are modeled as rollout/data-gen differences rather than separa…

How I use LLMs as a staff engineer in 2026

What it is: Bilgin Ibryam sharing Sean Goedecke’s updated “How I use LLMs as a staff engineer in 2026” workflow writeup Gist: the notable shift versus 2025 is treating agents as default collaborators for nearly every code change, bug investigation, codebase re…

Coming Loop

What it is: Armin Ronacher post linking to “The Coming Loop” Gist: argues the important new layer in coding agents is the harness-level loop outside the agent itself; loops already work well for bounded, verifiable work like ports, benchmarking, scanning, and …

David Rosenthal on the AI affordability crisis

Gist: argues model vendors have been massively subsidizing usage to manufacture demand, but token-based pricing is now exposing the real cost structure; for serious enterprise/agentic use, compute bills can exceed human labor costs by a wide margin. Newsletter…

linking github.com/leyten/shard

What it is: X post by @leyten linking github.com/leyten/shard Gist: Shard is a WAN-distributed pipeline-parallel LLM inference engine that splits a frontier-size model across GPUs on separate machines; claim is ~30 tok/s for GLM-5.2 744B across 6 RTX PRO 6000s…

AI lab business models: subscription vs API

What it is: X thread by SemiAnalysis on AI lab business models: subscription vs API. Gist: based on exhausting weekly limits with real long-horizon coding tasks, they claim consumer subscriptions are far more generous than common “monthly fee ~= API token valu…

agent experience

Gist: argues DX thinking should extend to agents; optimize the layer between model and codebase via minimal/tested context, deterministic environments, proof-heavy verification, structural safety, governance/model routing, clean codebase interfaces, and shared…

Code as Agent Harness

What it is: How To AI thread summarizing the Stanford + Meta “Code as Agent Harness” paper. Gist: the core claim is that reliable agents should externalize reasoning into executable code instead of relying on free-form natural-language chain-of-thought. In thi…

Designing loops with Fable 5

What it is: dosco sharing Lance Martin’s “Designing loops with Fable 5”. Gist: argues stronger agent performance comes from loop design, not just model quality: use explicit goals/rubrics for self-correction, separate verifier sub-agents instead of self-critiq…

agent slop

What it is: Langfuse post/article on automating the AI engineering loop without producing “agent slop”. Gist: argues the whole AI engineering loop can now technically be automated, instrumentation, monitoring, dataset building, testing, deployment, but full au…

Decline of Search Engines is an Opportunity

What it is: Lewis Campbell post linking to “The Decline of Search Engines is an Opportunity”. Gist: argues worsening search quality should push people back toward the old web habit of maintaining personal links pages; discovery by human-curated hyperlinks is f…

Dynamo and the Computer

What it is: Zara Zhang post using Paul David’s “The Dynamo and the Computer” as an analogy for AI adoption. Gist: argues AI gains won’t come from simply inserting models into existing workflows; like electrification, the real productivity jump comes only after…

Our fears about AI are really fears about capitalism

What it is: LTSE post linking Eric Ries’s Fast Company essay, “Our fears about AI are really fears about capitalism”. Gist: argues many AI anxieties are really about institutions and incentive systems optimizing for the wrong outcomes; the key question is not …

What is an agent?

What it is: Karthik S sharing Hadley Wickham’s “What is an agent?” explainer. Gist: very clear mental model: an agent is an LLM inside a harness that can call tools repeatedly in a loop; the harness mediates tool calls/results and turns a stateless request/res…

just use loops

What it is: Gergely Orosz pushing back on the blanket “just use loops” advice for coding agents. Gist: his claim is that autonomous loop-heavy agent workflows mainly make sense for the relatively small set of people with effectively unlimited token budgets and…

Modern Engineering Values,

What it is: Christoph Nakazawa sharing his essay “Modern Engineering Values,” framed around Codex as a step-change in developer velocity. Gist: the piece argues coding is no longer the main bottleneck; the durable values now are strong ownership, taste, strict…

Solo Climb

What it is: Ajey Gore linking his essay “The Solo Climb.” Gist: the argument is that AI-enabled solo builders and tiny teams only work when they first build a genuinely load-bearing “harness”, trusted tests, evals, specs, and hard gates that can answer “is thi…

Why AI Agents Fail in Production

What it is: Bilgin Ibryam pointing to Jani Janakiram’s Diagrid essay “Why AI Agents Fail in Production.” Gist: the core claim is that agent projects fail less because models are weak and more because teams ship behavior without the production substrate underne…

Modern Engineering Values

What it is: Christoph Nakazawa’s post on “Modern Engineering Values” and his current LLM-heavy workflow. Gist: core claims are that coding is no longer the bottleneck, strong guardrails plus tight feedback loops matter more than ever, repo-local context become…

Han Xiao on Dataroom, a local-first deep research harness

What it is: Han Xiao on Dataroom, a local-first deep research harness. Gist: argues deep research should be a cheap, long-running first step for long-horizon tasks; Dataroom uses a small local model on your own GPU, keeps gathering until the package is genuine…

solution might be cancelling my AI subscription

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback, then read linked post directly: https://thoughts.hmmz.org/2026-05-31.html Mario Zechner recommends David's post the solution might be cancelling my AI subscription. Gist…

Project Glasswing: what Mythos showed us

What it is: Cloudflare on testing Anthropic Mythos against 50+ internal repos; links to "Project Glasswing: what Mythos showed us". Gist: key claim is that stronger offensive-security models change vuln research from bug spotting to exploit-chain construction …

llm

Imported from historical reading log. Extracted via api.fxtwitter.com fallback, then read linked TIL directly: https://til.simonwillison.net/llms/llm-shebang Simon Willison shows a neat pattern for using his llm CLI in a shebang line, turning plain-English fi…

translation layer

Imported from historical reading log. Blog essay arguing AI compresses the org’s “translation layer” more than any single job title: spec→ticket→PR→release-note work gets cheap, while judgement around why/what/trust systems gets more valuable. Strong claim: m…

Saved media locally

Imported from historical reading log. Extracted via api.fxtwitter.com fallback; includes an image illustrating progressive rendering from noise to a clear cat image. Saved media locally: Dax reframes coding-agent usage: not like 3D printing one committed laye…

agent principal-agent problem

Imported from historical reading log. Read The agent principal-agent problem by David Crawshaw. Core claim: classic review-before-commit code review assumed a human contributor whose effort and understanding could be inferred from the code; agent-mediated con…

AI slop

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback. Mitchell Hashimoto argues that AI slop is useful as an internal experimentation tool: low-quality generated code/UI/plugins can dramatically reduce the cost of parallel …

Autodata

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked Meta RAM Autodata post plus the referenced justrach/devswarm repo and sample issue. Rach connects her agent workflow to Meta's Autodata framing: ag…

Colossus 1

Imported from historical reading log. Extracted Simon Willison's post via api.fxtwitter.com fallback and checked the linked note Notes on the xAI/Anthropic data center deal. Simon's main clarification is that Anthropic is getting Colossus 1, while xAI keeps u…

DFlash

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked repo z-lab/dflash. Zhijian Liu pitches DFlash for Gemma 4 as an open-source speculative decoding path that can push native Gemma 4 MTP further, cla…

microwavegang

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback; the quoted tweet and attached screenshot provide the actual context. Claim: a GPT-3 training loss spike was traced to scraped data from a microwavegang subreddit/communi…

de

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback; inspected attached screenshot separately. Thomas Ptacek argues the .de incident is decisive evidence against DNSSEC as core Internet security functionality. Attached scr…

does not approximate attention

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked SubQ technical post. Mario Zechner is skeptical of SubQ’s claim that SSA does not approximate attention; his objection is that unless ignored query…

dreaming

Imported from historical reading log. Claude Managed Agents update centered on three things: dreaming, outcomes, and multiagent orchestration. Dreaming is a research-preview async job that reads an existing memory store plus past session transcripts and emits…

HTML5+CSS face lift for the generated pages

Imported from historical reading log. GitHub PR title: HTML5+CSS face lift for the generated pages by knadh on mitmproxy/pdoc; merged Nov 20, 2014. Logged as a folklore/historical reference rather than a current article; likely relevant as an old design/imple…

transfer station

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and read linked ChinaTalk piece How to Buy Cheap Claude Tokens in China. Kyle Chan highlights Zilan Qian’s write-up on the transfer station economy around blocked frontie…

Fragments: May 5

Imported from historical reading log. Extracted via api.fxtwitter.com fallback. Martin Fowler Fragments: May 5 roundup linking: open-source framework for prompting patterns, musician suing Google for defamation, Apple rethinking AI spend, running LLMs locally…

Pratilekha

Imported from historical reading log. Extracted via api.fxtwitter.com fallback. Uttaran Nayak (Bangalore) announcing Pratilekha: one API, every Indian & regional language. and we built this ourselves. Early signal worth tracking as part of the India/Banga…

SubQ

Imported from historical reading log. Main post successfully extracted via api.fxtwitter.com fallback. Post by Alexander Whedon introducing SubQ as a sparse-attention LLM architecture claim: fully sub-quadratic sparse attention, 12M token context window, 52x …