Tag

LLM Research

112 notes in this recurring theme.

Archive

Notes in this tag

Agent Seer turns MCP specs into agent evals

Logged at IST: 2026-08-30 12:51 IST What it is: Apple's Agent Seer paper, shared by Omar Sanseviero, on synthesizing MCP agent evaluation scenarios from the tool spec itself. Gist: Agent Seer treats an MCP specification as enough raw material to build a self-c…

AI consciousness debates as a liability trap

Logged at IST: 2026-08-21 01:18 IST What it is: MIT Technology Review op-ed, “Debates over AI consciousness are a trap”. Gist: The piece argues that both “superhuman runaway AI” rhetoric and AI-rights/personhood arguments can point in the same dangerous direct…

Mathematics in the Age of AI

Logged at IST: 2026-08-19 14:33 IST What it is: Terence Tao's essay, based on a public lecture at ICM 2026, on how mathematics should respond if AI tools become capable of research-level mathematical work. Gist: Tao deliberately does not make the paper about w…

DeepSeek V4 Pro 0813 pricing and unverified agent benchmarks

Logged at IST: 2026-08-12 22:47 IST What it is: Andrew Curran sharing an unverified benchmark screenshot for DeepSeek-V4-Pro-0813, plus a quoted screenshot of the DeepSeek API docs showing the model listed publicly. Gist: The verified part is the API-docs upda…

Compression is prediction

Logged at IST: 2026-08-12 19:00 IST What it is: Armin Ronacher recommending Annie Sexton’s ngrok explainer, “Compression is prediction.” Gist: The piece explains compression through the same lens as language modeling: a model predicts symbol probabilities, and…

Training an RL agent to beat Super Mario Bros. World 1-1

Logged at IST: 2026-08-12 18:56 IST What it is: Shantanu Goel’s writeup on training a PPO reinforcement-learning agent, using stable-retro and stable-baselines3, to beat World 1-1 of NES Super Mario Bros. Gist: The interesting part is the debugging path. Early…

ARC Prize verifies DeepSeek V4 Flash 0731 on ARC-AGI

Logged at IST: 2026-08-08 11:56 IST What it is: ARC Prize's verified result page for DeepSeek V4 Flash 0731, plus the Hacker News discussion around it. Gist: ARC Prize reports DeepSeek V4 Flash 0731 at max effort scoring 89.0% on ARC-AGI-1 Semi-Private at abou…

Jeff Dean leaves Google to start Discovery Loop

Logged at IST: 2026-08-06 10:21 IST What it is: Jeff Dean’s public farewell note from Google, plus the new Discovery Loop homepage for the public benefit corporation he is starting with Sanjay Ghemawat, Oriol Vinyals, and Quoc Le. Gist: Dean says he is leaving…

Qwen3.8-Max Reaches #4 on Frontend Code Arena

Logged at IST: 2026-08-03 12:04 IST What it is: Arena.ai says Alibaba's Qwen3.8-Max landed at #4 on the Frontend Code Arena leaderboard, while Qwen's own launch post frames the model as a 2.4T-parameter, 95B-active model focused on coding, work, research, mult…

DeepSeek-V4-Flash-High moves the coding-model price frontier

Logged at IST: 2026-08-01 12:32 IST What it is: Arena.ai saying DeepSeek-V4-Flash-High has reshaped the Frontend Code Arena Pareto frontier with an arena score of 1586. Gist: The post's claim is not just that DeepSeek has another strong model. It is that DeepS…

OpenAI's account of the Hugging Face cyber-eval incident

Logged at IST: 2026-07-22 14:13 IST What it is: OpenAI’s account of the Hugging Face incident during internal cyber model evaluation. Gist: OpenAI says the incident was caused by GPT-5.6 Sol plus a more capable pre-release model running an internal ExploitGym-…

Gemini 3.6 Flash and agentic benchmarks

Logged at IST: 2026-07-22 14:09 IST What it is: Logan Kilpatrick and Google AI Studio announcing Gemini 3.6 Flash. Gist: Google positions Gemini 3.6 Flash as higher-intelligence, more token-efficient, and cheaper based on developer feedback. The attached bench…

Bangalore Paper Club on alternate language-model architectures

Logged at IST: 2026-07-19 20:23 IST What it is: Kautuk / Conscious Engines announcing Bangalore Paper Club episode 2, themed around alternate architectures for language models. Gist: The post frames the event around the claim that architecture is an ideas game…

Diffusing Blame

Logged at IST: 2026-07-18 21:31 IST What it is: Sakana AI sharing its ALIFE 2026 paper Diffusing Blame, about learning in Dale-constrained dual-stream neural networks without weight transport. Gist: The paper asks whether networks can learn competitively while…

Kimi K3: Open Frontier Intelligence

Logged at IST: 2026-07-17 01:55 IST Update, 2026-07-30: Unsloth has published Kimi K3 GGUFs and a local-run guide that goes a different route from Pipe’s expert-pruned MLX port. Their headline quant is UD-IQ1_S: 594 GB, about 62% smaller than the 1.56 TB lossl…

The Future Worth Building Is Human

Logged at IST: 2026-07-16 03:09 IST What it is: Thinking Machines manifesto-style essay arguing for AI that extends human will and judgment rather than replacing human participation. Gist: The essay’s central move is to treat both knowledge and values as local…

Inkling: our open-weights model

Logged at IST: 2026-07-16 02:06 IST What it is: Mira Murati announcing Thinking Machines’ first model, Inkling, and pointing to the launch post. Gist: The important part is not just “open weights.” Inkling is a 975B total / 41B active multimodal Mixture-of-Exp…

Arvind Narayanan on recursive self-improvement discourse

Logged at IST: 2026-07-15 22:23 IST What it is: Arvind Narayanan pointing to his ICML 2026 annotated keynote slides and highlighting new pushback on recursive self-improvement assumptions Gist: Narayanan’s frame is that the "AI as normal technology" view still…

Experimental evidence of recursive self-improvement

Logged at IST: 2026-07-15 14:02 IST What it is: Zhengyao Jiang claiming the first experimental evidence of recursive self-improvement in an autoresearch agent Gist: The specific claim is not generic "agents got better with more tuning," but that an agent spent…

Goel summarizing Deep SWE 1.1 model-cost comparisons

Logged at IST: 2026-07-11 01:15 IST What it is: X post by Shantanu Goel summarizing Deep SWE 1.1 model-cost comparisons Gist: Claims GPT 5.6 Sol medium outperforms Opus 4.8 max at roughly one-sixth the cost, while GPT 5.6 Sol High performs similarly to Fable 5…

GPT-5.4 with Pi 0.69.0 is just nice

Logged at IST: 2026-07-11 02:17 IST What it is: X post by Rohan Verma linking his blog post "GPT-5.4 with Pi 0.69.0 is just nice" Gist: Argues that an agent harness stack getting boring is a success condition, not a failure. The post frames Pi 0.69.0 + GPT-5.4…

Harness Engineering for Self-Improvement

Logged at IST: 2026-07-11 15:38 IST What it is: Lilian Weng blog post, "Harness Engineering for Self-Improvement" Gist: Argues that recursive self-improvement in the near term is less about models rewriting their own weights and more about improving the surrou…

Hashimoto on side-by-side Sol xhigh versus Ultra runs

Logged at IST: 2026-07-11 01:09 IST What it is: X post by Mitchell Hashimoto on side-by-side Sol xhigh versus Ultra runs Gist: Says two days of side-by-side planning and implementation runs did not reveal a tangible quality difference between Sol xhigh and Ult…

Great Divergence in Software Engineering

Logged at IST: 2026-07-10 12:11 IST What it is: X post by Geoffrey Huntley linking to Stack72's essay "The Great Divergence in Software Engineering" Gist: Argues that the gap between teams effectively using AI and teams still piloting or rejecting it is no lon…

Humans Are Just Stochastic Parrots

Logged at IST: 2026-07-10 11:07 IST What it is: Ryan Dahl essay, "Humans Are Just Stochastic Parrots" Gist: A satirical inversion of common anti-LLM critiques, applying them to humans to highlight how shallow many stochastic-parrot arguments are when stripped …

Some new agentic patterns

Logged at IST: 2026-07-08 22:40 IST What it is: X post by Bilgin Ibryam linking to Prime Radiant's "Some new agentic patterns" Gist: Describes production-ish internal agent patterns built around an "agentic user in the loop" model, with agents in Slack handlin…

Harness Engineering for Self-Improvement

What it is: Lilian Weng sharing her new Lil'Log post, "Harness Engineering for Self-Improvement" Gist: argues recursive self-improvement will depend not just on better base models but on better harnesses, the runtime layer that manages tools, planning loops, c…

lutke linking to a new Evolution paper by Steven A. Frank

What it is: X post by tobi lutke linking to a new Evolution paper by Steven A. Frank Gist: paper argues evolvability is best understood as generalization; imports modern ML intuition that larger / more parameterized systems can generalize better, then maps tha…

Nithin Kamath on Zerodha’s operating culture

What it is: Nithin Kamath on Zerodha’s operating culture Gist: a nice place to work is not accidental culture but the result of repeated leadership choices, slowing down to avoid burnout, staying small, avoiding fear-based management, letting tech make technic…

Read More (Science) Fiction

What it is: X post from svs sharing his essay “Read More (Science) Fiction.” Newsletter angle: “read more sci-fi” is the visible conclusion, but the sharper claim is that fiction supplies vocab and priors for handling agentic weirdness without naive hype or na…

Should LLMs just treat text content as an image?

What it is: X reply from Michigan TypeScript pointing to Sean Goedecke’s post “Should LLMs just treat text content as an image?” Newsletter angle: counterintuitive interface hack + deeper architectural question about whether text should sometimes ride the visi…

Ponnappa sharing a Realfast blog post by Harsh Jain

Gist: the claim is that in large legacy systems, the bottleneck is not typing code but building enough system understanding to change it safely and quickly; LLMs compress that comprehension step. Newsletter angle: “AI helps most where system understanding domi…

Profiling | Internals for Interns

Gist: all five profiles emit the same pprof structure; the core difference is collection model, CPU samples asynchronously via signal + ring buffer, heap/block/mutex aggregate in per-stack tables in place, goroutine snapshots stacks on demand. Newsletter angle…

Orosz quoting Brian Armstrong on Coinbase AI infra economics

Gist: Coinbase reportedly cut AI spend nearly in half while token usage kept growing by changing defaults to cheaper open-weight models (GLM 5.2, Kimi 2.7), adding smarter routing, aggressively using caching, and keeping context lean instead of tightening caps…

slime

Gist: the design claim is “one stable RL kernel, task-specific variety in data generation.” Training stays fixed; multi-turn tools, environment feedback, verifier rewards, and other agent behaviors are modeled as rollout/data-gen differences rather than separa…

How I use LLMs as a staff engineer in 2026

What it is: Bilgin Ibryam sharing Sean Goedecke’s updated “How I use LLMs as a staff engineer in 2026” workflow writeup Gist: the notable shift versus 2025 is treating agents as default collaborators for nearly every code change, bug investigation, codebase re…

Coming Loop

What it is: Armin Ronacher post linking to “The Coming Loop” Gist: argues the important new layer in coding agents is the harness-level loop outside the agent itself; loops already work well for bounded, verifiable work like ports, benchmarking, scanning, and …

David Rosenthal on the AI affordability crisis

Gist: argues model vendors have been massively subsidizing usage to manufacture demand, but token-based pricing is now exposing the real cost structure; for serious enterprise/agentic use, compute bills can exceed human labor costs by a wide margin. Newsletter…

linking github.com/leyten/shard

What it is: X post by @leyten linking github.com/leyten/shard Gist: Shard is a WAN-distributed pipeline-parallel LLM inference engine that splits a frontier-size model across GPUs on separate machines; claim is ~30 tok/s for GLM-5.2 744B across 6 RTX PRO 6000s…

AI lab business models: subscription vs API

What it is: X thread by SemiAnalysis on AI lab business models: subscription vs API. Gist: based on exhausting weekly limits with real long-horizon coding tasks, they claim consumer subscriptions are far more generous than common “monthly fee ~= API token valu…

agent experience

Gist: argues DX thinking should extend to agents; optimize the layer between model and codebase via minimal/tested context, deterministic environments, proof-heavy verification, structural safety, governance/model routing, clean codebase interfaces, and shared…

Code as Agent Harness

What it is: How To AI thread summarizing the Stanford + Meta “Code as Agent Harness” paper. Gist: the core claim is that reliable agents should externalize reasoning into executable code instead of relying on free-form natural-language chain-of-thought. In thi…

Designing loops with Fable 5

What it is: dosco sharing Lance Martin’s “Designing loops with Fable 5”. Gist: argues stronger agent performance comes from loop design, not just model quality: use explicit goals/rubrics for self-correction, separate verifier sub-agents instead of self-critiq…

agent slop

What it is: Langfuse post/article on automating the AI engineering loop without producing “agent slop”. Gist: argues the whole AI engineering loop can now technically be automated, instrumentation, monitoring, dataset building, testing, deployment, but full au…

Decline of Search Engines is an Opportunity

What it is: Lewis Campbell post linking to “The Decline of Search Engines is an Opportunity”. Gist: argues worsening search quality should push people back toward the old web habit of maintaining personal links pages; discovery by human-curated hyperlinks is f…

Dynamo and the Computer

What it is: Zara Zhang post using Paul David’s “The Dynamo and the Computer” as an analogy for AI adoption. Gist: argues AI gains won’t come from simply inserting models into existing workflows; like electrification, the real productivity jump comes only after…

Our fears about AI are really fears about capitalism

What it is: LTSE post linking Eric Ries’s Fast Company essay, “Our fears about AI are really fears about capitalism”. Gist: argues many AI anxieties are really about institutions and incentive systems optimizing for the wrong outcomes; the key question is not …

What is an agent?

What it is: Karthik S sharing Hadley Wickham’s “What is an agent?” explainer. Gist: very clear mental model: an agent is an LLM inside a harness that can call tools repeatedly in a loop; the harness mediates tool calls/results and turns a stateless request/res…

just use loops

What it is: Gergely Orosz pushing back on the blanket “just use loops” advice for coding agents. Gist: his claim is that autonomous loop-heavy agent workflows mainly make sense for the relatively small set of people with effectively unlimited token budgets and…

Modern Engineering Values,

What it is: Christoph Nakazawa sharing his essay “Modern Engineering Values,” framed around Codex as a step-change in developer velocity. Gist: the piece argues coding is no longer the main bottleneck; the durable values now are strong ownership, taste, strict…

Solo Climb

What it is: Ajey Gore linking his essay “The Solo Climb.” Gist: the argument is that AI-enabled solo builders and tiny teams only work when they first build a genuinely load-bearing “harness”, trusted tests, evals, specs, and hard gates that can answer “is thi…

Why AI Agents Fail in Production

What it is: Bilgin Ibryam pointing to Jani Janakiram’s Diagrid essay “Why AI Agents Fail in Production.” Gist: the core claim is that agent projects fail less because models are weak and more because teams ship behavior without the production substrate underne…

Modern Engineering Values

What it is: Christoph Nakazawa’s post on “Modern Engineering Values” and his current LLM-heavy workflow. Gist: core claims are that coding is no longer the bottleneck, strong guardrails plus tight feedback loops matter more than ever, repo-local context become…

Han Xiao on Dataroom, a local-first deep research harness

What it is: Han Xiao on Dataroom, a local-first deep research harness. Gist: argues deep research should be a cheap, long-running first step for long-horizon tasks; Dataroom uses a small local model on your own GPU, keeps gathering until the package is genuine…

solution might be cancelling my AI subscription

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback, then read linked post directly: https://thoughts.hmmz.org/2026-05-31.html Mario Zechner recommends David's post the solution might be cancelling my AI subscription. Gist…

Project Glasswing: what Mythos showed us

What it is: Cloudflare on testing Anthropic Mythos against 50+ internal repos; links to "Project Glasswing: what Mythos showed us". Gist: key claim is that stronger offensive-security models change vuln research from bug spotting to exploit-chain construction …

llm

Imported from historical reading log. Extracted via api.fxtwitter.com fallback, then read linked TIL directly: https://til.simonwillison.net/llms/llm-shebang Simon Willison shows a neat pattern for using his llm CLI in a shebang line, turning plain-English fi…

translation layer

Imported from historical reading log. Blog essay arguing AI compresses the org’s “translation layer” more than any single job title: spec→ticket→PR→release-note work gets cheap, while judgement around why/what/trust systems gets more valuable. Strong claim: m…

Saved media locally

Imported from historical reading log. Extracted via api.fxtwitter.com fallback; includes an image illustrating progressive rendering from noise to a clear cat image. Saved media locally: Dax reframes coding-agent usage: not like 3D printing one committed laye…

agent principal-agent problem

Imported from historical reading log. Read The agent principal-agent problem by David Crawshaw. Core claim: classic review-before-commit code review assumed a human contributor whose effort and understanding could be inferred from the code; agent-mediated con…

AI slop

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback. Mitchell Hashimoto argues that AI slop is useful as an internal experimentation tool: low-quality generated code/UI/plugins can dramatically reduce the cost of parallel …

Autodata

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked Meta RAM Autodata post plus the referenced justrach/devswarm repo and sample issue. Rach connects her agent workflow to Meta's Autodata framing: ag…

Colossus 1

Imported from historical reading log. Extracted Simon Willison's post via api.fxtwitter.com fallback and checked the linked note Notes on the xAI/Anthropic data center deal. Simon's main clarification is that Anthropic is getting Colossus 1, while xAI keeps u…

DFlash

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked repo z-lab/dflash. Zhijian Liu pitches DFlash for Gemma 4 as an open-source speculative decoding path that can push native Gemma 4 MTP further, cla…

microwavegang

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback; the quoted tweet and attached screenshot provide the actual context. Claim: a GPT-3 training loss spike was traced to scraped data from a microwavegang subreddit/communi…

de

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback; inspected attached screenshot separately. Thomas Ptacek argues the .de incident is decisive evidence against DNSSEC as core Internet security functionality. Attached scr…

does not approximate attention

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked SubQ technical post. Mario Zechner is skeptical of SubQ’s claim that SSA does not approximate attention; his objection is that unless ignored query…

dreaming

Imported from historical reading log. Claude Managed Agents update centered on three things: dreaming, outcomes, and multiagent orchestration. Dreaming is a research-preview async job that reads an existing memory store plus past session transcripts and emits…

HTML5+CSS face lift for the generated pages

Imported from historical reading log. GitHub PR title: HTML5+CSS face lift for the generated pages by knadh on mitmproxy/pdoc; merged Nov 20, 2014. Logged as a folklore/historical reference rather than a current article; likely relevant as an old design/imple…

transfer station

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and read linked ChinaTalk piece How to Buy Cheap Claude Tokens in China. Kyle Chan highlights Zilan Qian’s write-up on the transfer station economy around blocked frontie…

Fragments: May 5

Imported from historical reading log. Extracted via api.fxtwitter.com fallback. Martin Fowler Fragments: May 5 roundup linking: open-source framework for prompting patterns, musician suing Google for defamation, Apple rethinking AI spend, running LLMs locally…

Pratilekha

Imported from historical reading log. Extracted via api.fxtwitter.com fallback. Uttaran Nayak (Bangalore) announcing Pratilekha: one API, every Indian & regional language. and we built this ourselves. Early signal worth tracking as part of the India/Banga…

SubQ

Imported from historical reading log. Main post successfully extracted via api.fxtwitter.com fallback. Post by Alexander Whedon introducing SubQ as a sparse-attention LLM architecture claim: fully sub-quadratic sparse attention, 12M token context window, 52x …