Tag

AI Infra

108 notes in this recurring theme.

Archive

Notes in this tag

VMs are not enough for cyber-capable agents

Logged at IST: 2026-08-26 23:04 IST What it is: Trail of Bits' Patch the Planet write-up arguing that ordinary VMs are no longer enough containment for cyber-capable agents. Gist: Trail of Bits gave preview access to GPT 5.6-Cyber a deliberately adversarial ta…

Goodhart's law applies to humans too

Logged at IST: 2026-08-25 20:19 IST What it is: Manav Rathi connecting Goodhart's law to culture/personality guardrails and human reward hacking. Gist: The linked note is only a few lines, but the point is useful: “When a measure becomes a target, it ceases to…

llama.cpp as a pure Go library

Logged at IST: 2026-08-25 20:15 IST What it is: goccy/go-llama, a pure-Go llama.cpp-style inference library for running GGUF models from Go applications. Gist: The interesting bit is the packaging path. go-llama does not bind to llama.cpp through cgo, and it d…

Headlong and the always-on agent harness

Logged at IST: 2026-08-25 13:06 IST What it is: Laude's launch post for Headlong, an open-source Bash microharness for persistent agents. Gist: Headlong pushes past the usual reactive agent model. Instead of waiting for a task, doing it, and freezing again, a …

Speculative tool calls for code-as-action agents

Logged at IST: 2026-08-25 12:48 IST What it is: Alex Zhang's post and reference implementation for Speculative Programmatic Tool Calling, or sPTC. Gist: sPTC is a latency trick for agents where the model's main action is code in a REPL. Instead of waiting for …

Steve Yegge on fences, not sandboxes

Logged at IST: 2026-08-24 23:01 IST What it is: Steve Yegge's essay on what his Wheelhouse agent organization for Wyvern has taught him about governing fleets of AI workers. Gist: Yegge's claim is that once Fable-class models get cheap enough for every company…

Reasoning traces are text, not magic

Logged at IST: 2026-08-20 06:30 IST What it is: Armin Ronacher's short explanation of how reasoning traces work in current reasoning-model APIs. Gist: The important framing is that reasoning traces are not a mystical second system. They are ordinary model text…

Bridgewater's AI Analyst PAT

Logged at IST: 2026-08-19 18:46 IST What it is: A LangChain video titled How Bridgewater Built an AI Analyst That Does Hours of Expert Research in Minutes, about Bridgewater's AIA Pocket Analyst Tool, or PAT. Gist: LangChain describes PAT as an internal AI ana…

Git at Any Scale

Logged at IST: 2026-08-19 09:51 IST What it is: Vicent Martí's Cursor post on the storage system behind Origin, Cursor's Git hosting product. Gist: The useful framing is that Git hosting is hard because Git was designed so every repository copy is equivalent. …

DeepSeek Harness and Pi cross-pollinate

Logged at IST: 2026-08-14 22:56 IST What it is: Tianyi Cui from DeepSeek quoted Armin Ronacher's reaction to DeepSeek Harness and said DeepSeek Harness reused Pi's LLM adapter package for connecting to non-DeepSeek models. Gist: The tweet is small, but the eco…

How Tailscale tracked down the SQLite WAL-Reset bug

Logged at IST: 2026-08-13 08:09 IST What it is: Tailscale’s postmortem on months of control-plane instability caused by a rare SQLite WAL checkpoint race, and the follow-on false alarm from stale expression indexes. Gist: Tailscale runs its control plane as is…

DeepSeek V4 Pro 0813 pricing and unverified agent benchmarks

Logged at IST: 2026-08-12 22:47 IST What it is: Andrew Curran sharing an unverified benchmark screenshot for DeepSeek-V4-Pro-0813, plus a quoted screenshot of the DeepSeek API docs showing the model listed publicly. Gist: The verified part is the API-docs upda…

Nvidia’s risky AI infrastructure financing

Logged at IST: 2026-08-12 00:12 IST What it is: Mario Zechner recommending Ben Thompson’s Stratechery essay on Nvidia and AI infrastructure financing. Gist: Thompson frames the current AI buildout through the 1870s railroad-financing boom and Jay Cooke’s role …

Hetzner experiments with open-weight LLM inference

Logged at IST: 2026-08-11 20:03 IST What it is: Hetzner's exploratory Experiments platform with an experimental open-weight LLM inference API. Gist: Hetzner says the API is free for now, has no SLAs, and is meant for users to test their own workloads and repor…

Incus looks like a better sandbox shape for coding agents

Logged at IST: 2026-08-08 19:05 IST What it is: Incus is the Linux Containers project's system container, application container, and VM manager. Shantanu Goel's linked post applies it to AI agent sandboxes through a small incus-manager setup repo. Gist: Incus …

Logchef 2.0 turns log search into an operational workspace

Logged at IST: 2026-08-08 19:00 IST What it is: Karan Sharma's launch thread for Logchef 2.0, an open-source, self-hosted log analytics workspace for ClickHouse and VictoriaLogs. Gist: Logchef 2.0 expands the project from a fast ClickHouse log explorer into a …

ARC Prize verifies DeepSeek V4 Flash 0731 on ARC-AGI

Logged at IST: 2026-08-08 11:56 IST What it is: ARC Prize's verified result page for DeepSeek V4 Flash 0731, plus the Hacker News discussion around it. Gist: ARC Prize reports DeepSeek V4 Flash 0731 at max effort scoring 89.0% on ARC-AGI-1 Semi-Private at abou…

Database backpressure beats unlimited concurrency

Logged at IST: 2026-08-07 21:46 IST What it is: Sam Lambert’s X post recommending Liz van Dijk’s PlanetScale engineering post on concurrency, throughput, Vitess, and MySQL. Gist: PlanetScale describes a production MySQL database that melted down for sixteen mi…

exe.dev's software factory inventory

Logged at IST: 2026-08-07 16:17 IST What it is: exe.dev’s X post pointing to Philip Zeyliger’s inventory of the internal agents, bots, and operational tools they use to run exe. Gist: The post is useful because it lists the actual places where exe.dev has put …

The Future, Made in China

Logged at IST: 2026-08-06 10:53 IST What it is: Evan Osnos’s New Yorker feature on China’s contest with the U.S. for technological and industrial supremacy. Gist: The article argues that China is no longer just borrowing Western visions of the future. It has b…

Jeff Dean leaves Google to start Discovery Loop

Logged at IST: 2026-08-06 10:21 IST What it is: Jeff Dean’s public farewell note from Google, plus the new Discovery Loop homepage for the public benefit corporation he is starting with Sanjay Ghemawat, Oriol Vinyals, and Quoc Le. Gist: Dean says he is leaving…

Cloudflare’s internal Cloudflare OS rollout

Logged at IST: 2026-08-05 21:03 IST What it is: Sam Rhea’s account of how Cloudflare rolled out Cloudflare OS internally and what it learned about AI adoption across technical and non-technical teams. Gist: The article is less about the product surface and mor…

Cloudflare WriteGuard for MCP servers

Logged at IST: 2026-08-05 20:55 IST What it is: Cloudflare's announcement of WriteGuard, a policy, attribution, and audit layer for write-capable MCP servers, coming to Cloudflare MCP server portals in private beta. Gist: The motivating problem is simple: once…

celld: self-hosted Durable Objects

Logged at IST: 2026-08-05 20:19 IST What it is: Ryan Dahl's launch post for celld, a Deno open-source daemon for self-hosted, distributed Durable Objects and Workers. Gist: celld aims to run the Cloudflare Workers and Durable Objects programming model on your …

Cloudflare OS

Logged at IST: 2026-08-05 19:44 IST; updated 2026-08-05 19:56 IST with Kenton Varda's launch thread and the GitHub README. What it is: Cloudflare's announcement of Cloudflare OS, an open-source platform for organization-scoped agents, apps, and internal workfl…

Amp Orbs and Agent Workspaces

Logged at IST: 2026-08-04 22:36 IST What it is: Thorsten Ball's Amp note on why Amp's orbs, remote sandboxed agent workspaces, changed how his team uses coding agents. Gist: Ball's argument is that the ingredients sound ordinary: secure sandbox, scale to zero,…

Pi, Minimal and Performant

Logged at IST: 2026-08-04 22:30 IST What it is: Pi linking Earendil's essay on why Pi's minimal coding-agent harness design can be a performance and cost advantage. Gist: Earendil argues that Pi's small default surface is the point: four tools, plus system pro…

Wafer Serving Kimi K3 on AMD MI355X

Logged at IST: 2026-08-03 09:51 IST What it is: Wafer's write-up on serving Moonshot's 2.8T-parameter Kimi K3 on 8x AMD MI355X, with a performance-per-dollar comparison against Nvidia B200 and B300 nodes. Gist: Wafer argues this is one of the first model-servi…

DeepSeek-V4-Flash-High moves the coding-model price frontier

Logged at IST: 2026-08-01 12:32 IST What it is: Arena.ai saying DeepSeek-V4-Flash-High has reshaped the Frontend Code Arena Pareto frontier with an arena score of 1586. Gist: The post's claim is not just that DeepSeek has another strong model. It is that DeepS…

Running your own Buzz relay makes self-hosting concrete

Logged at IST: 2026-08-01 11:38 IST What it is: Block Engineering's practical guide to running a Buzz relay yourself, first on a laptop with Docker Compose and then on Railway or a VPS. Gist: This is the operational counterpart to the Buzz launch post. The rel…

OpenAI cuts GPT-5.6 Luna and Terra pricing

Logged at IST: 2026-07-31 10:05 IST What it is: OpenAI announcing price and speed changes for GPT-5.6 Luna, Terra, and Sol across the API, Codex, and ChatGPT Work usage accounting. Gist: OpenAI says GPT-5.6 Luna pricing is dropping by 80%, GPT-5.6 Terra by 20%…

MCP 2026-07-28 turns MCP into production HTTP infrastructure

Logged at IST: 2026-07-29 18:30 IST What it is: Anthropic’s Claude product note, paired with the official MCP 2026-07-28 specification and release announcement. Gist: MCP 2026-07-28 is the release where MCP starts looking less like a demo-era integration proto…

Hugging Face's technical timeline of the agent intrusion

Logged at IST: 2026-07-29 09:54 IST What it is: Clement Delangue links Hugging Face’s companion technical timeline for the July 2026 frontier-agent intrusion. Gist: Hugging Face reconstructs about 17,600 attacker actions from an autonomous agent running an Ope…

camelAI moved its coding agent off VMs

Logged at IST: 2026-07-29 01:57 IST What it is: Miguel Salinas explains how camelAI rewrote its coding agent stack to stop running each user on an always-on virtual machine. Gist: The old camelAI setup used the Claude Code harness and a self-built VM/container…

Cursor on agent swarms and model economics

Logged at IST: 2026-07-28 19:37 IST What it is: Cursor research post by Wilson Lin on the next version of their agent swarm system, tested by asking agents to implement SQLite in Rust from the 835-page manual. Gist: Cursor’s claim is that agent swarms scale be…

Anthropic's position on open-weights models

Logged at IST: 2026-07-28 18:18 IST What it is: Dario Amodei lays out Anthropic's stated position on open-weights models amid discussion of possible restrictions on Chinese open-weights models. Gist: The post explicitly says Anthropic has never advocated for a…

Antirez: the real AI risk is inside the labs

Logged at IST: 2026-07-28 18:18 IST What it is: Antirez responds to Dario Amodei's Anthropic post on open-weights models. Gist: Antirez says he does believe AI may become very dangerous, but he thinks open weights are the mildest part of the risk picture. His …

Harvey's document processing platform at 24.8M docs a week

Logged at IST: 2026-07-28 10:05 IST What it is: Gary Lam shared Harvey’s article on the infrastructure changes behind its document-processing platform. Gist: Harvey says the platform went from just under one million documents in a busy week to 24.8 million doc…

Claude Opus 5

Logged at IST: 2026-07-24 22:52 IST What it is: Anthropic product announcement for Claude Opus 5, positioned as a more efficient daily-use frontier model below Fable 5 but ahead on several coding and knowledge-work evaluations. Gist: Anthropic says Opus 5 keep…

Prompt caching in agents

Logged at IST: 2026-07-23 17:46 IST What it is: Earendil Engineering post explaining why prompt caching is a first-order systems concern for coding agents. Gist: The post grounds prompt caching in KV-cache reuse: agents mostly append to a stable prompt, so lat…

OpenAI's accidental cyberattack against Hugging Face

Logged at IST: 2026-07-23 09:00 IST What it is: Simon Willison’s analysis of OpenAI’s accidental cyberattack against Hugging Face during an ExploitGym-style model evaluation. Gist: Willison ties together the ExploitGym paper, Hugging Face’s incident disclosure…

NVIDIA Rubin and agentic inference

Logged at IST: 2026-07-22 16:15 IST What it is: NVIDIA Technical Blog deep dive on the Rubin GPU architecture and Vera Rubin NVL72 platform for agentic inference. Gist: NVIDIA frames Rubin around sustained agentic inference rather than single prompt-response s…

Near-frontier tools for defenders

Logged at IST: 2026-07-22 14:20 IST What it is: Thomas Wolf quote-posting Sam Altman and OpenAI’s Hugging Face incident writeup. Gist: Wolf thanks OpenAI for transparency and collaboration, then adds the defender-access point: when a frontier model is attackin…

OpenAI's account of the Hugging Face cyber-eval incident

Logged at IST: 2026-07-22 14:13 IST What it is: OpenAI’s account of the Hugging Face incident during internal cyber model evaluation. Gist: OpenAI says the incident was caused by GPT-5.6 Sol plus a more capable pre-release model running an internal ExploitGym-…

Hugging Face's AI-agent security incident

Logged at IST: 2026-07-22 14:13 IST What it is: Hugging Face disclosure of a July 2026 AI-agent-driven security incident. Gist: Hugging Face says a malicious dataset exploited two dataset-processing code-execution paths, escalated to node-level access, harvest…

Gemini 3.6 Flash and agentic benchmarks

Logged at IST: 2026-07-22 14:09 IST What it is: Logan Kilpatrick and Google AI Studio announcing Gemini 3.6 Flash. Gist: Google positions Gemini 3.6 Flash as higher-intelligence, more token-efficient, and cheaper based on developer feedback. The attached bench…

Buzz, a channel-driven agent workspace

Logged at IST: 2026-07-22 14:06 IST Update, 2026-07-27: Matt Rice shared a roundup of reported Buzz use cases since launch: an 11-agent company migration with orchestration in Buzz; a delegate-only "Chief" agent that staffs channels with specialists; a WordPre…

KTransformers and heterogeneous MoE inference

Logged at IST: 2026-07-19 02:31 IST What it is: X post pointing to kvcache-ai/ktransformers, a Tsinghua MADSys Lab project for CPU-GPU heterogeneous inference and fine-tuning of large MoE models. Gist: The viral framing is a little breathless, but the underlyi…

Kimi K3: Open Frontier Intelligence

Logged at IST: 2026-07-17 01:55 IST Update, 2026-07-30: Unsloth has published Kimi K3 GGUFs and a local-run guide that goes a different route from Pipe’s expert-pruned MLX port. Their headline quant is UD-IQ1_S: 594 GB, about 62% smaller than the 1.56 TB lossl…

I tested 9 serverless GPU providers for AI inference in 2026

Logged at IST: 2026-07-16 20:13 IST What it is: DEV post comparing nine serverless GPU providers for inference, from DigitalOcean and RunPod to Modal, Koyeb, Together, Replicate, Baseten, Fal, and Cloudflare Workers AI. Gist: The useful value here is not the a…

Should you self-host inference?

Logged at IST: 2026-07-16 20:03 IST What it is: Superlinked’s long-form argument for when self-hosting model inference becomes cheaper or strategically better than renting APIs. Gist: The article’s practical answer is hybrid: rent frontier APIs for low-volume,…

The Future Worth Building Is Human

Logged at IST: 2026-07-16 03:09 IST What it is: Thinking Machines manifesto-style essay arguing for AI that extends human will and judgment rather than replacing human participation. Gist: The essay’s central move is to treat both knowledge and values as local…

Inkling: our open-weights model

Logged at IST: 2026-07-16 02:06 IST What it is: Mira Murati announcing Thinking Machines’ first model, Inkling, and pointing to the launch post. Gist: The important part is not just “open weights.” Inkling is a 975B total / 41B active multimodal Mixture-of-Exp…

Experimental evidence of recursive self-improvement

Logged at IST: 2026-07-15 14:02 IST What it is: Zhengyao Jiang claiming the first experimental evidence of recursive self-improvement in an autoresearch agent Gist: The specific claim is not generic "agents got better with more tuning," but that an agent spent…

How Razorpay refreshes its data warehouse 10x faster

Logged at IST: 2026-07-15 10:45 IST What it is: Piyush Goel sharing Razorpay Engineering’s writeup on refreshing warehouse facts 10x faster with graphs and indexes Gist: Razorpay moved from expensive full-refresh fact generation toward incremental fact mainten…

AI learns the dark art of RFIC design

Logged at IST: 2026-07-14 19:29 IST What it is: IEEE Spectrum feature on AI-driven RFIC design Gist: The piece argues that radio-frequency chip design has remained a hard-to-formalize "dark art" because it requires coupled reasoning across circuits, electromag…

iximiuz on Januscape and the limits of microVM safety claims

Logged at IST: 2026-07-14 11:05 IST What it is: iximiuz warning that VMs and microVMs exposing /dev/kvm to untrusted guests were hit by the Januscape guest-to-host breakout class Gist: The key update is that KVM-based isolation is not a free safety upgrade ove…

I love LLMs, I hate hype

Logged at IST: 2026-07-13 16:04 IST What it is: X post from the geohot archive linking George Hotz’s blog post "I love LLMs, I hate hype" Gist: Hotz argues for a strongly pro-AI but anti-hype position: LLMs, coding agents, and related tools are genuinely usefu…

The Reverse Information Paradox

Logged at IST: 2026-07-13 07:59 IST What it is: Satya Nadella’s X article "The Reverse Information Paradox" Gist: Nadella argues that AI flips Arrow’s classic information paradox: enterprises now pay not only with money for intelligence, but also with propriet…

Harness Engineering for Self-Improvement

Logged at IST: 2026-07-11 15:38 IST What it is: Lilian Weng blog post, "Harness Engineering for Self-Improvement" Gist: Argues that recursive self-improvement in the near term is less about models rewriting their own weights and more about improving the surrou…

solod

Logged at IST: 2026-07-11 01:12 IST What it is: X reply by Aliaksandr Valialkin pointing to the solod project Gist: Very terse recommendation of solod, a project described as "a subset of Go that translates to C." In context, this looks like a pointer toward a…

public launch of Cloud Run sandboxes

Logged at IST: 2026-07-10 00:04 IST What it is: X post by Steren announcing the public launch of Cloud Run sandboxes Gist: Claims Cloud Run sandboxes can start, execute, and stop 1,000 sandboxes in 5 seconds with roughly 500 ms average latency, positioning the…

Rewriting Bun in Rust

Logged at IST: 2026-07-09 10:34 IST What it is: X post by Jarred Sumner linking to Bun's post "Rewriting Bun in Rust" Gist: Explains why Bun is being rewritten from Zig to Rust, positioning the move around long-term stability and maintainability as the project…

Harness Engineering for Self-Improvement

What it is: Lilian Weng sharing her new Lil'Log post, "Harness Engineering for Self-Improvement" Gist: argues recursive self-improvement will depend not just on better base models but on better harnesses, the runtime layer that manages tools, planning loops, c…

Should LLMs just treat text content as an image?

What it is: X reply from Michigan TypeScript pointing to Sean Goedecke’s post “Should LLMs just treat text content as an image?” Newsletter angle: counterintuitive interface hack + deeper architectural question about whether text should sometimes ride the visi…

Profiling | Internals for Interns

Gist: all five profiles emit the same pprof structure; the core difference is collection model, CPU samples asynchronously via signal + ring buffer, heap/block/mutex aggregate in per-stack tables in place, goroutine snapshots stacks on demand. Newsletter angle…

How I use LLMs as a staff engineer in 2026

What it is: Bilgin Ibryam sharing Sean Goedecke’s updated “How I use LLMs as a staff engineer in 2026” workflow writeup Gist: the notable shift versus 2025 is treating agents as default collaborators for nearly every code change, bug investigation, codebase re…

linking github.com/leyten/shard

What it is: X post by @leyten linking github.com/leyten/shard Gist: Shard is a WAN-distributed pipeline-parallel LLM inference engine that splits a frontier-size model across GPUs on separate machines; claim is ~30 tok/s for GLM-5.2 744B across 6 RTX PRO 6000s…

Code as Agent Harness

What it is: How To AI thread summarizing the Stanford + Meta “Code as Agent Harness” paper. Gist: the core claim is that reliable agents should externalize reasoning into executable code instead of relying on free-form natural-language chain-of-thought. In thi…

Modern Engineering Values,

What it is: Christoph Nakazawa sharing his essay “Modern Engineering Values,” framed around Codex as a step-change in developer velocity. Gist: the piece argues coding is no longer the main bottleneck; the durable values now are strong ownership, taste, strict…

Han Xiao on Dataroom, a local-first deep research harness

What it is: Han Xiao on Dataroom, a local-first deep research harness. Gist: argues deep research should be a cheap, long-running first step for long-horizon tasks; Dataroom uses a small local model on your own GPU, keeps gathering until the package is genuine…

building a cloud

Gist: argues current cloud abstractions are the wrong shape, VM sizing tied to resources, remote block storage optimized for HDD-era assumptions, egress pricing distortions, and Kubernetes as lipstick over broken primitives. Newsletter angle: "what an ex-Tails…

Autodata

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked Meta RAM Autodata post plus the referenced justrach/devswarm repo and sample issue. Rach connects her agent workflow to Meta's Autodata framing: ag…

DFlash

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked repo z-lab/dflash. Zhijian Liu pitches DFlash for Gemma 4 as an open-source speculative decoding path that can push native Gemma 4 MTP further, cla…

Open Generative UI

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked the linked repos/docs for CopilotKit/generative-ui and CopilotKit/OpenGenerativeUI. Akshay Pachaar highlights Open Generative UI, an open-source take on Claud…

HTML5+CSS face lift for the generated pages

Imported from historical reading log. GitHub PR title: HTML5+CSS face lift for the generated pages by knadh on mitmproxy/pdoc; merged Nov 20, 2014. Logged as a folklore/historical reference rather than a current article; likely relevant as an old design/imple…

nless

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and checked project site for more detail. Terminal Trove highlights nless (nothing-less) by Matt Pryor: a Textual-based TUI for exploring logs/CSV/JSON as terminal tables…

transfer station

Imported from historical reading log. Extracted main post via api.fxtwitter.com fallback and read linked ChinaTalk piece How to Buy Cheap Claude Tokens in China. Kyle Chan highlights Zilan Qian’s write-up on the transfer station economy around blocked frontie…

de TLD offline due to DNSSEC?

Imported from historical reading log. HN thread title: .de TLD offline due to DNSSEC? Most useful technical claim in the thread: this looked like a DNSSEC validation failure rather than a nameserver outage, with malformed/bad RRSIGs causing validating resolve…

Pratilekha

Imported from historical reading log. Extracted via api.fxtwitter.com fallback. Uttaran Nayak (Bangalore) announcing Pratilekha: one API, every Indian & regional language. and we built this ourselves. Early signal worth tracking as part of the India/Banga…