Reading up on infrastructure
100 deep · digging since nov 26, 25
- A Network That Can Wait
Store and Forward enables networks to treat waiting as an operation, allowing communication across time-varying links by storing data until future connectivity appears, extending connectivity beyond constant paths.
- Starbase, LA | Hacker News
SpaceX's Starbase expansion in Los Angeles aims to boost local aerospace industry but faces regulatory and community hurdles.
- Saving 100 terabytes of memory by optimizing 1.1.1.1's DNS cache
Cloudflare cut over 100 terabytes of RAM used by its 1.1.1.1 DNS cache by redesigning cache layout and eviction policies without hurting query latency.
- GitHub - tobi/walgit
walgit is a git server implemented as a single binary that runs in front of an object store (S3/GCS), requiring no local state beyond a cache.
- The American People Really Hate Data Centers
American opposition to data centers is driven less by their physical impacts and more by distrust of AI, big tech, and elites, fueled by bandwagon effects and rising AI visibility.
- Vedansh — backend & AI engineer
Vedansh, a backend and AI engineer, builds storage engines, network stacks, and real-time media systems from scratch, grounding his work in academic papers and AI/ML research.
- Data centers become "killer application" for new power transformer tech - Ars Technica
Solid-state transformers, spurred by AI data center demand, offer mass-manufacturable, efficient power conversion that could also benefit EV charging and household grids.
- The Teaser Period: Why the AI Boom Is Hitting a Reset Wall
The AI boom mirrors 2008's housing crisis as take-or-pay compute contracts create a 2027-2028 'reset wall' where payments start despite labs' revenue being insufficient to cover obligations.
- How Kubernetes Probes Work
The article explains how Kubernetes uses liveness, readiness, and startup probes to monitor container health and manage pod lifecycle effectively.
- GitHub Outages Show the Limits of Reactive Scaling — Rahmi Pruitt
GitHub’s eight‑hour outage shows that reactive scaling fails when hidden concurrency limits are hit and client retries amplify demand, proving that agents need proactive traffic pacing.
- A County Got Rich From Data Centers. Some Question ‘At What Cost?’
Loudoun County, Virginia, earns substantial tax revenue from over 250 data centers, but officials and residents warn that reliance on this income may be risky.
- Git at any scale
Cursor argues Git’s packfile‑based design hinders scalable hosting and presents Continuity, a S3‑backed write‑ahead log system that enables linear, consistent replication.
- The 6-Stage AI Infrastructure Journey: Navigating the Three FinOps & Hardware Crises with ACE Gateway — ACE Blog
The piece outlines a six‑stage AI infrastructure journey, maps three predictable cost/latency crises, and demonstrates how ACE Gateway’s control‑plane features cut spend and prevent hardware failures at each stage.
- Git at any scale
Cursor explains why Git's packfile design hinders scalable hosting, reviews past solutions like Spokes, and introduces Continuity, a S3‑based write‑ahead log system that provides linearizable, elastically scalable Git storage.
- Miami’s Skyline Is Getting Super Tall
At least 10 new skyscrapers, including five supertalls, are planned for Miami over the next five years, raising concerns about whether such rapid vertical growth is sustainable or wise.
- Power 2026 by Neel Somani - Electricity Pricing in the Age of AI
The primer explains how data center power demand from AI is straining the US grid, details power plant economics and marginal pricing, and outlines the development process using Homer City as a case study.
- Airport Lines Are Grueling. New Programs Aim to Change That.
U.S. airlines and airports are testing new passenger and baggage screening programs designed to significantly cut airport security wait times.
- Is Kentucky About to Give Billions in Tax Breaks to Data Centers? - Kentucky Center for Economic Policy
Kentucky’s data‑center sales‑tax exemption could cost the state over $1 billion in forgone revenue if awarded to just a few large, AI‑optimized facilities.
- Choose DuckDB rather than SQLite
The article argues DuckDB outperforms SQLite for analytical queries due to its columnar storage and vectorized execution, recommending it for data analysis tasks over SQLite's transactional strengths.
- Elevators | Hacker News
The article explores the often-overlooked complexity of elevator systems, from scheduling algorithms to user experience.
- Five Takeaways From the Times Investigation Into Larry Ellison’s A.I. Gamble
The Times investigation reveals Oracle incurred massive debt to build global AI data centers, with repercussions extending beyond the company itself.
- How we set up our cloud agent environment
Cursor rebuilt its monorepo to support cloud agents by matching local dev, simplifying the interface, and adding a self‑healing environment, boosting agent‑authored PRs from 10% to over half.
- A Deluge of A.I. Computing Power Is About to Come Online, Fueling Major Leaps - The New York Times
AI chip count will double roughly every nine months, reaching about 200 million H100‑equivalent units by 2028 as massive data‑center construction ramps up worldwide.
- Networking and the Internet, from First Principles
The article explains the foundational concepts of networking and the Internet, breaking down protocols, layers, and principles from first principles to build intuitive understanding.
- Claude Is Not a Compiler - exe.dev blog
Claude surpasses a compiler by enabling engineers to make cross‑stack decisions—from strategy to machine code—through iterative agent loops, turning vibe‑engineering into real engineering.
- Inside Roblox’s Bet on World Models - ByteByteGo Newsletter
Roblox is pairing its game engine with a video world model (Super Upsampler) to deliver photorealistic, scalable multiplayer games while solving latency, consistency, and creator‑control challenges.
- Introducing EmDash — the spiritual successor to WordPress that solves plugin security
Cloudflare launches EmDash, a serverless TypeScript CMS built on Astro that sandboxed plugins via Workers isolates to solve WordPress security issues while offering MIT licensing and x402 payments.
- Job queues are deceptively tricky
Designing reliable job queues requires careful handling of ordering, duplicate processing, failure retries, backpressure, and visibility, revealing many hidden pitfalls that developers often underestimate.
- Introducing Meerkat: an experiment in global consensus
Cloudflare Research introduces Meerkat, a global consensus service using the QuePaxa algorithm to provide strong consistency and high availability for control‑plane data across its 330+ data centers.
- Current AI – Open Source AI Gap Map
Mozilla's Current AI project maps the open source AI stack, evaluating 24,626 projects to identify gaps and seeking collaborators to close them.
- ‘It’s whack-a-mole’: how Europe’s smart border melted down
Europe's new smart border system (EES) failed at launch due to poor planning, technical glitches, and inadequate testing, causing major delays.
- OpenAI unveils its first custom chip, built by Broadcom
OpenAI unveiled its first custom inference chip, Jalapeño, designed with Broadcom and assisted by OpenAI's own models, claiming better performance-per-watt.
- Postgres transactions are a distributed systems superpower
Co-locating workflow state and application data in Postgres enables atomic transactions that provide exactly-once execution without application-level idempotency logic.
- Run any Dockerfile on Vercel - Vercel
Vercel now supports deploying any HTTP server from a Dockerfile on Fluid compute with autoscaling and CPU-based pricing.
- Why the West stopped making land - Works in Progress Magazine
1970s environmental regulations, not geography or transportation, halted U.S. urban land reclamation despite high land values and housing needs.
- Where Are the Most Data Centers Planned?
Rural areas in the southern United States are expected to host the most planned data centers, despite their noise and power demands.
- SpaceX's newest Starmind will make earth data centers obsolete
SpaceX plans to deploy Starmind, a constellation of one million AI compute satellites in orbit, aiming to make terrestrial data centers obsolete.
- Self-hosted dev sandboxes with preview URLs (Docker, Go, no K8s)
sandboxd is an open-source backend that creates isolated Linux containers with AI coding agents and live preview URLs, all self-hosted on one machine using Docker and Go.
- Buildings May Soon Have ‘Immune Systems’ That Fight Airborne Disease
The U.S. government is investing $150 million in technologies that give buildings immune-like systems to fight airborne diseases, following the pandemic.
- How SpaceX Humiliated Wall Street
SpaceX's Starlink generated more revenue in 2023 than all other commercial space companies combined, demonstrating the financial power of vertical integration and rapid iteration over traditional aerospace contracting.
- What job interviews taught me about Kubernetes
Kubernetes is overly complex for small teams, requiring numerous add-ons and frequent upgrades that outweigh its benefits.
- The Cloud Has Sound: The Unrelenting and Unseen Cost of A.I. Data Centers
Residents near AI data centers report health problems from constant low-frequency vibrations, highlighting an overlooked cost of infrastructure buildout.
- SpaceX & the Sentient Sun
SpaceX's strategy to build a Mars city, lunar factories, and orbital AI data centers is driven by Iain M. Banks' Culture utopia, with Falcon 9 and Starlink funding the stack.
- Inference cost at scale with napkin math
Napkin math shows serving a 32B LLM on an NVIDIA B200 GPU costs ~$9.36 per user per month when 300 users share the GPU with typical idle duty cycles.
- The Scientific Quest for a Perfect World Cup Field
A multi-year scientific initiative aims to engineer identical natural grass surfaces for all World Cup venues to ensure consistent playing conditions.
- What NASA Needs to Stay on Track for the Moon
NASA's Artemis III timeline is ambitious, with experts doubting the agency can meet its goal of returning humans to the Moon by the stated date.
- The evolution of agentic surfaces: building with Claude Managed Agents
Claude Managed Agents decouples model reasoning from code execution to let teams deploy production-grade agents without building custom infrastructure.
- Can NASA Really Land Astronauts on the Moon by 2028?
NASA's 2028 Moon landing goal depends heavily on the decisions and timelines of Elon Musk's SpaceX and Jeff Bezos' Blue Origin.
- Wonder What a Renovated Penn Station Might Look Like? Here’s a Preview.
A $7 billion redevelopment plan for New York's Penn Station would replace cramped corridors with a grand entrance, sweeping staircases, and a glass-walled concourse.
- xAI is looking more like a datacentre REIT than a frontier lab - Martin Alderson
xAI's GPU rental deals with Anthropic and Google transform it into a datacenter REIT-like business, driven by financial engineering, compute shortages, and infrastructure advantages.
- Opinion | You Can Walk to the World Cup in New Jersey. But Should You?
A writer and photographer walk from New York City to MetLife Stadium for the World Cup to test whether fans can bypass expensive transit, finding a fragmented, car-centric route that is technically possible but unsafe and uninviting.
- Give your agent its own computer
LangSmith Sandboxes give each AI agent its own hardware-isolated microVM with filesystem, shell, and package manager, enabling secure code execution without risking host infrastructure.
- DNS is for people - not for IT infrastructure
The author argues that for internal IT infrastructure, DNS adds complexity and risk, and suggests replacing it with tools like Ansible and /etc/hosts for greater reliability and security.
- Just a moment...
This page presents a security verification challenge, likely operated by Cloudflare, that prevents direct access to the underlying article content that was requested.
- AI models are having their iPhone moment. What’s Next? – On my Om
AI capability will continue to accelerate, but like DWDM, it will become invisible infrastructure that enables new applications rather than remaining the focus of conversation.
- the mathematics of multi-tenancy - by almog gavra
Multi-tenancy only reduces costs when workloads are uncorrelated, similar-sized, and numerous; S3 succeeds due to massive scale, workload diversity, and fine-grained object splitting.
- Uber to Offer Shuttles for Fans Leaving World Cup Matches
Uber will operate shuttle services for World Cup fans leaving stadiums in four U.S. cities that lack adequate public transit connections.
- link.mail.beehiiv.com
The linked Beehiiv page does not exist, returning a 404 error.
- Starship V3 | Hacker News
SpaceX's Starship V3 introduces major engine and design upgrades, with a suborbital flight planned to test payload deployment and heatshield inspection.
- GitHub - 2b2tplace/1m_release: The Largest World Download Project in 2b2t, and in Minecraft altogether. Full info + Renders + Timelapses (+ Torrent soon)
A team spent over a year downloading 24 TB of 2b2t Minecraft server world data, covering a 1m² Overworld area and other dimensions, and is preparing a public torrent.
- Frontier labs don’t use most AI compute (yet) - by Josh You
Epoch AI estimates frontier labs use less than half of global AI compute, but OpenAI and Anthropic may soon dominate, requiring economic transformation to sustain scaling.
- What we’ve learned building cloud agents
Cursor's cloud agents perform best when given full development environments, durable execution via Temporal, and a harness that shifts control to the agent.
- SpaceX S-1 | Hacker News
SpaceX's S-1 filing reveals a $1.25B monthly compute deal with Anthropic, prompting debate on profitability and AI infrastructure.
- OpenBSD 7.9 | Hacker News
OpenBSD 7.9 released May 19, 2026, adds experimental WiFi 6, IPv6 SLAAC by default, and mitigates floating-point state leakage on AMD Zen.
- Incident Report: May 19, 2026 – GCP Account Suspension
Hacker News commenters criticize Google Cloud's automated account suspension that took down Railway, questioning the lack of transparency and root cause explanation.
- Sam Altman may start a new compute company - by Alex Heath
Sam Altman is discussing launching a new AI compute company that he would fundraise for, with OpenAI as the majority shareholder.
- How OpenAI delivers low-latency voice AI at scale
OpenAI rearchitected its WebRTC stack into a split relay-plus-transceiver architecture to reduce latency for voice AI at global scale.
- The No-Bid Contract That Is Turning Washington’s Reflecting Pool Blue
President Trump awarded a no-bid contract to a firm he claimed built his pool to repair the Lincoln Memorial Reflecting Pool in Washington, D.C.
- AlphaEvolve: Gemini-powered coding agent scaling impact across fields — Google DeepMind
AlphaEvolve, a Gemini-powered coding agent, has optimized algorithms across genomics, quantum physics, and infrastructure, achieving significant improvements.
- After Stumbles, Technology Meant for Self-Driving Cars Finds a Second Act
Companies developing self-driving car technology pivoted to industrial and smart-city applications, such as managing shipyards and traffic, after autonomous-vehicle hype faded.
- AgentRepo — Git Hosting for Agents
AgentRepo offers git hosting for AI agents with free UUID-based public repos and private repos requiring wallet auth and payment via the x402 protocol.
- SpaceX is starting to move on from the world's most successful rocket - Ars Technica
SpaceX plans to reduce Falcon 9 launches from 165 in 2025 to roughly 140-145 in 2026 as it shifts focus and launch infrastructure toward the larger Starship rocket.
- Higher usage limits for Claude and a compute deal with SpaceX
Anthropic doubles Claude Code rate limits and API capacity for Opus models, enabled by a new compute partnership with SpaceX's Colossus 1 data center.
- Podman rootless containers and the Copy Fail exploit
Podman's rootless containers limit the blast radius of the Copy Fail exploit by using user namespaces to map container root to an unprivileged host user, preventing container escape.
- Amazon’s Durability – Stratechery by Ben Thompson
Amazon's decade-long investments in infrastructure, custom silicon, and physical-world operations position it to dominate the inference era of AI.
Takes
the models have no moat (OpenAI, Anthropic, XAI) the IDEs have no moat (Cursor, Windsurf) the harnesses have no moat (Cognition, Factory, LangChain) the app builders have no moat (Replit, Lovable, Bolt) the wrappers have no moat (Harvey, Abridge, OpenEvidence) the inference providers have no moat (Together, Fireworks, Groq) the voice layer has no moat (Sierra, Decagon, ElevenLabs) the data labeling companies have no moat (Scale, Surge, Mercor) the AI infrastructure has no moat (Baseten, Modal, Railway) the neoclouds have no moat (CoreWeave, Lambda, Crusoe) the generative media companies have no moat (Runway, Higgsfield, Suno) apparently nobody in AI has a moat except the venture firm ☠️
@nikunj
We bought 19 PB of flash storage for our AWS S3 exit in 2025 for about $1.5m. The list price for this setup today would be $19 MILLION 🤑. Don't know if I've ever timed a trade this well in my life. https://world.hey.com/dhh/it-s-five-grand-a-day-to-miss-our-s3-exit-b8293563
@dhh
we moved a lot of our data pipeline to cloudflare and i made a quick video showing it off yes this video is NOT ABOUT AI incredible
@thdxr
if I had to start a new startup from scratch, I'd pick a very boring infra problem. boring problems are owned by lazy giants. and lazy giants have legacy SDKs and confusing docs. in an agent's eyes, that's the whole product.
@zenorocha
for those of you that have very serious applications deployed on cloudflare, do you really manage it all with a wrangler config?
@thdxr
What it actually takes to build agent infrastructure yourself
@harsehaj
i am evaluating all sandbox providers, our requirements are high - fast disk, not networked - fast CPU, should be virtualizing on bare metal - can pause/resume
@thdxr
Dumb question: I’ve been running most of my cron jobs locally on my Mac Mini because it’s already authenticated with Google Workspace and the other apps I use. But should I run these jobs in the cloud instead with these apps OAuth’d to my Claude or ChatGPT account? How should I think about what jobs should stay local vs. move to the cloud?
@petergyang
☁️ I made my own little Cloudflare called Pietflare, it's a DDOS and probe detector with AI and with a central IP / ASN / country block list Each server (VPS) sends suspicious probes, or DDOS attempts etc, from the access logs to the central admin and each server pulls a central blocklist every minute and blocks it in Nginx It has a central dashboard where I can see any threats and then instantly block them but preferably the AI blocks it by itself
@levelsio
A few months ago my kids started vibecoding little web games with Cursor and wanted their friends to play them. GitHub Pages was fine until the games needed real backends, so I hacked together a setup where each game was a folder in one repo that deployed to a Hetzner box on every push. That held up until we shipped FULL SEND for Vibe Jam 2026 and it took off with 38,000+ players. The duct tape needed to become something real, so I rebuilt it properly and pulled it out into its own project. It turns one Linux server into a push-to-deploy host for many apps. The whole thing is a single Go binary that installs and drives Docker, Kamal, Cloudflare, Tailscale, and GitHub for you. After that: - Each app is a GitHub repo. - A git push is live in <5 seconds. - Deploys are zero-downtime. - Each app runs in its own container. - Automatic Cloudflare DNS and TLS tunnels. - SQLite-aware backup and restore. It's deliberately single server using convention over configuration, so for a typical app there's no YAML or Dockerfile to write. The idea is that one decent VPS can reliably run all your projects without per-app bills or piles of infra config. It's built on top of Kamal, so it's basically a Kamal wrapper for the "lots of apps on one server" case, with the Cloudflare, Tailscale, DNS, and backup glue wired up by convention. Setup is one interactive command on a fresh Linux box, which walks you through connecting everything. If you also have a bunch of projects you want to run on a single server, tell your Claude Code, Codex, Cursor, or favorite AI agent to grab a VPS and try it for you. It's fully open source and you can customize it to your liking:
@dvassallo
We're launching code storage and git hosting. Origin gives teams and agents a place to host, review, and collaborate on code. Available this fall. Join the waitlist. https://cursor.com/origin-waitlist
@cursor_ai
Claude Managed Agents can operate in a sandbox you control, on your own infrastructure or with any provider you choose. Today we added new guides for @blaxelAI, @e2b, @googlecloud, @namespacelabs, and @superserve_ai, so you can choose the best fit for your use case.
@ClaudeDevs
We are excited to announce that developers and agents can now provision the same mail-routing intelligence that powers postalform to enable mailing workflows in your own projects! Stripe Projects can automatically create your account, workspace, and let you set spend limits so you can get right into developing. Add mailing infra to your project today with this command: stripe projects add postalform/mail
@postalform
Spending some time tinkering on a flight and realizing that, yeah, all I need is Cloudflare. To do anything. * Compute: Workers * Storage: D1, KV, R2 * IdP: sign-in with Cloudflare through Access * Domain: Cloudflare Registrar * Email: send and receive * AI: Workers AI * Frontier Lab AI: no lock-in, route it to AI Gateway * Containers: sure Create an MCP portal and have an AI agent running in the cloud talk to my Oura and Withings data and email me a dashboard report as if it is my own personal operating system? Yup. I have worked here for 8+ years and sometimes even I just can't believe the platform the team has built is real...
@LakeAustinBlvd
my self-hosted observability stack pairs well with agents
@marckohlbrugge
All types of databases, Redis, Postgres, Clickhouse, Mysql etc. now display important stats and metrics aswell as most run queries in the Maple service map
@makisuo
it's wild -- i spent the last 2 decades of my career putting everything in the cloud and now i'm figuring out how to give colleagues remote access to a mac mini sitting in my downstairs home office
@clairevo
Starlink V3 satellites have >10X bandwidth of V2 and there’ll be >10X launched, which means >100X more bandwidth. Also, altitude will be 350km vs 550km, so min latency can be cut in half. Light travels 300km/ms in space, so physics round trip min latency drops to <5ms.
@elonmusk
Today's Training Data episode takes us BTS on the infrastructure challenges required to do large RL runs at scale, featuring @ellev3n11 (Composer Lead at @cursor_ai) and @dzhulgakov (Co-Founder at @FireworksAI_HQ). The Cursor team trained Composer 2 on Fireworks by starting with a strong base model (Kimi 2.5) and performing large-scale mid-training on code tokens and web data to learn common patterns and libraries, followed by a large-scale Reinforcement Learning run to learn how to navigate the Cursor harness, call tools, and write correct code. Today's episode dives into the systems and infrastructure challenges of making that large RL run happening, and there were many (!!), from numerical mismatch to global distribution to synchronizing rollouts across asynchronous pipelines to keeping track of expert activation across runs and more. Extremely nerdy in-the-weeds challenges that Federico and Dima were delighted to nerd out on together :) Beyond RL infra, we also discussed Online vs Simulated rollouts, self-summarization for long-horizon agents, environment design ("the most powerful RL environment is the product itself"), and other technical nuggets. PS: We filmed this episode before the SpaceX news, while the Cursor team was still compute-constrained. While Cursor now has *all* the flops, the takeaways and hurdles crossed ring true for any serious application-level company that is racing to post-train their own models. I believe that more serious application companies will go the way of Cursor and post-train their own models. 00:00 Introduction 00:53 Why Cursor Trained Composer 2 04:55 Specialization vs Bitter Lesson 06:16 Composer 2 Training Recipe 16:32 Scaling RL Infrastructure Globally 23:32 Floating Point Drift 25:11 MoE Sensitivity Explained 26:25 Router Replay Fix 27:19 Real Time RL Loop 31:49 Long Horizon Agents 34:29 Why RL Everywhere 37:34 LLM as Judge Rewards 39:14 RL in Hard Domains 40:13 Build Your Own Environments 44:34 Closing Thoughts
@sonyatweetybird
Latency vs Throughput vs Bandwidth
@alexxubyte
the one thing @mitsuhiko taught me: merged client & server logs. very useful.
@badlogicgames
Still limited by compute, so I built a thing that runs codex in the cloud, powered by @Cloudflare firecracker boxes (and since that's not beefy enough for larger projects, tests are run via crabbox) Uses Ghostty ofc, via WebAssembly. Codex replicated itself, basically.
@steipete
The bull market in stocks is only beginning. Everyone is underestimating how big the shortage of compute and power exists. The bears are wrong. The bulls are going to make money. Choose wisely.
@APompliano
So @loaibassam asked me my stack recently, I replied: FREE: Nginx web server on Ubuntu (free) Auto upgrade with unattended-upgrade (free) Scheduled workers with Cron (free) Vanilla PHP for site backend (free) Vanilla CSS (free) Vanilla JS for code (free) Game servers I do in vanilla Node JS (free) SQLite for DB (free) Python for tool scripts (free) Cloudflare with Cloudflare tunnel for DNS/SSL (free) Tailscale for security (free) OpenFreeMap for maps (free) CHEAP: xAI for AI API (cheap) Stripe for payments (cheap) Cloudflare R2 for image storage (cheap) Hetzner VPS ($4/mo) Cloudflare domain reg (~$10/year) So about ~$5/mo total costs with about ~5M unique visitors per month per site (these are site averages)
@levelsio
How LLM Inference Works
@akshay_pachaar