Reading up on Nvidia
98 deep · digging since nov 19, 25
- Data for Agents
NVIDIA argues that open synthetic data is essential for building inspectable, trustworthy AI agents while preserving proprietary secrets and fostering community collaboration.
- Are the ‘MANGOS’ Stocks Already Turning Soft?
The MANGOS stocks—Meta, Anthropic, Nvidia, and others—show early signs of softening performance as the AI boom's momentum begins to fade.
- OpenAI unveils its first custom chip, built by Broadcom
OpenAI unveiled its first custom inference chip, Jalapeño, designed with Broadcom and assisted by OpenAI's own models, claiming better performance-per-watt.
- The gap between open weights LLMs and closed source LLMs
Hacker News commenters debate the sustainability of open-weights LLMs, arguing they cannot be taken away once downloaded despite potential future restrictions or discontinuation by funders.
- Why American data centers can't plug in
The AI buildout is bottlenecked by the slow grid interconnection process, not a power generation shortage, requiring reforms to connect data centers faster.
- AI coding agents taught robots how to install GPUs and cut zip ties - Ars Technica
Nvidia's ENPIRE harness lets AI coding agents autonomously train robots to perform physical tasks like cutting zip ties and installing GPUs.
- The Cloud Has Sound: The Unrelenting and Unseen Cost of A.I. Data Centers
Residents near AI data centers report health problems from constant low-frequency vibrations, highlighting an overlooked cost of infrastructure buildout.
- It’s Not Just Nvidia. The A.I. Boom Has Ignited Asia’s Chip Companies.
Asia's chip suppliers, not just Nvidia, are surging from AI data-center demand, shifting the global tech power balance.
- A modest proposal: Reformat everything to make documents more palatable to AI
A Linux Foundation working group proposes DocLang, an XML-based document format optimized for LLM tokenizers to reduce cost and improve accuracy in enterprise AI document processing.
- A Guide to AI Inference Engineering - ByteByteGo Newsletter
LLM inference splits into compute-bound prefill and memory-bound decode, driving optimization techniques like batching, quantization, speculative decoding, and disaggregation.
- Opinion | The Global Bull Market That A.I. Obscures
Since early 2025, international markets have outperformed the U.S. — emerging economies up 68%, Europe 45%, Japan 44% — driven by the global AI infrastructure supply chain and corporate reforms.
- The Untrainable - Sarah Guo
As AI models commoditize measurable tasks, lasting value lies in 'untrainable' work requiring private data, trust, organizational change, and domain-specific authority.
- South Korea is obsessing over Nvidia CEO Jensen Huang's visit
South Korean investors track Nvidia CEO Jensen Huang's every move during his celebrity-like visit, hoping for deeper tech supply-chain ties.
- Silicon Frontier
Control over semiconductor supply chains, from ASML's lithography to TSMC's manufacturing and NVIDIA's CUDA ecosystem, determines which entities dominate the AI era.
- A Functional Taxonomy of World Models - Dr. Fei-Fei Li
Fei-Fei Li proposes a taxonomy of world models into renderers, simulators, and planners, arguing simulation is the most consequential and underappreciated category.
- AI models are having their iPhone moment. What’s Next? – On my Om
AI capability will continue to accelerate, but like DWDM, it will become invisible infrastructure that enables new applications rather than remaining the focus of conversation.
- Codex for every role, tool, and workflow
OpenAI launched role-specific plugins, Sites, and annotations for Codex, enabling non-developers to build apps, dashboards, and reports across 62 apps.
- Introducing Surface Laptop Ultra: Made for world makers
Microsoft announces Surface Laptop Ultra with NVIDIA Blackwell GPU, up to 128GB unified memory, and 1 petaflop AI compute for creators and developers.
- Nvidia Has a Plan to Put Its Chips in Personal Computers
Nvidia aims to bring AI agents to PCs, competing with Intel and Apple by putting its chips in laptops and desktops.
- Things I Think I Think... The New Internet Era
Drawing on dot-com history, predicts AI-focused companies like OpenAI and Anthropic will collapse while incumbents like Apple, Microsoft, and Meta survive by treating AI as a means, not an end.
- The SpaceX IPO and Data Centers in Space – Stratechery by Ben Thompson
SpaceX's $2T IPO lacks financial justification, but data centers in space for agentic AI inference could make the valuation plausible.
- Is AI Profitable Yet?
Frontier AI companies have spent $1.5T on infrastructure and operations but earned only $769B in revenue, leaving nearly all heavily unprofitable while Nvidia captures the majority of profits.
- The Inference Shift
The AI compute market is shifting from homogeneous GPU clusters for training toward heterogeneous hardware for inference, where Cerebras' wafer-scale chips excel at high-speed token generation but may be overshadowed by agentic inference's need for large memory rather than raw speed.
- Trump Approved a Nvidia Chip for Sale in China. Beijing Doesn’t Want It.
Despite Trump administration approval of Nvidia's powerful H200 chip for sale in China, not a single unit has been purchased by Beijing.
- Nvidia’s Profit Hits $58.3 Billion as A.I. Boom Gathers More Steam
Nvidia reported $58.3 billion profit in its latest quarter, a 211% year-over-year increase, driven by surging demand from big tech companies for A.I. chips.
- Cheap AI could derail OpenAI and Anthropic's IPOs
The article argues that cheap AI from Chinese labs and Western alternatives is eroding the pricing power and market share underpinning OpenAI and Anthropic's high IPO valuations.
- The haves and have nots of the AI gold rush
A Menlo Ventures partner says the AI boom has created a stark divide where roughly 10,000 people have achieved retirement wealth while many software engineers face layoffs and career uncertainty.
- 2028: Two scenarios for global AI leadership
Anthropic argues that US export controls on AI chips must be tightened to ensure democracies maintain a decisive lead over China's authoritarian regime by 2028.
- Chinese AI engineers are Silicon Valley’s new power players - Rest of World
Chinese-born AI researchers and founders have become central to Silicon Valley's boom, driven by elite math training, relentless work ethic, and intense career anxiety.
- US Said to Suspect Nvidia Chips Smuggled to Alibaba Via Thailand
US intelligence believes Nvidia's advanced AI chips were smuggled to Alibaba through Thailand, potentially violating export controls.
- Higher usage limits for Claude and a compute deal with SpaceX
Anthropic doubles Claude Code rate limits and API capacity for Opus models, enabled by a new compute partnership with SpaceX's Colossus 1 data center.
- 15 Stocks That Made Investors the Most Money Over the Past 10 Years
Over the past 10 years, 15 stocks created $27 trillion in shareholder wealth, led by tech companies with wide economic moats and strong growth.
- AI Has Made Memory Chips One of the World’s Most Profitable Products - WSJ
Riding the AI infrastructure boom, memory-chip makers Samsung, SK Hynix, and Micron are posting record profits, making memory one of the world's most profitable products.
- The World Can't Keep Up With AI Labs - LessWrong 2.0 viewer
AI labs see explosive revenue from coding agents, but infrastructure bottlenecks in memory, energy, and chip manufacturing will constrain growth and raise prices.
- Building a Fast Multilingual OCR Model with Synthetic Data
NVIDIA's Nemotron OCR v2 uses 12 million synthetic training images to achieve near-zero error rates across six languages at 34.7 pages per second on an A100.
- The Beginning of Scarcity in AI
GPU rental prices surged 48% in 60 days, signaling an AI compute shortage that will reshape startup competition and access to frontier models.
- Amazon CEO takes aim at Nvidia, Intel, Starlink, more in annual shareholder letter
Amazon CEO Andy Jassy's shareholder letter defends $200B capex by touting custom AI chips and satellite internet, while challenging Nvidia, Intel, and Starlink.
- How Jensen Manifests The Future - by Trungphan2
Jensen Huang's GTC keynote reveals his strategy of 'manifesting the future' through category coronation to shape industry belief systems and drive demand for Nvidia's AI compute.
- Build a Domain-Specific Embedding Model in Under a Day
NVIDIA details a six-command pipeline using synthetic data generation and hard negative mining to fine-tune an embedding model on a single GPU in under a day, achieving over 10% retrieval improvement.
- U.S. Says 3 Tied to Silicon Valley Server Maker Broke Export Laws - The New York Times
U.S. prosecutors accused three men, including a Super Micro co-founder, of diverting servers with Nvidia AI chips to China in violation of export laws.
- Greetings, Earthlings: Philip Johnston of Starcloud on Data Centers in Space
Falling launch costs and rising terrestrial constraints will make space-based AI data centers cheaper than Earth-based ones within a decade, potentially creating a trillion-dollar annual CapEx market for inference workloads.
- Unsloth Studio | Hacker News
Unsloth launches Unsloth Studio, an open-source, no-code web UI for locally running, training, and exporting 500+ open models with 2x faster training and 70% less VRAM.
- GitHub - NVIDIA/OpenShell: OpenShell is the safe, private runtime for autonomous AI agents.
NVIDIA OpenShell provides a sandboxed runtime with YAML-policy enforcement for filesystem, network, process, and inference access, protecting credentials and infrastructure during autonomous AI agent execution.
- Nvidia Debuts New A.I. Product at GTC Developer Conference - The New York Times
Nvidia announced a new AI product at its GTC conference, leveraging recent acquisition technology to demonstrate evolving AI capabilities.
- NVIDIA GTC Keynote 2026 - YouTube
Jensen Huang's GTC 2026 keynote unveils NVIDIA's latest AI and accelerated computing breakthroughs, focusing on agentic AI advancements.
- The emerging role of SRAM-centric chips in AI inference
SRAM-centric chips outperform GPUs on memory-bound AI inference workloads, particularly decode, by placing memory near compute for faster bandwidth.
- Jensen Huang says Nvidia is pulling back from OpenAI and Anthropic
Nvidia CEO Jensen Huang says the company's recent major investments in OpenAI and Anthropic are likely its last, as both startups prepare for public offerings.
- Anthropic's Compute Advantage: Why Silicon Strategy is Becoming an AI Moat
Anthropic's compute strategy—multi-hyperscaler, custom-silicon integration—gives it a 30–60% cost-per-token advantage over Nvidia-dependent OpenAI, a compounding edge as inference scales.
- Scaling AI for everyone
OpenAI raises $110B at $730B valuation from SoftBank, NVIDIA, and Amazon to scale AI infrastructure and products.
- [2602.21193] On Data Engineering for Scaling LLM Terminal Capabilities
NVIDIA's Nemotron-Terminal models, trained on a new open-source synthetic dataset, dramatically boost terminal task accuracy, with the 32B parameter version matching much larger models on Terminal-Bench 2.0.
- Nvidia’s Quarterly Profit Hits $43 Billion on Strong A.I. Chip Sales - The New York Times
Nvidia's quarterly profit hit $43 billion from strong AI chip sales, with annual profit surging to $120 billion, up from $4.4 billion three years earlier.
- Implementing a secure sandbox for local agents
Cursor built OS-level sandboxes for coding agents, reducing approval prompts by 40% via Seatbelt on macOS, Landlock+seccomp on Linux, and WSL2 on Windows.
- Moats in the Age of AI
As AI models and software commoditize, moats erode for pure software/AI firms; value concentrates in compute, energy, and relationship-based assets.
- Runway’s $5.3B valuation fuels world models
Video AI firm Runway raised $315M at a $5.3B valuation to develop world models, betting on AI that understands physical reality.
- 🎙️Nathan Lambert: Open Models Will Never Catch Up
Nathan Lambert argues open models will never catch up to closed frontier systems due to resource gaps, but are crucial for US AI research and policy as an engine for exploration.
- GPT-5.3-Codex | Hacker News
OpenAI releases GPT-5.3-Codex, a faster agentic coding model that achieves state-of-the-art results on SWE-Bench Pro and Terminal-Bench 2.0.
- DSHR's Blog: Mind The GAAP Again
Hyperscalers and pure-play AI companies face a severe accounting mismatch between straight-line depreciation of GPUs and their rapidly declining value, potentially hiding hundreds of billions in future charges.
- Introducing GPT-5.3-Codex
OpenAI launches GPT-5.3-Codex, a coding agent that improves on prior benchmarks, runs 25% faster, and was used to develop itself.
- The AI Boom Is Coming for Apple’s Profit Margins - WSJ
AI companies are outbidding Apple for components like chips and memory, squeezing Apple's profit margins and potentially raising consumer prices.
- Ask HN: What's the current best local/open speech-to-speech setup?
Developers find that truly local, low-latency speech-to-speech AI is not yet achievable with end-to-end open models, so the best 2026 setups combine streaming ASR, LLM, and TTS on a single GPU using frameworks like Pipecat.
- Apple's AI Game is Misunderstood - by Dave Friedman
Apple's AI strategy bets on-device inference using its 2.2 billion devices as pre-deployed infrastructure, avoiding cloud compute costs.
- Please don't say mean things about the AI I just invested a billion dollars in
A Hacker News discussion satirically mocks AI executives who complain about criticism while their technology is used for scams and surveillance, highlighting the disconnect between hype and reality.
- How GPUs Became the Newest Financial Asset
GPUs are being financialized as a new asset class through debt securitization, derivatives, and tokenization, despite rapid obsolescence threatening traditional financial infrastructure.
- Apple vs. the AI Hype Cycle - Eric Lamb
Apple's durable hardware ecosystem makes it resilient to an AI market correction, unlike peers priced on AI optimism.
- Nanolang: A tiny experimental language designed to be targeted by coding LLMs
Nanolang is a minimal experimental language with prefix notation and compile-time tests, designed to reduce coding errors made by LLMs.
- Nvidia Stock Crash Prediction
Using options implied volatility, the article estimates a ~10% chance that Nvidia's stock closes below $100 in 2026, sparking debate on AI bubble risks and competition.
- Apple is fighting for TSMC capacity as Nvidia takes center stage
Apple is losing its position as TSMC's largest client to Nvidia, facing capacity competition and price hikes as AI demand drives Nvidia's chip production.
- The AI data center deals that no one can verify
AI infrastructure deals lack standardized verification, making headline numbers appear as binding commitments when they are actually contingent options.
- The AI revolution is here. Will the economy survive the transition?
Anthropic's co-founder Jack Clark, investor Michael Burry, and podcaster Dwarkesh Patel debate whether AI spending is a historic capital misallocation or justified by rapid capability gains.
- Global AI computing capacity is doubling every 7 months
Global AI computing capacity from chips has grown 3.3x per year since 2022, doubling every seven months, with NVIDIA supplying over 60%.
- Nvidia Unveils Faster AI Chips Sooner Than Expected - WSJ
At CES, Nvidia CEO Jensen Huang unveiled the next-generation Vera Rubin AI server systems, signaling faster chip development cycles driven by the AI race.
- Linux is good now
The HN discussion reveals that while Linux desktop has made significant strides in usability and gaming, it still faces compatibility hurdles and a steep learning curve for non-technical users.
- Tracks vs. Trains: Why the Real Artificial Intelligence Boom Hasn’t Started Yet – Insights for 2026 – shawnHarris()
The AI infrastructure bubble is peaking in 2026, and value will shift to application-layer companies that leverage cheap, abundant compute to transform industries.
- GitHub - LMCache/LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
LMCache is a vendor-neutral KV cache management layer that reduces time-to-first-token and improves throughput for LLM inference by enabling persistent storage and reuse of cached states.
- AI Shifts Expectations for Entry Level Jobs - IEEE Spectrum
AI is reducing entry-level programming jobs but augmenting others, requiring graduates to focus on higher-order skills and AI proficiency.
- Reflections on 2025 - Samuel Albanie
AI progress follows compute scaling, making evaluation increasingly difficult but promising radical improvements in infrastructure and economic decision-making.
- OpenAI's cash burn will be one of the big bubble questions of 2026
Hacker News commenters argue OpenAI's high valuation and spending mirror historical railroad bubbles, predicting a market downturn by 2026.
- The easiest way to stay up to date with stocks
NVIDIA reported 122% revenue growth in Q2 and 171% in H1 fiscal 2025, driven by strong demand in the Compute & Networking segment.
- The Architects of AI: Person of the Year 2025
TIME names Jensen Huang and other AI leaders as Person of the Year, arguing their technology reshaped global economy, geopolitics, and daily life in 2025.
- Building a High-End AI Desktop
An engineer bought a discounted Grace-Hopper server, converted it to water cooling, and now runs 235B parameter models locally for under €9,000.
- Trump’s Nvidia Chip Deal Reverses Decades of Technology Restrictions - The New York Times
Trump’s decision to let Nvidia sell chips to China prioritizes short-term economic gain over long-term US security interests.
- Trump Eases Limits on Nvidia Exports to China at ‘Critical Moment’ - The New York Times
President Trump said Nvidia can export some chips to China, but past U.S. restrictions have accelerated China's domestic AI chip development.
- The RAM Shortage Comes for Us All
AI datacenter buildouts have caused a severe RAM shortage, with DDR5 prices tripling, forcing companies to raise prices or halt consumer product lines.
- Google, Nvidia, and OpenAI
Ben Thompson argues that Google's structural advantages give it a strong AI position, but OpenAI could win by adding an ad-supported model to ChatGPT.
- AMD’s Lisa Su is Staring Down Nvidia and Talk of an AI Bubble - WSJ
After pivoting to focus entirely on AI in 2022, AMD CEO Lisa Su has quadrupled the company's market value, positioning it as a strong second-place rival to Nvidia in the AI chip market.
- The A.I. Boom Has Found Another Gear. Why Can’t People Shake Their Worries? - The New York Times
The article reports that the AI boom is generating historic profits, stock prices, and deal prices, yet public anxiety over the rapid growth persists.
- OpenAI's dominance is unlike anything Silicon Valley has ever seen
OpenAI's unique private status, massive spending, and vertical expansion up and down the stack create unprecedented dominance and uncertainty for AI startups.
- The Scaling Wall Was A Mirage
Gemini 3's performance leap and Nvidia's $0.5 trillion revenue visibility confirm AI scaling laws are accelerating, not plateauing.
- Nvidia Earnings Show Profit Jumped 65% to $31.9 Billion - The New York Times
Nvidia reported a 65% profit increase to $31.9 billion and revenue of $57 billion, driven by demand for its AI chips.
- How Trump and Nvidia’s C.E.O. Became Partners on the International Stage - The New York Times
President Trump and Nvidia CEO Jensen Huang have formed a partnership as Nvidia chips become a tool in trade and peace talks.
- Nvidia Earnings Show Profit Jumped 65% to $31.9 Billion - The New York Times
Nvidia reported a 65% profit increase to $31.9 billion and revenue of $57 billion in its latest quarter, driven by AI chip demand.
- Exclusive | AI Music Platform Suno Valued at $2.45 Billion - WSJ
Suno raised $250 million at a $2.45 billion valuation, with annual revenue reaching $200 million from subscriptions.
- Robotaxis and Suburbia – Stratechery by Ben Thompson
Robotaxis and same-hour delivery will shrink the convenience gap between suburbs and cities, potentially ending the urbanist revival and challenging Uber's long-term model.
- GPU depreciation could be the next big crisis coming for AI hyperscalers — after spending billions on buildouts, next-gen upgrades may amplify cashflow quirks
Rapid GPU upgrade cycles threaten to make hyperscalers' hardware unprofitable, creating a financial crisis from accelerated depreciation and risky loans.
Takes
The laptop hasn't changed in 30 years. NVIDIA just changed it RTX Spark is their first PC chip ever. - RTX 5070 level GPU - 128GB unified memory - 1 petaflop of local AI - thin, light, barely throttles unplugged Your AI agent lives on the machine. 24/7. No cloud. This is step one of the agentic AI PC, and everyone else is about to copy it.
@shiri_shh
The vibes in SF feel pretty frenetic right now. The divide in outcomes is the worst I've ever seen. Over the last 5yrs, a group of ~10k people - employees at Anthropic, OpenAI, xAI, Nvidia, Meta TBD, founders - have hit retirement wealth of well above $20M (back of the envelope AI estimation). Everyone outside that group feels like they can work their well-paying (but <$500k) job for their whole life and never get there. Worse yet, layoffs are in full swing. Many software engineers feel like their life's skill is no longer useful. The day to day role of most jobs has changed overnight with AI. As a result, 1. The corporate ladder looks like the wrong building to climb. Everyone's trying to align with a new set of career "paths": should I be a founder? Is it too late to join Anthropic / OpenAI? should I get into AI? what company stock will 10x next? People are demanding higher salaries and switching jobs more and more. 2. There’s a deep malaise about work (and its future). Why even work at all for “peanuts”? Will my job even exist in a few years? Many feel helpless. You hear the “permanent underclass” conversation a lot, esp from young people. It's hard to focus on doing good work when you think "man, if I joined Anthropic 2yrs ago, I could retire" 3. The mid to late middle managers feel paralyzed. Many have families and don't feel like they have the energy or network to just "start a company". They don't particularly have any AI skills. They see the writing on the wall: middle management is being hollowed out in many companies. 4. The rich aren’t particularly happy either. No one is shedding tears for them (and rightfully so). But those who have "made it" experience a profound lack of purpose too. Some have gone from <$150k to >$50M in a few years with no ramp. It flips your life plans upside down. For some, comparison is the thief of joy. For some, they escape to NYC to "live life". For others still, they start companies "just cuz", often to win status points. They never imagined that by age 30, they'd be set. I once asked a post-economic founder friend why they didn't just sell the co and they said "and do what? right now, everyone wants to talk to me. if i sell, I will only have money." I understand that many reading this scoff at the champagne problems of the valley. Society is warped in this tech bubble. What is often well-off anywhere else in the world is bang average here. Unlike many other places, tenure, intelligence and hard work can be loosely correlated with outcomes in the Bay. Living through a societally transformative gold rush in that environment can be paralyzing. "Am I in the right place? Should I move? Is there time still left? Am I gonna make it?" It psychologically torments many who have moved here in search of "success". Ironically, a frequent side effect of this torment is to spin up the very products making everyone rich in hopes that you too can vibecode your path to economic enlightenment.
@deedydas
Thank you Jensen and NVIDIA! She’s a real beauty! I was told I’d be getting a secret gift, with a hint that it requires 20 amps. (So I knew it had to be good). She’ll make for a beautiful, spacious home for my Dobby the House Elf claw, among lots of other tinkering, thank you!!
@karpathy
Understanding the Five-Layer AI Stack
@NVIDIAAI