On-Prem AI Is a Bet on Control
Dell booked $12.3 billion in AI server orders in a single quarter — $30 billion year to date, with an $18.4 billion backlog and a five-quarter pipeline the company says is multiples of that, per…
Posts tagged “AI Infrastructure”
Loading Tool Schemas on Demand Is How Agents Scale
An agent connected to five MCP servers can burn 55,000 tokens on tool schemas before it reads the first word of your request. GitHub's server ships 35 tools at roughly 26K tokens. Slack adds 11…
Renting Compute From Three Clouds Is the Default Now
The companies with the most control over chip supply on the planet still rent across three cloud providers. That is the fact that should reset how a platform team thinks about AI infrastructure.…
The Great AI Reckoning: What 2025 Taught Us About Hype vs. Reality
2025 was supposed to be the year AI changed everything. The promises were bold: AI agents would "materially change the output of companies," scientific breakthroughs would accelerate, and the…
The Agentic AI Foundation: Why the Industry's Biggest Rivals Just Agreed on Something Huge (And What CTOs Need to Know)
Something unprecedented happened in AI this week. The companies most aggressively competing to dominate the AI landscape—OpenAI, Anthropic, Google, Microsoft, Amazon, and dozens of others—just…
The Hidden Infrastructure Cost of Running Local LLMs vs Cloud APIs: A Real-World TCO Analysis for Enterprise Deployments
The conversation around AI infrastructure costs has shifted dramatically in the past year. Every CTO and engineering leader is asking the same question: should we run our own LLMs or stick with…
The Hidden AI Vendor Dependency Crisis: How to Build AI Systems That Survive Platform Wars
The enterprise AI landscape is experiencing a seismic shift that most CTOs haven't fully grasped yet. While we've been laser-focused on AI implementation and performance metrics, a more…
The 7x Problem: Why Your AI Workloads Are Breaking the Grid (And What to Do About It)
The numbers are staggering: generative AI training clusters consume 7-8 times more energy than traditional computing workloads. That's not a typo. Seven to eight times. As data center power…
New Hire Onboarding in the Era of AI
Having built teams for over two decades, I've watched onboarding evolve from handwritten manuals to polished video libraries. But as AI reshapes how we work, it's time to ask some hard questions…
Building the Future of AI: Sustainable, Reliable Cloud Infrastructure for a New Era
As artificial intelligence continues to transform industries, the demand for specialized cloud infrastructure has reached unprecedented heights. The next generation of AI applications requires not…