How We Built a Greener AI Data Center and Saved Millions

Published 2024-06-23 · Updated 2026-05-23 · 8 min read · AI Hardware and Infrastructure · By Sahin Boydas

After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.

A founder asked me last week about how we built a greener ai data center and saved millions. My answer surprised them, and it might surprise you too.

After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.

The Reality Nobody Talks About

Most people approach how we built a greener ai data center and saved millions with assumptions that made sense five years ago. The world has moved on. When I look at my portfolio companies, the ones that succeed are doing something fundamentally different.

The first thing to understand is that the market doesn't care about your roadmap. I've seen this play out across dozens of companies. The pattern is unmistakable.

At RemoteTeam, we learned this the hard way. We spent months going down the wrong path before realizing that most founders overthink this and underspend on execution. Once we made the switch, everything changed.

The Framework That Actually Works

I'm going to share the exact framework I use when evaluating how we built a greener ai data center and saved millions. It's not complicated, but it requires discipline.

Step 1: simplicity beats complexity every time This is where most people go wrong. They skip this step entirely and jump straight to execution. Don't do that.

Step 2: your team matters more than your technology Once you have the foundation right, this becomes much easier. I've watched founders struggle with this for months when the answer was staring them in the face.

Step 3: Iterate relentlessly Nothing works perfectly the first time. The companies in my portfolio that nail how we built a greener ai data center and saved millions are the ones that treat it as an ongoing process, not a one-time project.

What I've Learned From 46 Companies

After investing in 200+ startups and running two companies to successful exits, I've developed a pretty clear picture of what works with how we built a greener ai data center and saved millions.

The biggest misconception is that you need to simplicity beats complexity every time. That's backwards. The companies that win are the ones that most founders overthink this and underspend on execution.

I remember sitting with the Anthropic team early on and discussing how they thought about how we built a greener ai data center and saved millions. Their approach was counterintuitive but brilliant.

Lessons From the Trenches

I want to share a few specific lessons I've picked up over the years. These aren't theoretical. They come from real companies, real failures, and real successes.

Lesson 1: The best time to start thinking about how we built a greener ai data center and saved millions was yesterday. The second best time is now. Don't wait until you have the perfect plan.

Lesson 2: Hire for attitude, train for skill. The best how we built a greener ai data center and saved millions practitioners I've met weren't the most technically gifted. They were the most curious and persistent.

Lesson 3: Your competitors are probably getting this wrong too. That's your opportunity. While everyone else is following the same playbook, you can zig when they zag.

This connects to broader themes around AI cloud, NVIDIA, AI chips, GPU shortage that I've been thinking about a lot lately.

What's Next

The world of how we built a greener ai data center and saved millions is moving fast. What worked last year might not work next year. That's both the challenge and the opportunity.

My advice: stay curious, stay humble, and stay close to the people who are actually doing the work. Read less thought leadership and do more experiments. Talk to fewer consultants and more practitioners.

And if you're a founder building in this space, remember that the best time to get how we built a greener ai data center and saved millions right is before you need to. Don't wait for a crisis to force your hand.

I'll keep sharing what I learn. This stuff matters too much to keep to myself.

Frequently Asked Questions

What's the most common pushback you get on this?

People often push back by citing exceptions or edge cases. And they're usually right that exceptions exist. But building a strategy around exceptions rather than patterns is a losing game for most founders.

What experience informs this perspective?

This perspective comes from over a decade of building companies in Silicon Valley, two successful exits (RemoteTeam to Gusto, MovieLaLa to Gfycat), and investing in 200+ startups including Anthropic, OpenAI, and Scale AI. I write about what I've lived.

How can I apply this thinking to my own situation?

Start by identifying the core principle behind the opinion, not the specific example. Then ask yourself: does this principle apply to my context? If yes, test it in a small, low-risk way before going all in.

More in AI Hardware and Infrastructure

  • From TPU to Your Own Custom Silicon: A Founder's Journey — After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.
  • Surviving the GPU Apocalypse: A Founder's Guide to the Shortage — After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.
  • The 6 AI Infrastructure Mistakes That Are Secretly Killing Your Startup — After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.
  • Cerebras Systems — Portfolio Company | Angel Investment by Sahin Boydas — Building the world's largest AI chips for training and inference at unprecedented scale.
  • Why the Future of AI Is Not in the Cloud 338 — After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.
  • The Counterintuitive Truth About AI Chip Design 869 — After years in the trenches of Silicon Valley, I've seen firsthand how the right AI hardware can make or break a company. I'm sharing the hard-won lessons and contrarian insights I wish I had when I started, from navigating the GPU shortage to building our own custom silicon.

All AI Hardware and Infrastructure articles · Sahin's angel investments · Startups he founded