150K–295K USD / year

Data Center Hardware Operations Site Lead

OperationsOn-site — Santa Clara, California, United States
Published on 2026-11-20
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.

About this role

Lead the deployment, operation, maintenance, and decommissioning of GPU hardware at a data center site. Own site-level technical escalations and coordinate staff, contractors, facilities, networking, and engineering teams across the hardware lifecycle.

About the company

Baseten is an inference cloud that helps companies run and scale AI models in production with flexible infrastructure and developer tooling.

The team

EPD, Engineering, Hardware Virtualization

Stack

LinuxipmitooldmesglspciNVIDIA GPUsInfiniBandRoCECisco IOS

What you'll do

  • Lead GPU cluster rack-and-stack, cabling, and turn-up.
  • Plan data hall layouts, rack elevations, and power, cooling, and network capacity.
  • Own hardware diagnostics, break/fix, upgrades, RMAs, and decommissioning.
  • Coordinate cross-connect testing and remediation with the network team.
  • Respond to facility alarms with DC Facilities and assess hardware impact.
  • Write and execute MOPs and SOPs; conduct equipment inspections and audits.
  • Manage site labor, contractors, receiving, spares, and DCIM inventory.
  • Maintain site standards and safety practices, and mentor hardware operations staff.

What we're looking for

  • 6+ years of data center operations experience, including 2+ years in a lead or supervisory role.
  • Hands-on experience racking, stacking, and cabling servers and network equipment at scale.
  • Experience across the bare-metal server lifecycle, from installation through decommissioning.
  • Comfort using Linux command-line tools for hardware diagnostics.
  • Working knowledge of data center networking and electrical and mechanical systems.
  • Experience leading data center projects and coordinating contractors and cross-functional teams.
  • Able to work onsite in Santa Clara, CA or Westlake, TX, lift up to 50 lbs, work at heights, and participate in 24/7 on-call rotation.
  • Bachelor's degree in a technical field or equivalent practical experience.

Nice to have

  • Experience with large NVIDIA GPU clusters, such as HGX/DGX H100, H200, or B200.
  • Direct liquid-cooling experience, including CDUs and leak response.
  • Data hall construction, commissioning, or new-site setup experience.
  • Experience with InfiniBand or RoCE, network operating systems, or DCIM tools.
  • Python or Bash scripting for diagnostics or inventory automation.
  • CompTIA Server+ or Network+ certification.

Benefits

  • Meaningful equity.
  • Medical, dental, and vision coverage for employees and dependents at 100% (U.S. only).
  • Flexible PTO.
  • Paid parental leave.
  • Fertility and family-building stipend.
  • Company-facilitated 401(k) (U.S. only).
View original job post