Staff Software Engineer, Inference Infrastructure
Cohere · Montréal, Canada; New York City, United States; San Francisco, United States; Toronto, Canada · Hybrid · Full-time
Team: Inference
Posted: 2026-01-12
Pay: USD 190000 – USD 325000 per year
The Staff Software Engineer for Inference Infrastructure develops, deploys, and operates high-performance AI platforms to serve large language models via scalable API endpoints. The role requires over five years of experience in distributed systems, Kubernetes, and GPU-accelerated production environments, along with proficiency in high-performance languages like Golang or C++.
Skills & tags: distributed systems, kubernetes, gpu infrastructure, golang, c++, inference optimization, cloud computing, linux, machine learning operations, scalable systems
View and apply at the original posting
Postings belong to their employers; this page links to the source.