Staff Software Engineer, Inference Infrastructure

Cohere · Montréal, Canada; New York City, United States; San Francisco, United States; Toronto, Canada · Hybrid · Full-time

Team: Inference

Posted: 2026-01-12

Pay: USD 190000 – USD 325000 per year

The Staff Software Engineer for Inference Infrastructure develops, deploys, and operates high-performance AI platforms to serve large language models via scalable API endpoints. The role requires over five years of experience in distributed systems, Kubernetes, and GPU-accelerated production environments, along with proficiency in high-performance languages like Golang or C++.

Skills & tags: distributed systems, kubernetes, gpu infrastructure, golang, c++, inference optimization, cloud computing, linux, machine learning operations, scalable systems

View and apply at the original posting

Postings belong to their employers; this page links to the source.

JOB DETAILS

Job details