Staff Software Engineer- Foundation Model Inference

Databricks

San Francisco, California

🏢 Офис

Senior

Полная занятость

Продуктовая

Tech

Описание вакансии

Обязанности

•Build LLM inference infrastructure for large scale workloads

•Collaborate with platform, infra, and ML teams

•Deliver end to end AI experiences

•Enable developers and data scientists to build and interact with AI

•Improve reliability latency and efficiency of distributed AI workloads

Технологии: CI/CD, Cloud Native, Cloud-native infrastructure, Distributed Systems, GPU Orchestration, Java, Kubernetes, ML Infrastructure, Python, Real Time, Real-time Serving, Scalable APIs, Service Oriented, Service-Oriented Architecture, System Observability