LLMOps Engineer

Bse Global

Brooklyn, NY 11232

🏢 Офис

Senior

Полная занятость

Продуктовая

Tech

Описание вакансии

Обязанности

•Build CI/CD pipelines for AI systems

•Build evaluation dashboards

•Build sandboxed agent environments

•Build shared evaluation infrastructure

•Define service level objectives for AI reliability

•Design AI infrastructure

•Develop operational playbooks

•Handle deployments and incident response

•Implement governance and security guardrails

•Implement secrets management

•Implement secure environment configuration

•Manage Amazon Bedrock integrations

•Manage environment promotion and rollback

•Measure hallucination and tool call success

•Monitor cost per request metrics

•Operate AI agent systems on AWS

•Operate CodeAI development pipeline

•Set up monitoring with CloudWatch

•Version models and prompts

Условия

•401k employer match

•Company holidays

•Dental insurance

•FSA eligibility

•HSA eligibility

•Health insurance

•Paid time off

•Parental leave

•Vision insurance

Технологии: AWS, Amazon Bedrock, CI/CD, CloudWatch, Docker, Evaluation, Incident Response, Infrastructure as Code, Langchain, Langgraph, Model versioning, Monitoring, Observability, Prompt engineering, SLO, Secrets management, Service Level, Service-Level Objectives, “as-code”