This leader will bring deep experience running high-performance teams, a strong background in distributed system architecture, and hands-on familiarity with multi-vendor integrations. Superior communication and strategic collaboration skills are critical for managing expectations and aligning stakeholders across the entire R&D organization
Strategic Team Leadership: Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers (mostly distributed across North America)
Foster a high-performance culture of technical excellence, predictable delivery, and career growth
High-Scale Operations & Scaling: Own the strategy and architecture of our enterprise AI Gateway - currently processing up to 1 Trillion LLM tokens per week with a projected 10x growth surge driven by agentic workflows (such as SuperAnalyst) - while ensuring high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms
Multi-Vendor Orchestration: Strategically guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability across different providers
Cross-Functional Alignment: Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals
Technical Governance: Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization
For base compensation, we set standard ranges for all roles based on function and level benchmarked against similar stage growth companies and internal comparables. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location
You may also be offered equity, and a generous benefits program