Чем предстоит заниматься
Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems
Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management
Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages
Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations
Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability