Lead Data Engineer ID71008

Agileengine

≈ 379,9 тыс.–498,8 тыс. ₽ · 4,7 тыс.–6,2 тыс. $ · 4,1 тыс.–5,4 тыс. €

82 500 – 108 333 MXN

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Build near real time processing

•Define Airflow pipeline dependencies

•Design ETL pipelines

•Design partitioning and file formats

•Develop Athena based query workflows

•Drive AWS data lake architecture

•Enforce code quality standards

•Implement schema and data type strategy

•Lead developer team

•Operate Kubernetes workloads on EKS

•Orchestrate batch workflows with DAGs

•Partner with DevOps on requirements

•Provide technical guidance

•Review pull requests

•Run scheduled batch workflows

Условия

•Annual learning budget

•Collaborative culture

•Flexible hours

•Mentorship

•People focused support

•Performance and compensation reviews

•Remote work

•Techtalks

•Well-being programs

•Zero micromanagement

Технологии: AWS Athena, AWS Bedrock, Airflow, Amazon EKS, Amazon S3, BigQuery, Caching, ClickHouse, DAG, Data Lake, Data Partitioning, Docker, ETL, FastAPI, Flask, GraphQL, Kubernetes, Langchain, Linux, Linux Terminal, MacOS, Monorepo Tooling, Near-real-time, Near-real-time Processing, Nx, OLAP, ORC, Object storage, Parquet, Poetry, PostgreSQL, Presto, Pydantic AI, Python, REST API, React, Real-time Processing, Redis, S3 Equivalent Data Lake, SageMaker, Schema Design, Snowflake, Spark SQL, Time processing, Trino, TypeScript, YARN