Lead Data Engineer ID71008

Agileengine

≈ 1,1 млн–1,3 млн ₽ · 11,5 тыс.–14,4 тыс. €

13 167 – 16 500 $

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Build Airflow DAG workflows

•Define schema and data type strategy

•Design and own ETL pipelines

•Design data lake partitioning strategy

•Drive AWS data stack adoption

•Guide senior developers and ensure engineering alignment

•Implement near real time processing

•Orchestrate scheduled batch pipelines

•Partner with DevOps team on requirements

•Review pull requests and enforce code quality

Условия

•Annual learning budget

•Flexible hours

•Mentorship

•People focused support

•Performance reviews

•Remote work

•Supportive culture

•Techtalks

•Well-being programs

Технологии: Amazon S3, Apache Airflow, Apache Spark, Apache Spark SQL, Athena, BigQuery, ClickHouse, DAG, Data Lake, Data Partitioning, Docker, EKS, ETL, FastAPI, Flask, GraphQL, Kubernetes, ORC, Parquet, PostgreSQL, Presto, Python, REST, S3 Data Lake, SQL, Schema Design, Snowflake, Spark SQL, Trino