Lead Data Engineer ID71008

Agileengine

≈ 418,4 тыс.–519,4 тыс. ₽ · 5,2 тыс.–6,5 тыс. $ · 4,6 тыс.–5,7 тыс. €

26 583 – 33 000 BRL

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Coordinate requirements with DevOps team

•Create Airflow DAG workflows

•Define near real time OLAP processing

•Design data lake architecture

•Enforce code quality standards

•Govern schema and file format strategy

•Lead development team technical direction

•Orchestrate batch scheduled jobs

•Own ETL pipeline design

•Partition data lake datasets

•Review pull requests

Условия

•Annual learning budget

•Flexible hours

•Mentorship

•People focused support

•Remote work

•Technical talks

•Well-being programs

Технологии: AWS Data, AWS Data Ecosystem, Amazon EKS, Amazon S3, Apache Airflow, Athena, BigQuery, ClickHouse, Dagster, Data Ecosystem, Data Lake, Data pipeline, Docker, ETL, FastAPI, Flask, GraphQL, Kubernetes, Linux, Luigi, MacOS, Near-real-time, Near-real-time Processing, OLAP, ORC, Parquet, Partitioning, PostgreSQL, Prefect, Presto, Python, REST API, Real-time Processing, Schema Design, Snowflake, Spark SQL, Step Functions, Terminal Environments, Time processing, Trino