Lead Data Engineer ID71008

Agileengine

≈ 174,4 тыс.–196,4 тыс. ₽ · 2,2 тыс.–2,5 тыс. $ · 1,9 тыс.–2,1 тыс. €

7 000 000 – 7 885 000 COP

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Build and govern S3 data lake

•Collaborate with DevOps on requirements

•Define partitioning and schema strategy

•Deploy services on Amazon EKS

•Design ETL pipelines

•Design batch workflows with DAGs

•Implement near real time OLAP processing

•Lead development team and guide engineering practices

•Orchestrate pipelines using Airflow

•Own data pipeline architecture

•Query data using Athena

•Review pull requests and enforce code quality

Условия

•Flexible hours

•Learning budget

•Mentorship

•Performance reviews

•Remote work

•Supportive culture

•Techtalks

•Well-being programs

Технологии: AWS, Amazon Athena, Amazon EKS, Amazon S3, Apache Airflow, Apache Parquet, BigQuery, ClickHouse, DAGs, Data Pipelines, Docker, ETL, FastAPI, Flask, GraphQL, Kubernetes, Linux, MacOS, Near-real-time, OLAP, ORC, Object storage, Partitioning Strategy, PostgreSQL, Presto, Python, REST, Real Time, Schema Design, Snowflake, Spark SQL, Trino, Trino/Presto