Lead Data Engineer ID71008

Agileengine

≈ 1,1 млн–1,3 млн ₽ · 11,5 тыс.–14,4 тыс. €

13 167 – 16 500 $

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Collaborate with DevOps on requirements

•Create Airflow DAG workflows

•Define near real time processing strategy

•Deploy and manage EKS Kubernetes workloads

•Design ETL pipelines

•Design OLAP analytical data architecture

•Design partitioning file formats schema

•Drive AWS data lake and analytics stack

•Extract transform validate data

•Lead developers and align engineering practices

•Orchestrate scheduled batch workflows

•Own data pipeline architecture

•Review pull requests and enforce code quality

Условия

•Annual learning budget

•Flexible hours

•Mentorship

•Remote work

•Support programs

•Techtalks

•Well-being programs

Технологии: AWS Data, AWS Data Ecosystem, Airflow, Amazon S3, Athena, BigQuery, CI/CD, ClickHouse, DAG, Data Ecosystem, Docker, Docker Compose, EKS, ETL, FastAPI, Flask, GraphQL, Kubernetes, Near-real-time, Near-real-time Processing, OLAP, ORC, Object storage, Parquet, Partitioning, PostgreSQL, Presto, Python, REST, Real-time Processing, Schema Design, Snowflake, Spark SQL, Time processing, Trino