Lead Data Engineer ID71008

Agileengine

≈ 1,1 млн–1,3 млн ₽ · 11,5 тыс.–14,4 тыс. €

13 167 – 16 500 $

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Build S3 backed data lake solutions

•Collaborate with DevOps on requirements

•Define analytical architecture for OLAP workloads

•Deploy services on EKS Kubernetes

•Design ETL pipelines

•Design near real time processing

•Implement Athena query workflows

•Lead data engineering team and mentor developers

•Orchestrate batch workflows with Airflow DAGs

•Plan data lake partitioning and file formats

•Review pull requests and enforce code quality

Условия

•Annual learning budget

•Collaborative culture

•Flexible hours

•Mentorship

•No micromanagement

•People focused support

•Remote work

•Techtalks

•Well-being programs

Технологии: AWS, Airflow, Amazon S3, Apache Parquet, Athena, BigQuery, ClickHouse, DAG Workflow, Data Governance, Docker, EKS, ETL, FastAPI, Flask, GraphQL, Kubernetes, Linux, MacOS, Near-real-time, Near-real-time Processing, ORC, Object storage, Partitioning Strategy, PostgreSQL, Presto, Python, REST, Real-time Processing, Schema Design, Snowflake, Spark SQL, Terminal, Time processing, Trino