Lead Data Engineer ID71008

Agileengine

≈ 418,4 тыс.–519,4 тыс. ₽ · 5,2 тыс.–6,5 тыс. $ · 4,6 тыс.–5,7 тыс. €

26 583 – 33 000 BRL

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Architect partitioning and file formats

•Collaborate with DevOps on requirements

•Define schema and data type strategy

•Design and own ETL pipelines

•Develop serverless query workflows with Athena

•Govern data lake architecture on S3

•Implement near real time processing for OLAP workloads

•Lead developers and align engineering practices

•Manage Kubernetes deployments with EKS

•Orchestrate DAG based workflows with Airflow

•Review pull requests and enforce code quality

Условия

•Flexible hours

•Learning budget

•Mentorship

•People focused support

•Performance and compensation reviews

•Remote work

•Techtalks

•Wellbeing programs

Технологии: AWS Data, AWS Data Ecosystem, Amazon S3, Apache Airflow, Athena, BigQuery, ClickHouse, DAG, Data Ecosystem, Data Lake, Data pipeline, Docker, EKS, ETL, FastAPI, File format, Flask, GraphQL, GraphQL API, Kubernetes, Near-real-time, Near-real-time Processing, OLAP, ORC, Parquet, Partitioning, PostgreSQL, Presto, Python, REST, REST API, Real-time Processing, Schema Design, Snowflake, Spark SQL, Time processing, Trino