Lead Data Engineer ID71008

Agileengine

≈ 174,4 тыс.–196,4 тыс. ₽ · 2,2 тыс.–2,5 тыс. $ · 1,9 тыс.–2,1 тыс. €

7 000 000 – 7 885 000 COP

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Build DAG based batch workflows

•Define partitioning and file formats

•Design and own ETL pipelines

•Design schema and data types

•Develop analytics oriented OLAP data systems

•Drive AWS data lake architecture

•Extract transform and validate data at scale

•Implement near real time processing

•Lead developers and align engineering practices

•Manage pipeline dependencies and triggering

•Partner with DevOps on requirements

•Review pull requests and enforce code quality

Условия

•Flexible hours

•Internal TechTalks

•Learning budget

•Mentorship

•People focused support

•Performance and compensation reviews

•Remote work

•Well-being programs

Технологии: AI Development, AI development tools, AWS Bedrock, Amazon EKS, Amazon S3, Apache Airflow, Apache Spark, Apache Spark SQL, Athena, BigQuery, Caching, Claude Code, ClickHouse, DAG, Dagster, Data Lakes, Data Partitioning, Development tools, Docker, ETL, FastAPI, Flask, GraphQL, Kubernetes, Langchain, Luigi, ORC, Parquet, PostgreSQL, Prefect, Presto, Pydantic, Python, REST, Redis, SageMaker, Schema Design, Snowflake, Spark SQL, Step Functions, Trino, Trino/Presto