Data Engineer

Ambush

State of Rio Grande do Sul, Porto Alegre, Brazil

≈ 426,3 тыс.–519,4 тыс. ₽ · 5,3 тыс.–6,5 тыс. $ · 4,6 тыс.–5,7 тыс. €

27 083 – 33 000 BRL

🏢 Офис

Middle

Полная занятость

Продуктовая

Tech

Описание вакансии

Обязанности

•Build ETL and ELT pipelines

•Build change data capture and event driven pipelines

•Design Medallion lakehouse architecture

•Ensure data integrity and idempotency

•Implement data quality validation and data contracts

•Implement observability, monitoring, and alerting

•Migrate databases and data warehouses

•Model data

•Orchestrate data workflows

Технологии: Alerting, Amazon Aurora, Apache Airflow, Apache Iceberg, Apache Parquet, Change Data Capture, ClickHouse, DBT, Dagster, Data Capture, Data Contracts, Data Integrity, Data Modeling, Data Quality, Data Validation, Data orchestration, Delta Lake, DuckDB, ELT, ETL, Event Driven, Event-driven architecture, Exactly once, Great Expectations, Idempotency, Monitoring, Observability, Pandas, PostgreSQL, Prefect, PyArrow, Pydantic, Python, SQLAlchemy, Soda