Senior Data Engineer, Unified Platform

Drw

Singapore

≈ 910,1 тыс.–1,1 млн ₽ · 11,6 тыс.–13,8 тыс. $ · 10,2 тыс.–12,1 тыс. €

15 000 – 17 833 SGD

🏢 Офис

Senior

Полная занятость

Продуктовая

Сингапур

Tech

Описание вакансии

Обязанности

•Backfill datasets and rerun batch jobs

•Contribute to on-call rotation

•Coordinate vendor change management

•Design & build data pipelines

•Develop monitoring and quality control software

•Develop self-service data capabilities

•Handle dead letter queues

•Implement data governance discovery cost sharing usage tracking access controls quality control

•Manage data pipeline orchestration and operational tasks

•Model, build, and manage data products

•Monitor data ingestion pipelines and data quality

•Onboard and manage new data sources

•Own technical aspects of vendor ingestion pipelines

•Perform routine data operations

•Respond to user requests and identify platform gaps

•Triage data quality control and correct data gaps

Технологии: Amazon S3, Apache Airflow, Apache Arrow, Apache Flink, Apache Kafka, Apache Spark, Apache Thrift, Argo Workflows, Avro, Batch Processing, Cassandra, ClickHouse, Data Governance, Data Modeling, Data Quality, Data Transformation, Data orchestration, Dead Letter, Dead-letter queues, Delta Lake, GRPC, Iceberg, JSON, Java, Kubernetes, NoSQL, Parquet, Protobuf, Python, Relational databases, SQL, Streaming processing