H
Senior Consultant Specialist
Hsbc Group
Xi'an, Shaanxi, China
≈ 117,9 тыс.–176,9 тыс. ₽ · 1,5 тыс.–2,2 тыс. $ · 1,3 тыс.–1,9 тыс. €
10 000 – 15 000 CNY
🏢 Офис
Senior
Полная занятость
Продуктовая
Tech
Описание вакансии
Обязанности
•Apply data governance best practices
•Automate ETL workflows with Airflow or Cloud Composer
•Design ETL processes
•Develop Apache Beam Dataflow jobs
•Ensure compliance with GDPR and HIPAA
•Implement ETL pipelines
•Implement data protection measures
•Integrate data from databases, APIs, and flat files
•Manage GCP data storage
•Monitor and troubleshoot ETL jobs
•Optimize data pipeline performance
•Set up monitoring and alerting
Технологии: Apache Airflow, Apache Beam, Apache Flink, Apache Kafka, Apache Spark, Cloud Composer, Cloud Storage, Data Warehousing, Dataflow, ETL, GCP, GDPR, Google BigQuery, HBase, HIPAA, Hadoop, Hive, Java, MapReduce, PubSub, Python, SQL