Cloud DevOps & Integration - Consultant

Kpmg India

Gurgaon, Haryana, India

≈ 104,5 тыс.–181,1 тыс. ₽ · 1,3 тыс.–2,3 тыс. $ · 1,1 тыс.–2 тыс. €

125 000 – 216 667 INR

🏢 Офис

Middle

Полная занятость

Продуктовая

Tech

Описание вакансии

Обязанности

•Architect ETL/ELT pipelines

•Build and maintain feature stores

•Control cloud costs across data stack

•Deploy and manage containerized data services using infrastructure as code

•Develop automated machine learning training pipelines

•Ensure data quality, integrity, and security

•Implement event driven streaming with Kafka

•Ingest telemetry and log data into cloud data warehouse

•Manage workflows with Apache Airflow and dbt

•Monitor and optimize query performance

•Optimize sharding strategies

•Process multi terabyte datasets with distributed computing

Технологии: AWS Lake, AWS Lake Formation, Apache Airflow, Apache Kafka, Apache Spark, Azure Cosmos, Azure Cosmos DB, Azure Data, Azure Data Factory, Azure Data Lake, Azure Data Lake Storage, Azure Databricks, Azure Event, Azure Event Hubs, Azure Functions, Azure Synapse, Azure Synapse Analytics, Cloud Bigtable, Cloud Dataflow, Cloud Dataproc, Cloud Functions, Cloud Pub/Sub, Cloud Storage, Cosmos DB, DBT, Data Factory, Data Lake Storage, Data Modeling, Docker, ELT, ETL, Event Hubs, Google BigQuery, Google Cloud, Google Cloud Bigtable, Google Cloud Dataflow, Google Cloud Dataproc, Google Cloud Functions, Google Cloud Pub/Sub, Google Cloud Storage, Google Dataplex, Kubernetes, Lake Formation, Microsoft Purview, Pub/Sub, PySpark, Python, SCD, SQL, Scala, Slowly Changing Dimensions, Snowflake Schema, Star Schema, Synapse Analytics, Terraform