Databricks Data Engineer

Virtusa

IN-KA-Bangalore

≈ 101,6 тыс.–149 тыс. ₽ · 1,3 тыс.–1,9 тыс. $ · 1,1 тыс.–1,7 тыс. €

125 000 – 183 333 INR

🏢 Офис

Middle

Полная занятость

Продуктовая

Tech

Описание вакансии

Обязанности

•Build batch and streaming pipelines

•Collaborate with data scientists

•Collaborate with mlops engineers

•Design data pipelines

•Develop ETL/ELT workflows

•Develop data pipelines

•Ensure data quality best practices

•Implement Lakehouse architecture

•Implement governed data solutions

•Optimize data pipelines

•Perform Spark workload performance tuning

Технологии: Apache Spark, Azure Data, Azure Data Lake, Azure Data Lake Storage, Azure Databricks, CI/CD, Data Lake Storage, Data Quality, Delta Lake, ELT, ETL, Event Hubs, Git, Kafka, Lakehouse, PySpark, Python, SQL, Spark SQL, Terraform, Unity Catalog