N
Databricks Engineer
Novalink Solutions Llc
Austin, United States
≈ 1,2 млн–1,6 млн ₽ · 13,1 тыс.–17,9 тыс. €
15 000 – 20 583 $
🏢 Офис
Senior
Контракт
Продуктовая
Tech
Описание вакансии
Обязанности
•Build dashboards in Databricks
•Build data ingestion pipelines
•Create data models for analytics
•Design scalable data solutions on Databricks
•Develop Databricks Apps
•Develop declarative pipelines
•Implement ETL and ELT pipelines
•Implement data governance and security
•Implement data quality validation
•Implement medallion architecture
•Monitor pipeline performance
•Optimize workloads for scalability and cost
•Schedule and orchestrate offline jobs
Технологии: Airflow, Apache Spark, CI/CD, Data Governance, Data Lakehouse, Data Quality, Data Security, Data Warehousing, Data pipeline, Data pipeline orchestration, Databricks, Declarative Pipelines, Delta Lake, Delta Live Tables, Delta Live), Dimensional Modeling, ELT, ETL, Git, Lakeflow, Lakeflow Jobs, Lakehouse Architecture, Medallion Architecture, Pipeline Orchestration, PySpark, Python, SQL, Scala, Snowflake Schema, Star Schema