•Build Delta Live Tables using PySpark
•Build data platform on Azure
•Create CI CD pipelines for data engineering
•Design data pipelines
•Develop ETL/ELT processes
•Develop enterprise data model
•Ensure high availability
•Implement data quality and governance
•Implement streaming data solutions
•Integrate third-party APIs and data sources
•Mentor junior engineers
•Monitor data platform
•Optimize pipeline performance and reliability
•Troubleshoot complex data engineering issues
Технологии: API Integration, Azure, Azure Data, Azure Data Factory, Azure Data Lake, Azure Data Lake Storage, Azure Databricks, Azure DevOps, CI/CD, Cosmos DB, Data Factory, Data Governance, Data Lake Storage, Data Modeling, Data Quality, Data Security, Delta Lake, Delta Live Tables, Delta Live), ELT, ETL, Git, Infrastructure as Code, Monitoring, NoSQL, PySpark, Python, Relational databases, SQL, Streaming, “as-code”