Чем предстоит заниматься
Build ETL and ELT processes
Design and consume REST APIs
Design and develop data pipelines
Design and optimize Delta Lake data models
Develop reusable Python data processing libraries
Implement CI/CD deployment automation
Implement data quality controls and monitoring
Implement event-driven architectures
Implement monitoring and alerting mechanisms
Integrate Databricks with Java and Spring Boot applications
Optimize Spark workloads
Participate in architecture reviews
Support production pipelines and perform root cause analysis