Чем предстоит заниматься
Develop new data pipelines and maintain existing ones
Migrate existing data pipelines from BDP to Databricks
Maintain ML ETL pipelines and apply necessary changes to ML code
Monitor daily pipelines and resolve issues as they arise
Support ML model development, training, and deployment
Perform data integration and transformation through ETL processes
Contribute to database design, optimization, and data quality assurance
Document processes and workflows in clear and unambiguous language
Collaborate with the team using BitBucket, Jira, Confluence, and Teams