Build GenAI RAG data pipelines
Build batch pipelines
Build embedding pipelines
Build streaming pipelines
Define data SLAs and SLOs
Enable self service documentation
Encrypt data at rest and in transit
Enforce Unity Catalog governance
Implement data quality checks
Implement ingestion patterns
Implement transformation frameworks
Ingest data from external sources
Ingest data from internal sources
Integrate Databricks with Azure services
Maintain feature store versioning
Manage access control and auditing
Manage feature engineering pipelines
Onboard new data sources
Optimize Spark workloads
Optimize data storage layouts
Perform root cause analysis
Provide L3 production support
Provision Lakeflow connectors
Publish trusted data products
Refresh vector indexes
Set up data monitoring and observability
Set up governance controls
Transform and validate data