E
Senior Databricks Platform Engineer
Ecs
Arlington, VA, United States
🏢 Офис
Senior
Полная занятость
Продуктовая
США
Tech
Описание вакансии
Обязанности
•Apply data governance and metadata management
•Build and configure workspaces clusters notebooks jobs
•Build platform observability
•Collaborate with cloud infrastructure teams
•Configure metastore and catalog hierarchies
•Configure storage integrations
•Connect source systems to Databricks
•Develop user provisioning processes
•Enforce compute policies and cluster configurations
•Evaluate new AWS and Databricks features
•Implement RBAC and security groups
•Implement data lineage and auditing
•Implement encryption and data masking
•Implement secrets management
•Integrate AWS services with Databricks
•Integrate identity management with Databricks
•Maintain Databricks enterprise platform
•Maintain technical documentation
•Manage Unity Catalog governance
•Manage serverless SQL warehouses
•Monitor and manage workload reliability
•Monitor and tune cluster utilization
•Optimize costs and resource allocation
•Troubleshoot platform authentication and connectivity issues
•Validate security controls across data lifecycle
Технологии: AWS, Active Directory, Apache Hive, Apache Spark, Audit Logging, Autoscaling, Azure, Bash, Cluster configurations, Compute policies, Data Factory, Data Lineage, Data masking, Databricks, Delta Lake, EMR, Glue, Hadoop, IAM, KMS, KPI Dashboards, Monitoring, Powershell, Python, RBAC, S3, SAML, SCIM, SQL, Scala, Secrets management, Serverless SQL, Unity Catalog, Workload management