Чем предстоит заниматься
Design and implement the UniForm write layer (Delta + Iceberg dual metadata)
Build GCS → BigQuery ingestion pipelines for structured operational datasets
Develop and implement in Python and Spark
Implement Kafka-based CDC patterns for real-time and near-real-time ingestion
Develop data lineage, dependency tracking, and modular adapter code
Configure Snowflake Horizon external tables for zero-copy reads
All data hub tables are to be written once using Delta Lake with Iceberg UniForm enabled… readable by all target consumers without conversion
Implement and certify Delta Sharing endpoints for Databricks consumers
Build governed access layer components: RBAC, connector registry entries, tenant-scoped authorization
Align semantic layer models with LookML and KPI catalog definitions
Collaborate with cross‑functional teams to deliver end‑to‑end features
Troubleshoot issues across the full stack and contribute to code quality