Lead architecture assessment and documentation of the current data platform (Snowflake, Airflow, AWS)
Design the future-state data platform architecture following modern ELT and dbt best practices
Define standards for: data modeling, pipeline architecture, transformation frameworks, governance and data quality
Lead the migration of transformation logic into dbt models
Define architectural patterns for: staging layers, intermediate layers, data marts
Implement automated testing frameworks within dbt
Lead discovery sessions and technical workshops with the client’s data engineering teams
Document architecture, pipelines, and operational processes
Conduct architecture walkthrough sessions during knowledge transfer phases
Define standards for CI/CD, monitoring frameworks, and data quality validation
Establish schema management and governance best practices
Optimize Snowflake compute usage and platform performance
Design scalable orchestration strategies for Airflow pipelines
Improve platform reliability, monitoring, and operational observability