Manufacturing & Construction
Synapse to Snowflake migration for a construction data platform
- Cost reduction vs Synapse
- -30%
- Maximum downtime
- <4h
- Man-days delivered
- 565
- Tools modernized
- 6
Challenge
The group wanted its construction data platform off Azure Synapse and onto Snowflake. Six tools had to be replaced at once, including SAP SLT and Talend for ingestion, Synapse Pipelines for transformation and Azure DevOps for CI/CD. The budget allowed no data loss and under four hours of downtime.
Solution
We designed the target architecture around Fivetran for ingestion, DBT for transformation, Airflow for orchestration, GitHub for CI/CD, Collibra for governance and DataDog for monitoring. We wrote the SQL and TSQL conversion guides, the migration framework, the pipeline blueprints and the test strategy, then led the six-person delivery team through nine months.
Key results
- Target 30%+ reduction in data warehouse costs
- Zero data loss migration with under 4 hours downtime
- Project delivered across 565 man-days
- Full tool chain modernization (6 tools replaced)
- MicroStrategy dashboards repointed to Snowflake
- Knowledge transfer and team enablement completed
Technologies
- Snowflake
- Azure Synapse
- DBT
- Fivetran
- Airflow
- Collibra
- DataDog
- MicroStrategy
What are you trying to fix?
Describe it in a paragraph. We'll tell you whether we are the right people, and what we would do first.