Moving our warehouse off DuckDB
The article explains the migration from DuckDB and DuckLake to a custom version of Trino and a new open table format called HogLake, detailing what broke at scale and the reasons behind the decision.
Key points
- •The data warehouse was moved from DuckDB and DuckLake to a custom flavor of Trino and a new open table format, HogLake.
- •The article details what broke when scaling the system.
- •It explains the reasons for making the migration decision.