Snowplow Releases Lake Loader with Apache Iceberg and Delta Lake Support
The latest release provides customers with unparalleled flexibility, performance, and reduced costs.
Why does the Snowplow Lake Loader matter?
More and more organizations are adopting the lakehouse paradigm – storing their enterprise data using open table formats like Apache Iceberg and Delta Lake. This is attractive to organizations for a number of reasons:
- Cost Effectiveness: Customers no longer have to pay to load the data into a data warehouse;
- Enhanced Performance: Iceberg and Delta enable analytical queries at performance levels that are on-par with data warehouses;
- Increased Flexibility: Customers now have the flexibility to pick and choose between various compute engines, with platforms like Databricks, Snowflake, BigQuery, Dremio, Starburst, Clickhouse and more, all supporting accessing the data directly in Iceberg or Delta, or both. This contrasts with storing the data natively in one of the cloud data warehouses, which can make it difficult to access from another.
What’s new?
The latest version of the Snowplow Lake Loader is superior in performance. It is able to transform and write out more Snowplow data faster than earlier versions, while maintaining the same amount of compute, and reducing customer costs.
It also includes support for the latest versions of Iceberg and Delta*:
- Apache Iceberg enables companies to efficiently manage and analyze large-scale data lakes with enhanced performance, flexibility, and data consistency
- Delta Lake enhances data lakehouse capabilities with ACID transactions, efficient metadata handling, and seamless integration for batch and streaming operations
Want to learn more?
Current Snowplow BDP customers can get in touch if they are interested in using the Lake Loader. For those interested in getting started, schedule a demo today!
*Snowplow Lake Loader support for the latest version of Iceberg and Delta is currently in Private Preview for Snowplow BDP customers.