Blog

Snowplow Releases Lake Loader with Apache Iceberg and Delta Lake Support

By
Daniela Howard
June 27, 2024
Share this post

The latest release provides customers with unparalleled flexibility, performance, and reduced costs.

Why does the Snowplow Lake Loader matter?

More and more organizations are adopting the lakehouse paradigm – storing their enterprise data using open table formats like Apache Iceberg and Delta Lake. This is attractive to organizations for a number of reasons:

  1. Cost Effectiveness: Customers no longer have to pay to load the data into a data warehouse;
  2. Enhanced Performance: Iceberg and Delta enable analytical queries at performance levels that are on-par with data warehouses;
  3. Increased Flexibility: Customers now have the flexibility to pick and choose between various compute engines, with platforms like Databricks, Snowflake, BigQuery, Dremio, Starburst, Clickhouse and more, all supporting accessing the data directly in Iceberg or Delta, or both. This contrasts with storing the data natively in one of the cloud data warehouses, which can make it difficult to access from another.

What’s new?

The latest version of the Snowplow Lake Loader is superior in performance. It is able to transform and write out more Snowplow data faster than earlier versions, while maintaining the same amount of compute, and reducing customer costs.

It also includes support for the latest versions of Iceberg and Delta*:

  • Apache Iceberg enables companies to efficiently manage and analyze large-scale data lakes with enhanced performance, flexibility, and data consistency
  • Delta Lake enhances data lakehouse capabilities with ACID transactions, efficient metadata handling, and seamless integration for batch and streaming operations

Want to learn more?

Current Snowplow BDP customers can get in touch if they are interested in using the Lake Loader. For those interested in getting started, schedule a demo today!

*Snowplow Lake Loader support for the latest version of Iceberg and Delta is currently in Private Preview for Snowplow BDP customers.

Subscribe to our newsletter

Get the latest blog posts to your inbox every week.

By subscribing you agree to with our Privacy Policy.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Get Started

Unlock the value of your behavioral data with customer data infrastructure for AI, advanced analytics, and personalized experiences

By clicking “Accept All Cookies”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. View our Privacy Policy for more information.