Rockset Adds Snowflake Connector for Real-time Analytics Across Streaming and Historical Data
New integration gives developers highly efficient sub-second search, aggregations and joins across real-time and historical data.
San Mateo, Calif. — June 15, 2022 — Rockset, the Real-time Analytics Platform Built for the Cloud, today announced a new Snowflake connector which enables low-latency, high-concurrency analytics across streaming data from sources such as Apache Kafka, Amazon DynamoDB or MongoDB and historical data from Snowflake.
Data warehouses like Snowflake are used by analysts and data scientists to store and analyze historical business data, often at petabyte-scale, with data loaded in infrequent batches to save costs. In contrast, developers use real-time analytics platforms like Rockset to combine historical data from Snowflake with real-time event streams from sources like Apache Kafka, and serve user-facing applications and operational analytics use cases.
Rockset efficiently organizes data in a Converged Index™, which is optimized for real-time data ingestion and low-latency analytical queries. Rockset’s ingest rollups enable developers to pre-aggregate real-time data using SQL, without the need for complex real-time data pipelines. As a result, customers can reduce the cost of storing and querying real-time data by 10-100x. In addition, Rockset is built for the cloud, with independently scaling compute and storage to maximize resource efficiency without any operational overhead.
"The world is moving from static dashboards to real-time, interactive user-facing analytics such as customer recommendations, logistics tracking, and risk analytics, which demand efficient performance," said Venkat Venkataramani, CEO and co-founder at Rockset. "Rockset’s integration with Snowflake enables users to search, aggregate and join historical data with real-time event streams, to power sub-second queries. Another common usage pattern is to build and train your machine learning model on historical data in Snowflake, and use Rockset to provide real-time features and signals during model serving."
This release enables organizations using Snowflake to:
- Search, aggregate and join data across historical data from Snowflake and real-time event streams or change data capture streams from Apache Kafka, Amazon Kinesis, Amazon DynamoDB, MongoDB, PostgreSQL, MySQL, Oracle, SQL Server and more.
- Use Rockset’s Converged Index for achieving better performance at lower costs, enabling low-latency, high-concurrency queries to serve user-facing analytics on historical data from Snowflake.
- Use Rockset for real-time model serving as part of the machine learning pipeline with Snowflake.
Rockset has an extensive library of data connectors for schemaless ingestion from existing event streams, databases and lakes and stays in sync with the data source, enabling fast analytics within 1-2 seconds of new data being generated. Built by the team behind the online data infrastructure that powers Facebook Newsfeed and Search, Rockset is inspired by the same indexing systems that power real-time analytics at cloud scale.
Rockset, the Real-time Analytics Platform Built for the Cloud, delivers fast analytics on real-time data with surprising efficiency. Search, join and aggregate any data at scale with sub-second responses. Scale efficiently with Rockset’s cloud-native converged indexing and built-in connectors. Build data apps in weeks, not months, regardless of the shape of your data. For more information, go to rockset.com.