Convert Kafka Topics into SQL Tables
Real-time APIs and operational monitoring dashboards on Apache Kafka

Visualize, Analyze and Act on Event Streams

Rockset is a serverless search and analytics engine that turns Kafka topics into fast SQL tables without any code. Monitor event data in real time - simply using SQL. Rockset tails your Kafka topic, indexes every field and auto-schematizes your data, so you can query Kafka event streams and join them with other business data using SQL, in real time.

Use Cases
Operational monitoring
Get real-time visibility into what’s happening at every stage of your event-driven business. Join unstructured event data with business data and drill-down into issues as they occur. Visualize your operations using flexible SQL dashboard tools.
APIs for Developers
Power your internal tools and customer-facing applications using a SQL API on event data from Kafka. Empower your developers to build better applications, faster, by giving them real-time API access.
Sensor data analytics
Analyze sensor data in real-time, detect anomalies and trigger automation. Take the right actions at the right time by using Rockset's real-time sort, filter and search functionalities on raw sensor data at scale, without any ETL.

Operational Analytics on Data from Kafka

Run ad hoc SQL queries that are not natively possible on event streams. Join event streams with data from other sources such as DynamoDB, S3, GCS and more, in real-time. New data is queryable in seconds and queries return in milliseconds, powered by Rockset's converged indexing technology.

Continuously load streaming event data
Rockset delivers low data latency through native integrations with Apache Kafka and Amazon Kinesis. Rockset's Confluent-verified Gold Kafka Connect Sink Connector streams events from Kafka topics into Rockset where the data is automatically indexed. Rockset builds inverted index, columnar index and row index on these events by using RocksDB. All events are time-stamped to help you deal with events arriving out of order. Set up time-based retention policies to automatically purge older events.
Explore event data as SQL tables without ETL
Rockset enables millisecond SQL including joins, filters, aggregates and full text search on raw event data. It schemalessly ingests raw data, including nested JSON and Avro, and automatically represents them as SQL tables. New fields in Kafka records automatically create new SQL columns ensuring there is no schema drift. A SQL column can contain data of mixed types. Join, filter, aggregate across datasets without upfront schema definitions or schema registry.
Deliver real-time APIs & dashboards
Rockset delivers low data latency and low query latency with cloud-native auto-scaling to handle bursty write rates or spikes in queries. Developers can programmatically access Rockset via Python, Java, Javascript, GO or REST APIs and live dashboards can use SQL clients like Tableau, Redash, Apache Superset or others via the JDBC connector.

How It Works

Rockset serves as a real-time sink that continuously ingests raw event data from Kafka or Kinesis for real-time event analytics. It uses converged indexing to deliver real-time SQL over REST with serverless auto-scaling under the hood.

Visualization Tools

Enable your business teams to visualize real-time event streams using dashboarding tools that they already know and love, using Rockset's JDBC connector and native support for standard SQL-based visualization tools.

Grafana

Grafana is an open observability platform for analytics and monitoring. Grafana requires a SQL backend and cannot query Kafka directly. Use Rockset to visualize Kafka events in Grafana.

Learn more

API Access

Insert, update and query data programmatically from custom application code using Rockset's client libraries wrapped on top of REST.

Python

# connect to Rockset
from rockset import Client, Q, F
rs = Client()

# build a query object
q = Q('hello_world').where(F['name'] == 'Jim Gray')
results = rs.sql(q)

Rockset’s Python package is called rockset and the entire API is contained within a single Python module called rockset. APIs defined in the rockset module allow you to securely connect to the Rockset service, create or manage collections and query Rockset.

Learn more
# connect to Rockset
from rockset import Client, Q, F
rs = Client()

# build a query object
q = Q('hello_world').where(F['name'] == 'Jim Gray')
results = rs.sql(q)

Powerful Analytics on Kafka Without Any ETL

Resources



Related Blog

Real-time analytics in the world of VR

I work as a Data Engineer at a leading company in the VR space, with a mission to capture and transmit reality in perfect fidelity.

Read more
Related Blog

E-commerce monitoring using Kafka-Rockset

By using Rockset on the critical path, Fynd can now obtain immediate insight into what consumers are doing on their platform...

Read more
Related Blog

How Rockset’s Kafka-Connect works

We created the Kafka Connect Plugin for Rockset to export data from Kafka and send it to a collection of documents in Rockset. Learn how it works.

Read more
How-To Guide

Using SQL for real-time insights on Kafka events

This post offers a how-to guide for real-time analytics using SQL on streaming data with Apache Kafka and Rockset.

Read more
How-To Guide

Live dashboards on Kinesis

This blog shows how Rockset can serve a live dashboard, which surfaces analytics on real-time Twitter data ingested into Rockset from a Kinesis stream.

Read more
Documentation

How to use Kafka topics as data source

Read up on how to securely connect Kafka topics with Rockset using Kafka-Connect plugin, and create collections which sync your data in real-time.

Read more

Our Customers

See how the most innovative companies do more with their data, faster.

"Building our dashboard on Rockset was the easiest way to analyze our call data in DynamoDB and get real-time insights on the metrics we care about."

-Naresh Talluri, product manager at FULL Creative

Read more

Try SQL on Kafka now