Rockset vs. Elasticsearch

Switch from Elasticsearch to Rockset for real-time analytics that goes beyond text and logs

Real-Time Analytics at Cloud Scale

Rockset’s Converged Index™ enables faster time to market and up to 50% lower Total Cost of Ownership as compared to Elasticsearch’s search index, for real-time analytics use cases. This is achieved by optimizing for hardware and developer efficiency in the cloud.

Built for Real-time Analytics

Ad Optimization

A/B Testing

Logistics

Gaming Leaderboards

Fraud Detection

Real-time 360

Personalization

Real-time Recommendations

A New, Radical Approach to Indexing

Rockset indexes all felds, including nested felds, in a Converged Index™ which combines an inverted index for search, a columnar index for aggregations and a row index for random reads. Serve complex analytical queries with sub-second latencies for your applications.
Real-Time Analytics At Lightning Speed

See Rockset in action

How Rockset Compares to Elasticsearch for Real-Time Analytics

Challenge #1:
No support for JOINs

Elasticsearch

Elasticsearch does not natively support joins. This results in joining code as part of the application which results in prohibitively expensive queries. Or, do write-time denormalization which limits your flexibility and requires you to know the queries in advance.

Rockset

Rockset supports a full featured SQL language including joins. A multi level aggregator executes Rockset’s join operator. Aggregators are distributed and the JOINs are executed in a parallel fashion over multiple aggregators for both scalability and speed.

Challenge #2:
Scaling queries on large datasets

Elasticsearch

When an index grows in size and data is spread out to shards on different machines, queries become slower and the only option is to create a new index with a larger number of shards and reindex all the data from the existing index to the new index. This is a resource-intensive, costly process. However, reindexing tens to hundreds of terabytes is a resource-intensive, costly process.

Rockset

Rockset is designed to scale to hundreds of terabytes without needing to ever reindex a dataset. A Rockset index is organized in the form of thousands of micro-shards, and a set of micro-shards combine together to form appropriate number of shards based on the number of available servers and the total size of the index. If the dataset increases in size, a subset of micro-shards are peeled away from every existing shard and made into additional independent shards and these additional shards are distributed to the new machines in your cluster.

Challenge #3:
High operational burden

Elasticsearch

Elasticsearch requires deep expertise for controlling costs at scale. It requires configuring clusters with different node types, pre-configuring the number of shards in an index, tuning the amount of CPU per node, configuring thread-pools, and moving indexes between hot-warm-cold nodes to manage the index lifecycle as data ages.

Rockset

Rockset’s cloud-native serverless architecture is optimized for hands-free operations, while providing visibility and control. With Rockset, you don't need to manage indexes, clusters or shards.

Challenge #4:
Getting optimal price-performance

Elasticsearch

Elasticsearch was created in 2010 when the cloud was nascent. It was optimized for the datacenter and does not decouple compute from storage.

Rockset

Rockset, on the other hand, is cloud-native and decouples compute and storage. Data is served from hot storage, and automatically backed up on durable cloud storage. Compute resources are scaled independently as required. Compute resources used for ingesting and querying data are also separated so you get fast queries on fresh data. Scaling storage independently from compute allows developers to seamlessly control price-performance.

Resources



Related Whitepaper

Elasticsearch vs Rockset

A Converged Index™ enables faster time to market and up to 50% lower TCO as compared to Elasticsearch’s search index, for real-time analytics use cases...

Read more
Related Webinar

Serverless Real-time Indexing: A Low Ops Approach to Elasticsearch

In this talk, we compare and contrast Elasticsearch and Rockset as indexing data stores for serving low latency queries...

Read more
Related Blog

eGoGoGames Esports Platform Uses Rockset for Real-Time Analytics on Gaming Data

eGoGames improves user experience, detects fraud, and makes business decisions using...

Read more
Related Blog

Analytics on DynamoDB: Comparing Elasticsearch, Athena and Spark

We compare options for real-time analytics on DynamoDB - Elasticsearch, Athena, and Spark - in terms of ease of setup...

Read more
Related Blog

Analytics on Kafka Event Streams Using Druid, Elasticsearch and Rockset

We discuss how different data backends - Druid, Elasticsearch and Rockset - can be used alongside Kafka for analytics...

Read more
Related Blog

Converged Index™ for blazing-fast queries

Learn how Rockset delivers low-latency SQL for search and analytics using a combination of row, column, and search indexes...

Read more
Real-Time Analytics At Lightning Speed

See Rockset in action