Channels ▼
RSS

Open Source

DataStax Manages Big Data Trio: Real-Time, Analytic, and Search


DataStax is pushing forward its commercial offerings for the Apache Cassandra open source distributed database management system with this week's release of its DataStax Enterprise 2.0 product.

Aiming to combine and manage a triumvirate of "real-time", "analytic", and now "enterprise search" data all in the same database cluster. The DSE 2.0 platform manages real-time data with Cassandra, provides batch analytic capabilities with Apache Hadoop, and enables enterprise search on that same data with Apache Solr.

"Enterprise search is a high-demand capability and open-source Apache Solr is the most popular search technology available," said Billy Bosworth, CEO of DataStax. "Solr downloads outnumber even Hadoop downloads today. By combining enterprise search (Solr) with real-time analytic power in DSE 2.0, we're allowing our customers to move faster in response to never-ending user demands by allowing them to focus on building the application instead of battling big data infrastructure."

The aim here is to combine the search capabilities of Solr with the real-time and analytic database capabilities of Cassandra and Hadoop to produce "Google-like capabilities" for a database; but without the data movement routines, which could potentially be both time-consuming and error-prone.

As DataStax Enterprise 2.0 is built on Cassandra, its real-time search operations across multiple data centers also work with automatic "data sharding" and easy index rebuild operations, none of which are found in native Solr. Lastly, developers can access Solr/search information using the SQL-like Cassandra Query Language (CQL), which should make it easier to do real-time operations on search data.

NOTE: Database tools company CodeFutures Corporation provides the following definition for data sharding: "Database sharding can be simply defined as a 'shared-nothing' partitioning scheme for large databases across a number of servers, enabling new levels of database performance and scalability achievable. If you think of broken glass, you can get the concept of sharding — breaking your database down into smaller chunks called shards and spreading those across a number of distributed servers."

With DataStax Enterprise 2.0, users can run real-time, analytic, and search operations in the same database cluster without any of the workloads affecting the other from a performance or resource contention standpoint. The platform does not require ETL software to move data between systems, because everything is automatically and transparently replicated in the cluster, even if that cluster spans multiple data centers or is implemented in the cloud.

"With DataStax Enterprise, DataStax introduced the ability to use the same database cluster to support operational and analytic workloads. With version 2.0 the company has taken that one step further with the integration of enterprise search and elastic workload re-provisioning," said Matt Aslett, research manager, data management and analytics, 451 Research. “The new capabilities expand the way companies are able to use and analyze their data, avoiding the need to host redundant systems that have to be kept in-synch."


Related Reading


More Insights






Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

Dr. Dobb's encourages readers to engage in spirited, healthy debate, including taking us to task. However, Dr. Dobb's moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing or spam. Dr. Dobb's further reserves the right to disable the profile of any commenter participating in said activities.

 
Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.
 

Video