Channels ▼
RSS

Embedded Systems

Building Apps With CDK In Cloudera Apache Hadoop


Apache Hadoop software, support, and services company Cloudera has released the Cloudera Developer Kit (CDK) at its first developer kit created for the firm's own distribution of Hadoop (CDH).

More Insights

White Papers

More >>

Reports

More >>

Webcasts

More >>

The Cloudera Developer Kit includes APIs, tools, and documentation to simplify most common tasks in open-source Hadoop.

NOTE: The Palo Alto headquartered firm, which recently opened offices in London's TechCity, has explained in the past that more than 50% of its engineering output is donated upstream to the various Apache-licensed open source projects — including Apache Hive, Apache Avro, Apache HBase, and so on.

The firm points out the reality of the current situation with Hadoop; i.e., the process of building and managing Hadoop environments remains complicated and time-consuming for many developers without specialized training.

CDK includes a collection of API libraries, tools, example code, and documentation that aim to help simplify the most common tasks when working with Apache Hadoop.

NOTE: Like CDH, CDK is 100% free, open source, and licensed under the same Apache Software License, allowing developers to use the code in any way they choose across existing commercial code bases or in any open source project.

"At Cloudera we are not just Hadoop providers; we're also consumers who know first-hand the challenges developers can face when working with Hadoop," said Eric Sammer, engineering manager, Cloudera. "The new Cloudera Development Kit is one of the many ways we're sharing our expertise with the community. First-time Hadoop programmers will find that CDK walks them through each step of the process, enabling them to get up and running on the platform quickly, while more-experienced developers will appreciate the flexibility of CDK to swap out different components for a completely customized experience. By making Hadoop more accessible, we are excited to help an even broader range of organizations get more value out of their data."

CDK is modular in its approach to flexibility, enabling developers to pick and choose the pieces they want to use, while freely substituting code of their own. For Java developers using tools like Maven, artifacts are available from the Cloudera Maven Repository for project integration.

The first module included in CDK is the CDK Data module, a set of APIs that simplifies working with datasets in Hadoop filesystems, such as HDFS and the local filesystem. Cloudera will continue to add new modules to CDK to extend its functionality and flexibility for developers. As CDK is a fully open source project, community contributions are also welcome.


Related Reading






Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

Dr. Dobb's encourages readers to engage in spirited, healthy debate, including taking us to task. However, Dr. Dobb's moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing or spam. Dr. Dobb's further reserves the right to disable the profile of any commenter participating in said activities.

 
Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.
 

Video