At the Hadoop Summit in Dublin this week, Ted Malaska, Principal Solutions Architect at Cloudera, and I presented Ingest and Stream Processing - What Will You Choose?, looking at the big data streaming landscape with a focus on ingest. The session closed with a demo of StreamSets Data Collector, the open source graphical IDE for building ingest pipelines.

In the demo, I built a pipeline to read JSON data from Apache Kafka, augmented the data in JavaScript, and wrote the resulting records to both Apache Kudu (incubating) for analysis and Apache Kafka for visualization.

The Apache Kudu (incubating) team is happy to announce the release of Kudu 0.8.0!

This latest version adds a sink for Apache Flume, partition pruning in the C++ client and related improvements on the server-side, better error-handling in Java client, plus many other improvements and bug fixes.

• Read the detailed Kudu 0.8.0 release notes
• Download the Kudu 0.8.0 source release

Welcome to the fourth edition of the Kudu Weekly Update. This weekly blog post covers ongoing development and news in the Apache Kudu (incubating) project.

Welcome to the third edition of the Kudu Weekly Update. This weekly blog post covers ongoing development and news in the Apache Kudu (incubating) project.

Welcome to the second edition of the Kudu Weekly Update. As with last week’s inaugural post, we’ll cover ongoing development and news in the Apache Kudu project on a weekly basis.