Hortonworks, a publicly traded company selling a commercial distribution of the Hadoop open-source big data software, announced today that it has acquired Onyara, an early-stage startup whose employees developed Apache NiFi, a piece of open-source software that was first used inside the National Security Agency (NSA).
Terms of the deal weren’t disclosed. The startup started in March and lists 10 employees on its website.
Apache NiFi (pronounced NIGH-figh) is based on Niagarafiles, a piece of software the NSA first created in 2006 to deliver sensor data to the right systems and keep track of what was happening to the data.
It “became a fairly important piece of technology,” Onyara cofounder and chief technology officer Joe Witt told VentureBeat in an interview. Then, last year, the NSA moved to release the software under an open-source license.
Hortonworks, which itself spun out of Yahoo, has previously acquired XA Secure and SequenceIQ. Now Hortonworks will be selling a new subscription based on the Apache NiFi software, under the name Hortonworks DataFlow. Companies can use DataFlow to collect data from many sources and send it into the Hortonworks Data Platform (HDP), which is based on Hadoop, for long term storage. HDP enables companies to run queries on great supplies of historical data, while DataFlow will provide brief but up-to-the-minute information.
NiFi itself goes beyond messaging software, such as Apache Kafka, as well as enterprise service bus tools, such as IBM Integration Bus, said Witt, who is one of seven of NiFi’s initial committers.
“Fundamentally what we’re saying is the data broker needs to be more intelligent,” Witt said.
This isn’t the first time NSA technology has been commercialized. Sqrrl has been pushing a commercial distribution of the Apache Accumulo key-value store that the NSA originally developed.
In recent months, the company has found interest in the health care, financial services, and gaming industries, Witt said. Clearly, then, organizations other than the NSA were encountering the same problems that the NSA had.
“The problem space we’re going after is data flow,” Witt said. “That is inherently applicable to a lot of industries.”
Hortonworks went public in December.
Here’s a video of Witt giving a presentation of NiFi at OSCON 2015 last month:
Hortonworks was formed by the key architects and core Hadoop committers from the Yahoo! Hadoop software engineering team in June 2011 in order to accelerate the development and adoption of Apache Hadoop. Funded by Yahoo! and Benchmark … read more »
Powered by VBProfiles
VB’s research team is studying web-personalization… Chime in here, and we’ll share the results.