Teradata introduces Kylo to Quickly Build, Manage Data Pipelines

Teradata has introduced Kylo that will deliver unprecedented efficiencies for companies creating data lakes. It is a Teradata sponsored, open-source project that is offered under the Apache 2.0 license. Kylo evolved from code harvested from proven data lake engagements led by Think Big Analytics.

Teradata is contributing Kylo to help organizations address the most common challenges they face in data lake implementation efforts. These include the central problem that data lakes simply take too long to build, and in the average 6-12-month build cycle, users find that use cases can become out of date and less relevant to quickly evolving businesses. Second, despite the lower cost of software, engineering costs quickly mount. Finally, a data lake, once created, may fail to attract users who find it difficult to explore, and so little value is realized.

Derived and developed from data lake deployments across industries, Kylo can easily help resolve these challenges, because it integrates and simplifies pipeline development and common data management tasks, resulting in faster time to value, greater user adoption and developer productivity. With Kylo, no coding is required and its intuitive user interface for self-service data ingests and wrangling helps accelerate the development process. Kylo also leverages reusable templates to increase productivity.

“Open source technology is making strong inroads into mainstream enterprise technology and has become an important consideration for enterprises looking to develop a modern end-to-end enterprise data architecture. In today’s highly competitive landscape, businesses are increasingly looking at driving more efficiency with an advanced data lake solution that is open and easy to integrate into other business-critical platforms without losing out on necessary controls especially in sensitive industries like health care, financial services, telecom and retail. Our new open source software platform will help companies to load data faster into their data lakes enabling their businesses to drive constant innovation using real-time data analysis.” said Sunil Jose, Managing Director, Teradata India.

Kylo helps organizations address the most common challenges they face in data lake implementation efforts, including -

* Skill shortage for experienced software engineers and administrators

* Learning and implementing best practices around data lake governance

* Driving data lake adoption beyond engineers

“Kylo provides tooling on top of Apache NiFi to make it faster and easier to get data into your data lake,” said Scott Gnau, Chief Technology Officer, Hortonworks. “Hortonworks is pleased to announce Kylo’s certification with Hortonworks DataFlow and our expanded joint support relationship for NiFi.”

Teradata will play a leadership role in the governance, stewardship and community-building around open-source Kylo.