Categories: Tech NewsTechCrunch+

Decodable wants to take real-time stream processing mainstream

Decodable, the well-funded real-time data engineering and stream processing platform based, in part, on the Apache Flink open-source project, is launching a major update today that aims to make the service more attractive to large enterprises. In addition to expanding its library of connectors to enable data ingestion from more sources and a new enterprise support option, the marquee feature here is the launch of its automated task-sizing capabilities. Thanks to this, Decodable can now dynamically configure workloads as needed to optimize performance and cost.

As Decodable founder and CEO Eric Sammer told me, he believes that while stream processing itself is quickly becoming mainstream — with Apache Flink becoming the de facto standard — what happens around that isn’t quite mainstream yet, in part because until now, only businesses with highly sophisticated engineering teams were able to build on top of this technology.

“The analogy I think about is networking switches,” he explained. “We can move packets back and forth. The next iteration of that — the part that I don’t think is fully mainstream yet — is the processing capability on top of that — the ability to transform and aggregate. What I think we would have called streaming analytics 10 years ago.”

Advertisement

Image Credits: Decodable

The likes of Lyft, Uber or Stripe are able to create this enterprise-grade layer of abstractions on top of these real-time data streams. Others, he argues, need a tool like Decodable to do so, especially if they want to build consumer-facing applications.

“Streaming is one piece of technology,” he also noted. “It’s a collection of Debezium plus Kafka or Redpanda or whatever — plus Flink, plus API’s and all these other kinds of things. And it’s cost prohibitive to stand up a team and operationalize that. That’s where we add value. And that’s why we focus on developer experience and self-service and enterprise features.”

Advertisement

As for the new task sizing feature, Sammer noted that users can tell the service how many tasks they want to dedicate to a given workload. Decodable will then scale up to this maximum number of tasks — or scale down, if warranted. For a lot of users, this may result in lower spending overall. And while that may also mean they won’t spend as much on Decodable, Sammer believes that if the company can make stream processing easier and more cost effective for its users, these users will bring more workloads to the service. “There are very few cases where you wouldn’t want fresher, more accurate data — or be able to make a better decision in real time,” he said. “So from that perspective, every time we make it cheaper for someone to run a workload on Decodable, they add more workloads.”

 

Decodable wants to take real-time stream processing mainstream by Frederic Lardinois originally published on TechCrunch

Advertisement
Share
Published by

Recent Posts

Securing phpMyAdmin Like a Pro: Essential Tips and Tricks

Securing phpMyAdmin is crucial to prevent unauthorized access and protect your databases. Here's a guide…

5 months ago

Pasqal raises $100M to build a neutral atom-based quantum computer

Pasqal, a Paris-based quantum computing startup, today announced that it has raised a $100 million…

1 year ago

Apple in talks with Disney, others on VR content for new headset: Report

Developed with Sony Group Corp, the headset will have two ultra-high-resolution displays to handle the…

1 year ago

Microsoft, Amazon results to highlight softening cloud business

After years of blistering growth, most recently fuelled by remote working and studying during the…

1 year ago

Intel chairman Omar Ishrak steps down

Omar Ishrak had stepped down and the chipmaker appointed board director Frank Yeary as his…

1 year ago

Canada to commercialise world's first photonic-based quantum computer

Canadian Prime Minister Justin Trudeau has announced a new federal investment to build and commercialise…

1 year ago