Companies have long dreamed of a single data platform that can handle their real-time and batch data and workloads, without some clunky interface in between. However, unless your name is Uber or Netflix, you probably don’t have the engineering resources to build a modern Lambda architecture yourself.

When he was an engineer at Confluent, Hojjat Jafarpour took a shot at creating a system that moved the ball forward on Apache co-creator Jay Kreps’ dream of a Kappa architecture that solved the Lambda dilemma by reimagining everything as a stream. The result was the 2017 launch of kSQL, which provided a SQL interface atop data flowing through Kafka. By itself, kSQL didn’t create a Kappa architecture, but it filled an important gap.

While kSQL simplified a lot of things, it still had its limitations, said Jafarpour, who was the engineering lead on the kSQL project. For starters, it was tightly coupled to Kafka itself. If you wanted to read and write to other streaming data platforms, such as AWS’s Amazon Kinesis, then you were back to doing software engineering and integrating multiple distributed systems, which is hard.

After moving up into a more customer-facing role at Confluent, Jafarpour gained a new understanding of the types of things that customers and prospects really wanted out of their data infrastructure. When it came to getting value out of real-time processing systems, real-world companies continued to express frustration with the continued expense and complexity that it entailed.

That’s what motivated Jafarpour to jump ship in 2020 and found his own company, called DeltaStream. Jafarpour wasn’t ready to give up on SQL or Kafka, but instead he wanted to build a better abstraction for a stream processing product that rode atop existing Kafka and Kinesis pipelines out there.

To guide development at DeltaStream, Jafarpour took his inspiration from Snowflake, which managed to provide a very clean interface for its sophisticated cloud data warehouse.

“We want to make it super simple for you to use it, take away all of the complexity of operations and infrastructure, and you just come and use it and get value from your data,” Jafarpour told BigDATAwire at the recent Snowflake conference. “The idea was to build something similar for your streaming data.”

Instead of reinventing the wheel, Jafarpour decided to build DeltaStream atop the best stream processing engine that existed in the market: Apache Flink.

“We get the power of Flink, but we abstract the complexity of that from the user,” Jafarpour said. “So the user doesn’t have to deal with the complexity, but they would be able to get the scalability, elasticity and all of the things that Flink brings.”

Jafarpour observed that one of the most common use cases for Flink deployments is to process fast-moving data to ensure that downstream dashboards, applications, and user-facing analytics are kept up-to-date with the freshest data possible. That often meant taking streaming data and loading data into some type of analytics database, where it can be consumed as a materialized view.

“A lot of use cases people would run Flink with something like Postgres, Clickhouse, or Pinot, and again, you have two different systems to manage,” Jafarpour said. “As I said, we wanted to build a complete data platform for streaming data. We saw that a lot of streaming use cases need that materialized view use case. Why not make it as part of the platform?”

So in addition to Apache Flink, DeltaStream also incorporates an OLAP database as part of the offering. Customers are given the option of using either open source Clickhouse or Postgres to build materialized views to serve downstream real-time analytics use cases.

“The good thing is that we are a cloud service, so under the hood we can bring in these components and put them together without customers having to worry about it,” Jafarpour said.

DeltaStream, which raised $10 million in 2022, has been adopted by organizations that need to ingest large amounts of incoming data, from IoT sources or change data capture (CDC) logs. The company has customers in gaming, security, and financial services, said Jafarpour, who previously was an engineer at Informatica and Quantcast and has a PhD in computer science.

Earlier this month, the Menlo Park, California company rolled out the next iteration of the product: DeltaStream Fusion. The new edition gives customers the ability to land data into Apache Iceberg tables, and then run queries against those Iceberg tables.

DeltaStream Fusion uses Flink, Spark, and Clickhouse for streaming, batch, and real-time use cases

To power DeltaStream Fusion, Jafarpour surveyed the various open source engines available on the market, and picked the one he thought was best fitted for the job: Apache Spark.

“Spark is the proper tool for batch. Flink is good for streaming, even though both of them want to do the other side,” Jafarpour said. “The good thing is that we abstracted it from the user. If it’s a streaming query, it’s going to compile into a Flink job. If it’s a query for the Iceberg tables, it’s going to use Spark for running that query.”

Ironically, Confluent itself would follow Jafarpour’s lead by adopting Flink. In 2023, it spent  reported $100 million to buy Immerok, one of the leading companies behind Apache Flink into its offerings. The company hasn’t completely abandoned kSQL (now called ksqlDB), but it’s clear that Flink is the strategic stream processing engine at Confluent today. Databricks has also moved to support Flink within Delta Lake.

Jafarpour is philosophical about the move beyond kSQL.

“That was one of the first products in that space, and usually when you build a product the first time, you make a lot of decisions that some of them are good, some of them are bad, depending on the situation,” he said. “And as I said, as you build things and as you see how people are using it, you’re going to see the shortcomings and strength of the product. My conclusion was that, okay, it’s time for the next generation of these systems.”

Related Items:

Slicing and Dicing the Real-Time Analytics Database Market

Confluent Expands Apache Flink Capabilities to Simplify AI and Stream Processing

Five Drivers Behind the Rapid Rise of Apache Flink

The post DeltaStream Dreams: Bringing Batch, Streaming, and Real-Time Together appeared first on BigDATAwire.

Read more here:: www.datanami.com/feed/

The post DeltaStream Dreams: Bringing Batch, Streaming, and Real-Time Together appeared first on IPv6.net.

Your home office thermostat, security camera, voice-activated virtual assistant and wireless printers are all working perfectly fine. They help to make your office much more efficient, convenient and connected than

The post How to eliminate IoT vulnerabilities that are putting your business at risk appeared first on IoT Now News – How to run an IoT enabled business.

Read more here:: www.m2mnow.biz/feed/

The post How to eliminate IoT vulnerabilities that are putting your business at risk appeared first on IPv6.net.

Edgewater Wireless Systems, the industry pioneer in Wi-Fi Spectrum Slicing technology, has announced that it has been awarded $921,000 in non-dilutive funding from FABrIC, the Government of Canada’s flagship initiative

The post Edgewater Wireless wins federal grant for advanced Wi-Fi chip commercialisation appeared first on IoT Now News – How to run an IoT enabled business.

Read more here:: www.m2mnow.biz/feed/

The post Edgewater Wireless wins federal grant for advanced Wi-Fi chip commercialisation appeared first on IPv6.net.

The world is creating more data than enterprises can realistically manage. In 2024, global data creation is expected to hit 149 zettabytes. By 2028, that number is projected to nearly triple, reaching more than 394 zettabytes. For large organizations, the challenge is no longer just about storage; it’s about how to handle that scale intelligently, without overwhelming infrastructure or slowing down decisions.

DataBahn.ai, a Texas-based startup focused on AI-driven data pipeline automation, is stepping into that gap. The company has raised $17 million in Series A funding to grow its platform, which helps enterprises automate and streamline how data moves across security, observability, and AI systems.

The latest funding round was led by Forgepoint Capital, with participation from S3 Ventures and returning investor GTM Capital, bringing its total funding to $19 million. 

Forgepoint Capital managing director Ernie Bio, who led the round and has joined DataBahn’s board, said the company is tackling real and growing infrastructure challenges. As enterprises face rising volumes of data from cloud, AI, and connected systems, many are still relying on legacy SIEM tools that are too costly and too rigid to scale.

According to DataBahn, its AI-driven platform helps streamline data flows, cut SIEM costs by over 50%, and automate more than 80% of data engineering work. Bio cited strong early adoption, rapid ROI, and a highly responsive team as signs that the company is well-positioned to grow and help enterprises make sense of their data without overhauling their entire stack.

The startup shared that new funding will be used to expand the platform with more advanced autonomous AI capabilities and to support the company’s global growth plans. A key focus is building out agent-based tools that can learn from enterprise data in real time, helping teams automate complex engineering tasks without manual effort.

DataBahn was founded in July 2024 by a team with backgrounds in cybersecurity, enterprise data, and operational risk. CEO Nanda Santhana had previously helped launch Securonix and served as a tech fellow at Oracle. President Nithya Nareshkumar brought leadership experience from JPMorgan and DTCC.

The startup’s early focus was on one of enterprise security’s more persistent challenges: managing the volume and complexity of data flowing from systems like IoT networks, OT environments, and SOC infrastructure. Most tools weren’t built for that kind of operational noise, and the company saw an opportunity to build pipelines that were more purpose-built for the reality of security environments.

Since then, the company has expanded its scope. What began as a security-specific solution has grown into a broader control layer that brings order to data across infrastructure, applications, and AI systems.

A key part of the platform, according to the company, is its use of Phantom agents—lightweight AI modules designed to collect, clean, and enrich data in real time. DataBahn says these agents avoid the overhead typical of traditional software, allowing teams to manage growing data volumes without sacrificing performance or adding unnecessary complexity.

The company also highlights its federated search capabilities as a key differentiator. Rather than depending on structured queries, the system surfaces insights based on a user’s role and responsibilities. This means observability teams can anticipate issues before they escalate, security teams can identify threats more quickly, and business users gain a clearer picture of how applications are performing—all without having to sift through raw data or rely on custom queries.

“Today’s enterprises don’t just need data pipelines; they need intelligent fabrics that adapt, govern, and optimize data at scale,” said Nanda Santhana, co-founder and CEO of DataBahn.ai. “We’re building the foundation for a new era of observability, one where data is not just moved, but understood, enriched, and made AI-ready in real time.”

DataBahn points to a Forrester blog post that reflects its own thinking on how enterprise data infrastructure needs to change. The post explains that purpose-built pipeline tools are not just about moving data from one place to another. They also help reduce the effort required to prepare that data by routing, enriching, redacting, and transforming it along the way. 

This becomes especially useful in security environments, where teams are often working with fragmented systems and inconsistent signals. For DataBahn, the priority is not simply making data available, but making it usable in context.

(Wanan Wanan/Shutterstock)

That emphasis on usability is already resonating with enterprise teams. Some of DataBahn’s early customers are seeing measurable improvements in how they manage, understand, and act on their data. One of those organizations is CSL Behring.

“This product has changed what data means to us. Our journey with DataBahn has transformed data from a cost center into a strategic asset. I’d recommend this to every CISO and IT leader looking to take control of their data,” said Greg Stewart, senior director of cybersecurity and threat intelligence at CSL Behring.

With fresh funding and growing interest from customers, DataBahn is focused on helping teams get more value from the data they already collect. In a space crowded with tools that surface more data, its pitch is simple: make the pipelines smarter, and everything downstream gets easier.

Related Items

Are Data Engineers Sleepwalking Towards AI Catastrophe?

NTT DATA Launches Industry-Ready AI Agents

Monte Carlo Brings AI Agents Into the Data Observability Fold

The post With $17M in Funding, DataBahn Pushes AI Agents to Reinvent the Enterprise Data Pipeline appeared first on BigDATAwire.

Read more here:: www.datanami.com/feed/

The post With $17M in Funding, DataBahn Pushes AI Agents to Reinvent the Enterprise Data Pipeline appeared first on IPv6.net.

Leaseweb kondigde vandaag de benoeming aan van Alex Wessel als nieuwe Chief Operations Officer (COO). Met vijftien jaar ervaring zal hij de gecentraliseerde teams op het Leaseweb hoofdkantoor leiden, waaronder de teams die verantwoordelijk zijn voor bedrijfsbrede beleidslijnen, procedures, beveiliging en projectmanagement.

In zijn nieuwe rol zal Wessel ook nauw samenwerken met operationele directeuren binnen de Leaseweb entiteiten om de servicekwaliteit op alle locaties van het bedrijf te ondersteunen. Hij zal zich richten op het stimuleren van standaardisatie en het waarborgen van een consistente ervaring bij alle services, ongeacht de locatie.

“Leasewebs reputatie was mij al bekend door voormalige collega’s en industriepartners,” zei Alex Wessel, COO van Leaseweb. “Wat mij naar het bedrijf trok was de sterke cultuur, de schaal en diversiteit van de operaties en de kans om bij te dragen aan een organisatie waar zoveel klanten op vertrouwen om hun kernbusiness te runnen. De datacenterwereld is ongelooflijk dynamisch, en ik ben enthousiast om te zien hoe ontwikkelingen zoals AI en IoT de klantbehoeften zullen vormgeven. Ik geloof ook dat we een groeiende verschuiving naar lokale serviceproviders zullen zien naarmate datasoevereiniteit belangrijker wordt.”

“Alex brengt een zeer sterke combinatie van operationele discipline, technische diepte en klantfocus mee – kwaliteiten die essentieel zijn voor Leasewebs voortdurende groei,” zei Svenja de Vos, co-CEO bij Leaseweb. “Zijn ervaring in het beheren van wereldwijde infrastructuur, van hoogwaardige faciliteiten tot klantgerichte operaties, en zijn gestructureerde benadering van kritieke infrastructuur maken hem de ideale kandidaat voor deze rol. We zijn verheugd hem in het team te verwelkomen en kijken uit naar de positieve impact die hij zal hebben op onze wereldwijde operaties.”

Het bericht Leaseweb benoemt Alex Wessel tot Chief Operations Officer verscheen eerst op ChannelConnect.

Read more here:: www.isptoday.nl/feed/

The post Leaseweb benoemt Alex Wessel tot Chief Operations Officer appeared first on IPv6.net.

Anne Neuberger, who was the deputy national security advisor for cybersecurity and emerging technology in the prior administration, disputed a probe launched by FCC Chairman Brendan Carr against the Cyber Trust Mark program, which is designed to certify consumer smart devices with a label that deems them cybersecure. The voluntary program officially launched early this year after months of development in the Biden administration.

Carr’s investigation, first reported last week by Fox News, centers on the lead administrator of the initiative, Underwriter Labs, which was selected in December. Carr directed an internal FCC national security body to “investigate certain worrying issues he has discovered” about UL and the other program administrators because of potential ties to China, Fox reported, citing an internal agency document.

The reported document says UL “has a joint venture in China with China National Import and Export Commodities Inspection Corp.” that will “be excluded from the FCC’s equipment authorization program” under rules recently adopted by the commission. The company “has 18 China-based testing locations” with three “particularly alarming” locations, the document says.

“China is a leading manufacturer of IoT devices, with a large percentage of the world’s connected devices coming from China. Americans use insecure Chinese devices in their homes, schools and offices every day, like Hikvision IP cameras, Huawei networking equipment and Xiaomi devices,” Neuberger told Nextgov/FCW.

“Cyber Trust Mark will change that status quo. It requires IoT devices to meet a [U.S. government] cybersecurity standard for the first time. It also gives American shoppers a label to check which devices have been tested. Underwriter Labs has testing sites around the world and could be required to only do testing outside China,” she argued.

“Using UL is the fastest and most effective way to change today’s insecure status quo, given it has consumers’ trust and a network of experienced labs who can start testing immediately to get secure IOT devices into Americans’ hands,” she said.

An FCC source told Fox the Cyber Trust Mark was rushed under the Biden administration and is now in limbo. Carr, a Trump appointee who initially voted to approve the initiative in 2024, has since raised concerns about its implementation and is calling for additional scrutiny, the report adds.

The FCC did not respond to a request for comment.

Intelligence and national security officials have long argued that technologies linked to China could pose surveillance and sabotage risks. Policy analysts often cite a 2017 Chinese law requiring domestic companies to assist state intelligence efforts, fueling concerns that firms operating with overseas units could be compelled to hand over data to Beijing.

China has also become a central focus of U.S. tech and supply chain policy in President Donald Trump’s second term, particularly under Carr, a longtime China hawk. In March, Carr said the FCC began probing a group of Chinese tech and telecom providers that could still be operating in the U.S. despite prior agency-issued restrictions.

Pausing the program would affect a key provision in a cybersecurity executive order issued by Biden and retained in a June 6 directive signed by Trump, which requires all government-purchased smart devices to carry the certification label by January 2027.

In April, former Republican FCC commissioner Nathan Simington said the cyber certification might be expanded in the near future to include other equipment beyond household appliances. 

“I’m not sure if we could go for wireless first, or for industrial first, or for both,” he said at the time, adding that it’ll be interesting to see whether that January 2027 deadline is kept in place by the Trump administration. Simington abruptly announced his departure from the FCC on June 4.

]]>

Read more here:: www.nextgov.com/rss/all/

The post Former Biden cyber chief defends Cyber Trust Mark in the face of FCC review appeared first on IPv6.net.

In an ambitious leap from startup to 5G frontrunner, Uzbekistani mobile operator Perfectum has achieved a major technological milestone by successfully launching test calls on its new 5G standalone (SA)

The post From start-up to roll out in nine months – How Nokia perfected 5G SA deployment for Perfectum appeared first on IoT Now News – How to run an IoT enabled business.

Read more here:: www.m2mnow.biz/feed/

The post From start-up to roll out in nine months – How Nokia perfected 5G SA deployment for Perfectum appeared first on IPv6.net.

Lacuna Space has announced the successful launch of new satellites under its “Call of the Wild” mission banner — a step forward in scaling one of the world’s direct-to-device (D2D)

The post Lacuna expands direct-to-device IoT network with “Call of the Wild” satellite launches appeared first on IoT Now News – How to run an IoT enabled business.

Read more here:: www.m2mnow.biz/feed/

The post Lacuna expands direct-to-device IoT network with “Call of the Wild” satellite launches appeared first on IPv6.net.

Vodafone is leading a new consortium of partners to deliver the next phase of the Mayor of London’s pioneering Breathe London programme, delivering an advanced and comprehensive network of monitors

The post Vodafone-led consortium to deliver next phase of air quality monitoring network across London appeared first on IoT Now News – How to run an IoT enabled business.

Read more here:: www.m2mnow.biz/feed/

The post Vodafone-led consortium to deliver next phase of air quality monitoring network across London appeared first on IPv6.net.

SEALSQ Corp, a company that focuses on developing and selling Semiconductors, PKI and Post-Quantum technology hardware and software products, together with ColibriTD, a pioneer in Quantum-as-a-Service (QaaS) platforms, and Xdigit,

The post SEALSQ, ColibriTD and Xdigit plan to develop a solution set to revolutionise semiconductor wafer yields for sub-7nm nodes appeared first on IoT Now News – How to run an IoT enabled business.

Read more here:: www.m2mnow.biz/feed/

The post SEALSQ, ColibriTD and Xdigit plan to develop a solution set to revolutionise semiconductor wafer yields for sub-7nm nodes appeared first on IPv6.net.