Press release
New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL
Recent research outlines practical methods to speed up machine learning pipelines and improve query performance across large, diverse datasets.Image: https://www.abnewswire.com/upload/2025/08/a93bd65bd7e383afca1989342c6e0ee5.jpg
Phoenix, Arizona, United States of America - Speed is no longer a luxury in data analytics; it is a necessity. A financial service flagging a suspicious payment in time to stop it, or an e-commerce site changing a promotion while a shopper is still browsing, can make all the difference. Yet as data pours in from more sources and is stored in more places, turning it into useful insight without delay has become a bigger challenge than ever.
Two newly published studies in the IEEE Xplore Digital Library by data engineering specialist Vamsi Krishna Eruvaram address this challenge directly. His work focuses on two pressing areas for today's data teams: keeping real time data pipelines running fast enough to feed advanced machine learning, and improving the speed of federated SQL queries that pull information from massive, scattered datasets.
In the first paper, Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures , Eruvaram looks closely at three open source frameworks - Apache Kafka Streams, Apache Flink and Apache Pulsar. Rather than testing them under perfect lab conditions, he recreated the kinds of demands that real businesses face. One scenario simulated fraud detection on live financial transactions, another handled fast-changing recommendations for online shoppers, and a third processed streams of sensor readings from industrial equipment.
Latency, throughput, scalability and resource use were measured. Apache Flink consistently delivered the lowest latency for complex, time-sensitive processing. Kafka Streams was simpler to run and suited for teams already working in the Kafka ecosystem. Pulsar showed strong multi-tenancy and replication capabilities, important for global operations with varying data rules. Instead of naming a single winner, Eruvaram advises matching the choice of tool to the specific workload and operational context.
His second paper, Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach , explores how to speed up queries that must pull data from different systems without moving it into one place first. In many organizations, the data sits in a mix of on-premise clusters, cloud storage and specialized platforms, making transfers costly or restricted by regulation.
Eruvaram's research examines methods to make these federated queries faster and more reliable. He focuses on sending filters to the source data, scanning only the relevant partitions, choosing execution plans based on cost efficiency, and managing workloads to prevent resource bottlenecks. The paper also details ways to keep long-running queries from failing when part of the system goes down.
Tests on multi-terabyte datasets showed query time reductions of up to 62 percent for complex joins, all achieved without new hardware. For organizations, that means faster results without higher infrastructure costs.
Taken together, Eruvaram's studies offer a clear roadmap for handling the speed of incoming data and the complexity of distributed storage. They provide solutions that are both technically sound and grounded in the realities of running large-scale data systems.
Both papers by Vamsi Krishna Eruvaram are available in the IEEE Xplore Digital Library: Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures at https://ieeexplore.ieee.org/document/11088800 and Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach at https://ieeexplore.ieee.org/document/11089251.
Media Contact
Company Name: CB Herald
Contact Person: Ray
Email:Send Email [https://www.abnewswire.com/email_contact_us.php?pr=new-ieee-studies-offer-faster-smarter-approaches-to-real-time-data-and-federated-sql]
City: Phoenix
State: Arizona
Country: United States
Website: http://Cbherald.com
Legal Disclaimer: Information contained on this page is provided by an independent third-party content provider. ABNewswire makes no warranties or responsibility or liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. If you are affiliated with this article or have any complaints or copyright issues related to this article and would like it to be removed, please contact retract@swscontact.com
This release was published on openPR.
Permanent link to this press release:
Copy
Please set a link in the press area of your homepage to this press release on openPR. openPR disclaims liability for any content contained in this release.
You can edit or delete your press release New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL here
News-ID: 4146507 • Views: …
More Releases from ABNewswire
Cardiff Care Workers Missing Out on Uniform Tax Refunds
Many Cardiff care workers are missing out on tax relief for uniforms. Pie's HMRC-compliant PAYE tax rebate app makes it easy to reclaim money owed, simplifying the process and ensuring carers receive the refunds they deserve.
CARDIFF, United Kingdom - 17 November, 2025 - Thousands of Cardiff care workers are failing to claim tax relief on work-related uniforms, leaving hundreds of pounds unclaimed each year. Many carers are unaware they are…
Liverpool Small Businesses Go Digital to Beat Tax Deadlines
Pie Money Limited is a UK-based fintech company transforming how individuals and small businesses manage and file taxes. With real-time calculations, intuitive design, and HMRC-compliant filing, Pie helps users stay stress-free and fully compliant throughout the tax year.
LIVERPOOL, United Kingdom - 17 November, 2025 - Liverpool's small business community is embracing digital tax tools at record speed as Making Tax Digital (MTD) requirements continue to reshape the way SMEs manage…
MyKetoCaps Launches Independent Educational Platform to Guide Consumer Health an …
MyKetoCaps has launched a new independent online platform dedicated to providing transparent, data-driven analysis for the health and wellness market. The resource employs a rigorous methodology to evaluate products, focusing on ingredient scrutiny, brand transparency, and third-party testing verification. This educational tool is designed to empower consumers with unbiased information, enabling them to make confident and informed personal wellness decisions without promotional influence.
Cleveland, OH - Nov 17, 2025 - MyKetoCaps…
Texas Legacy in Lights Premiere Draws Over 2,000 Visitors, Earns All 5-Star Revi …
Gonzales' Historic Light Show Shines Bright - Mayor, State Leaders, and Visitors from as far as Canada Attend Opening of Groundbreaking Attraction.
Gonzales, TX, USA - November 17, 2025 - The world's first permanent, narrative-driven, live-action projection mapping film, Texas Legacy in Lights, premiered to a sold-out crowd and universal acclaim on October 2, 2025, as part of Gonzales' 200th anniversary celebration. The event drew over 2,000 attendees - including Mayor…
