openPR Logo
Press release

New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL

08-15-2025 07:08 PM CET | Business, Economy, Finances, Banking & Insurance

Press release from: ABNewswire

New IEEE Studies Offer Faster, Smarter Approaches to Real Time

Recent research outlines practical methods to speed up machine learning pipelines and improve query performance across large, diverse datasets.
Image: https://www.abnewswire.com/upload/2025/08/a93bd65bd7e383afca1989342c6e0ee5.jpg

Phoenix, Arizona, United States of America - Speed is no longer a luxury in data analytics; it is a necessity. A financial service flagging a suspicious payment in time to stop it, or an e-commerce site changing a promotion while a shopper is still browsing, can make all the difference. Yet as data pours in from more sources and is stored in more places, turning it into useful insight without delay has become a bigger challenge than ever.

Two newly published studies in the IEEE Xplore Digital Library by data engineering specialist Vamsi Krishna Eruvaram address this challenge directly. His work focuses on two pressing areas for today's data teams: keeping real time data pipelines running fast enough to feed advanced machine learning, and improving the speed of federated SQL queries that pull information from massive, scattered datasets.

In the first paper, Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures , Eruvaram looks closely at three open source frameworks - Apache Kafka Streams, Apache Flink and Apache Pulsar. Rather than testing them under perfect lab conditions, he recreated the kinds of demands that real businesses face. One scenario simulated fraud detection on live financial transactions, another handled fast-changing recommendations for online shoppers, and a third processed streams of sensor readings from industrial equipment.

Latency, throughput, scalability and resource use were measured. Apache Flink consistently delivered the lowest latency for complex, time-sensitive processing. Kafka Streams was simpler to run and suited for teams already working in the Kafka ecosystem. Pulsar showed strong multi-tenancy and replication capabilities, important for global operations with varying data rules. Instead of naming a single winner, Eruvaram advises matching the choice of tool to the specific workload and operational context.

His second paper, Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach , explores how to speed up queries that must pull data from different systems without moving it into one place first. In many organizations, the data sits in a mix of on-premise clusters, cloud storage and specialized platforms, making transfers costly or restricted by regulation.

Eruvaram's research examines methods to make these federated queries faster and more reliable. He focuses on sending filters to the source data, scanning only the relevant partitions, choosing execution plans based on cost efficiency, and managing workloads to prevent resource bottlenecks. The paper also details ways to keep long-running queries from failing when part of the system goes down.

Tests on multi-terabyte datasets showed query time reductions of up to 62 percent for complex joins, all achieved without new hardware. For organizations, that means faster results without higher infrastructure costs.

Taken together, Eruvaram's studies offer a clear roadmap for handling the speed of incoming data and the complexity of distributed storage. They provide solutions that are both technically sound and grounded in the realities of running large-scale data systems.

Both papers by Vamsi Krishna Eruvaram are available in the IEEE Xplore Digital Library: Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures at https://ieeexplore.ieee.org/document/11088800 and Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach at https://ieeexplore.ieee.org/document/11089251.

Media Contact
Company Name: CB Herald
Contact Person: Ray
Email:Send Email [https://www.abnewswire.com/email_contact_us.php?pr=new-ieee-studies-offer-faster-smarter-approaches-to-real-time-data-and-federated-sql]
City: Phoenix
State: Arizona
Country: United States
Website: http://Cbherald.com

Legal Disclaimer: Information contained on this page is provided by an independent third-party content provider. ABNewswire makes no warranties or responsibility or liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. If you are affiliated with this article or have any complaints or copyright issues related to this article and would like it to be removed, please contact retract@swscontact.com



This release was published on openPR.

Permanent link to this press release:

Copy
Please set a link in the press area of your homepage to this press release on openPR. openPR disclaims liability for any content contained in this release.

You can edit or delete your press release New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL here

News-ID: 4146507 • Views:

More Releases from ABNewswire

Bedrock Restoration - Water Fire Mold Damage Service, Expands Water Damage Repair Services to Support St. Louis Park Homeowners
Bedrock Restoration - Water Fire Mold Damage Service, Expands Water Damage Repai …
Water Fire Mold Damage Service, a trusted provider of property restoration, has announced expanded service offerings to meet the growing demand for professional water damage solutions in the region. Known for their reliable, customer-focused approach, the company continues to support both homeowners and businesses in recovering from unexpected property damage caused by water, fire, or mold. Responding to a Growing Need for Water Damage Restoration Property owners across Minnesota are increasingly seeking
Winkler Kurtz LLP Expands Resources to Handle Increased Demand for Personal Injury Attorneys Representation in Port Jefferson Station
Winkler Kurtz LLP Expands Resources to Handle Increased Demand for Personal Inju …
For individuals searching for personal injury attorneys, the expansion of Winkler Kurtz LLP's team means greater accessibility and reduced wait times for consultations. The firm's deep roots in the Port Jefferson Station community allow them to understand local nuances, such as common accident hotspots and specific regional legal precedents. Port Jefferson Station has seen a notable rise in personal injury cases, driven by factors such as increased traffic congestion, construction activity,
Protecting Property Value: Hose Bros Inc Highlights How Professional Power Washing Prevents Long-Term Damage in Millsboro DE
Protecting Property Value: Hose Bros Inc Highlights How Professional Power Washi …
For residents searching for power washing near me, Hose Bros Inc offers accessible and reliable services tailored to the Millsboro community. Their local expertise ensures an understanding of regional challenges, such as the impact of salt air on coastal properties or the tendency for humidity to promote mold growth in shaded areas. This knowledge allows them to customize their approach, selecting appropriate pressure levels and cleaning agents for different surfaces. In
Tampa Bay Home Remodeling Costs Guide [2025] Kitchen & Bathroom Renovation Prices
Tampa Bay Home Remodeling Costs Guide [2025] Kitchen & Bathroom Renovation Price …
A 2025 cost guide to kitchen, bathroom, and full home remodeling in Tampa Bay, featuring expert insights from Craftline Remodeling on pricing, budgeting, and contractor selection. Market Overview: Understanding Tampa Bay Remodeling Investment Trends Tampa Bay's home remodeling market has experienced significant cost evolution in 2025, with project expenses varying dramatically across South Tampa, Carrollwood, Seminole Heights, Clearwater, St. Petersburg, and Wesley Chapel based on material choices, project scope, and contractor expertise.

All 5 Releases