Press release
New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL
Recent research outlines practical methods to speed up machine learning pipelines and improve query performance across large, diverse datasets.Image: https://www.abnewswire.com/upload/2025/08/a93bd65bd7e383afca1989342c6e0ee5.jpg
Phoenix, Arizona, United States of America - Speed is no longer a luxury in data analytics; it is a necessity. A financial service flagging a suspicious payment in time to stop it, or an e-commerce site changing a promotion while a shopper is still browsing, can make all the difference. Yet as data pours in from more sources and is stored in more places, turning it into useful insight without delay has become a bigger challenge than ever.
Two newly published studies in the IEEE Xplore Digital Library by data engineering specialist Vamsi Krishna Eruvaram address this challenge directly. His work focuses on two pressing areas for today's data teams: keeping real time data pipelines running fast enough to feed advanced machine learning, and improving the speed of federated SQL queries that pull information from massive, scattered datasets.
In the first paper, Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures , Eruvaram looks closely at three open source frameworks - Apache Kafka Streams, Apache Flink and Apache Pulsar. Rather than testing them under perfect lab conditions, he recreated the kinds of demands that real businesses face. One scenario simulated fraud detection on live financial transactions, another handled fast-changing recommendations for online shoppers, and a third processed streams of sensor readings from industrial equipment.
Latency, throughput, scalability and resource use were measured. Apache Flink consistently delivered the lowest latency for complex, time-sensitive processing. Kafka Streams was simpler to run and suited for teams already working in the Kafka ecosystem. Pulsar showed strong multi-tenancy and replication capabilities, important for global operations with varying data rules. Instead of naming a single winner, Eruvaram advises matching the choice of tool to the specific workload and operational context.
His second paper, Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach , explores how to speed up queries that must pull data from different systems without moving it into one place first. In many organizations, the data sits in a mix of on-premise clusters, cloud storage and specialized platforms, making transfers costly or restricted by regulation.
Eruvaram's research examines methods to make these federated queries faster and more reliable. He focuses on sending filters to the source data, scanning only the relevant partitions, choosing execution plans based on cost efficiency, and managing workloads to prevent resource bottlenecks. The paper also details ways to keep long-running queries from failing when part of the system goes down.
Tests on multi-terabyte datasets showed query time reductions of up to 62 percent for complex joins, all achieved without new hardware. For organizations, that means faster results without higher infrastructure costs.
Taken together, Eruvaram's studies offer a clear roadmap for handling the speed of incoming data and the complexity of distributed storage. They provide solutions that are both technically sound and grounded in the realities of running large-scale data systems.
Both papers by Vamsi Krishna Eruvaram are available in the IEEE Xplore Digital Library: Optimizing Real Time Data Pipelines for Machine Learning A Comparative Study of Stream Processing Architectures at https://ieeexplore.ieee.org/document/11088800 and Enhancing Federated SQL Query Performance in Large Scale Data Lakes A Trino Based Approach at https://ieeexplore.ieee.org/document/11089251.
Media Contact
Company Name: CB Herald
Contact Person: Ray
Email:Send Email [https://www.abnewswire.com/email_contact_us.php?pr=new-ieee-studies-offer-faster-smarter-approaches-to-real-time-data-and-federated-sql]
City: Phoenix
State: Arizona
Country: United States
Website: http://Cbherald.com
Legal Disclaimer: Information contained on this page is provided by an independent third-party content provider. ABNewswire makes no warranties or responsibility or liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. If you are affiliated with this article or have any complaints or copyright issues related to this article and would like it to be removed, please contact retract@swscontact.com
This release was published on openPR.
Permanent link to this press release:
Copy
Please set a link in the press area of your homepage to this press release on openPR. openPR disclaims liability for any content contained in this release.
You can edit or delete your press release New IEEE Studies Offer Faster, Smarter Approaches to Real Time Data and Federated SQL here
News-ID: 4146507 • Views: …
More Releases from ABNewswire
Holiday Skin Stress? KREMOLOGIE Trademark Offers Professional Solutions for Sens …
Professional-grade skincare brand KREMOLOGIE addresses the seasonal skin challenges facing women this holiday season. With formulations rooted in clinical esthetics expertise, the brand provides barrier-strengthening solutions for reactive skin stressed by holiday demands, travel, and harsh winter conditions.
The holiday season brings joy, celebration, and unfortunately for many women, significant skin stress. Between November and January, dermatologists and estheticians report increased consultations for dehydration, sensitivity flare-ups, and accelerated aging signs. KREMOLOGIE…
Jupiter Landscaping Boosts Home Values in Boynton Beach With High End Landscape …
Jupiter Landscaping enhances Boynton Beach homes with luxury landscape designs, boosting curb appeal and property value.
Boynton Beach, FL - Landscaping experts in Boynton Beach are making a significant impact on home values with their top-tier landscape designs. Specializing in custom landscaping solutions, these professionals offer comprehensive services that enhance curb appeal, create functional outdoor spaces, and increase property value, especially for homeowners seeking Boynton Beach landscaping [https://www.jupiterlandscaping.net/boynton-beach-fl].
"We believe that landscaping…
Naples Comfort Systems Delivers Emergency AC Installation Solutions to Protect G …
Naples Comfort Systems provides fast emergency AC installation to keep Golden Gate families safe and cool during extreme heat.
Naples, FL - In response to the sweltering temperatures affecting Golden Gate and surrounding areas, Naples Comfort Systems is offering AC Installation Golden Gate FL [https://stahlmanac.com/air-conditioning/golden-gate-fl/] services on an emergency basis to help protect local families from the dangers of extreme heat. As the summer heat intensifies, the company is stepping up…
Emergency AC Repair Support Expanded in Golden Gate as Heat Intensifies
Emergency AC repair services in Golden Gate expand as rising temperatures increase demand for fast, reliable cooling solutions.
Naples, FL - As temperatures in Golden Gate and surrounding areas rise to extreme levels, homeowners and businesses are facing the critical need for reliable air conditioning services. To meet this growing demand, Naples Comfort Systems is significantly boosting its emergency AC Repair Golden Gate FL [https://stahlmanac.com/air-conditioning/golden-gate-fl/], ensuring that residents and businesses stay…
