Dr. Jorge Quiané

Co-founder

Principal Investigator of Rheem, now Apache Wayang. Passionate on building next-generation Big Data infrastructures. *2023

TagSniff Tutorial: Online & Post-Hoc Data Debugging

Hands-on guide to implementing TagSniff in your data pipelines. Covers online debugging (inspecting data during execution), post-hoc analysis (debugging from logs), and integration patterns for Spark, Flink, and Apache Wayang applications with code examples.

Author:

Dr. Jorge Quiané

TagSniff: Debugging Model for Distributed Data Processing

TagSniff introduces two simple primitives—tag and sniff—for debugging distributed data processing. Tag marks tuples with metadata; sniff identifies tuples needing attention. Together they enable data breakpoints, lineage tracking, and anomaly detection across Spark and Flink jobs.

Author:

Dr. Jorge Quiané

Big Data Debugging: Why Traditional Tools Fail

Step-through debugging fails when your job runs across 100 nodes processing terabytes. This analysis explains why traditional debugging approaches break down for big data applications and what new primitives are needed for effective distributed data debugging.

Author:

Dr. Jorge Quiané

Scalytics Architecture Deep Dive: Wayang & Federated AI

A technical deep dive into the Scalytics architecture: how Apache Wayang powers our federated data layer, the ML-based cost optimizer, and our approach to privacy-preserving AI. Essential reading for data architects evaluating cross-platform processing solutions.

Author:

Dr. Jorge Quiané