How eBay build Data Quality Platform with Apache Griffin

William Guo, Branky Shao

2019-09-10 14:30 #observability

High Quality data plays an important role for incubating awesome big data applications. In real projects, governing data, observing their quality health, and taking remedy actions are tedious and time-consuming. Apache Griffin is an open source Data Quality solution for Big Data, which supports both batch and streaming mode. It offers a unified process to measure your data quality from different perspectives, helping you build trusted data assets, therefore boost your confidence for your business. In this session, we will talk about how eBay leverage Apache Griffin and build a big data quality platform to support all kinds of business critical data applications. First, we will introduce the key concepts and architecture design of Griffin and share the experience of open-source it under the Apache way. Then, we will dive into our internal data quality platform and its use cases.