Big Data：From Theory to Systems.pdf

Wenfei Fan

Shenzhen Institute of Computing Sciences

University of Edinburgh

Beihang University

Big Data:

From Theory to Systems

1

The 5 V’s of Big Data

The study has raised as many questions as it has answered

• Heterogeneous queries on big

data across different models

 How to query big data

with limited resources?

Volume

 How to answer queries

across heterogeneous

data models? Variety

 How to query dynamic

data in response to

updates? Velocity

 How to clean dirty

Smart City

• Massive data from

unreliable data sources

• Real-time analysis in

response to updates

The need for both theory and systems for big data analytics

The challenges introduced by AIGC

To make practical use of AIGC

60% of the techniques proposed in the papers have been implemented in the systems

 Products: MedHunter, Mirror, Dream Creak, Lemmon Grass, Dasan Pass

An end-to-end solution to big data management