Big Data, Machine Learning and Artificial Intelligence

Challenges and opportunities of predictive analytics

Big Data is described by high dimensionality and large sample size. These two features that raise three unique challenges:

(i) High dimensionality brings noise accumulation, spurious correlations and incidental homogeneity.

(ii) High dimensionality combined with large sample size creates issues such as heavy computational cost and algorithmic instability.

(iii) The massive samples in Big Data are typically aggregated from multiple sources at different time points using different technologies.