Exploratory Data Analysis - EDA Development

EDA Development

Tukey held that too much emphasis in statistics was placed on statistical hypothesis testing (confirmatory data analysis); more emphasis needed to be placed on using data to suggest hypotheses to test. In particular, he held that confusing the two types of analyses and employing them on the same set of data can lead to systematic bias owing to the issues inherent in testing hypotheses suggested by the data.

The objectives of EDA are to:

  • Suggest hypotheses about the causes of observed phenomena
  • Assess assumptions on which statistical inference will be based
  • Support the selection of appropriate statistical tools and techniques
  • Provide a basis for further data collection through surveys or experiments

Many EDA techniques have been adopted into data mining and are being taught to young students as a way to introduce them to statistical thinking.

Read more about this topic:  Exploratory Data Analysis

Famous quotes containing the word development:

    The proper aim of education is to promote significant learning. Significant learning entails development. Development means successively asking broader and deeper questions of the relationship between oneself and the world. This is as true for first graders as graduate students, for fledging artists as graying accountants.
    Laurent A. Daloz (20th century)