Difference between revisions of "Significance of E. Coli Evolution Experiments"

From Conservapedia
Jump to: navigation, search
m (links)
(Added table comparing p-values from paper to chi-square test p-values)
Line 107: Line 107:
  
 
The chi-square test is a common statistical method.<ref>''Mathematical Statistics with Applications'' by Wackerly, Mendenhall, and Scheaffer, Section 14.4.</ref> It can be implemented in Microsoft Excel. If the numbers from the last four columns of the table above (excluding the “totals” row) are entered into Excel in rows 1-12 and columns A-D, then the p-value can be computed by entering “=CHITEST(A1:B12,C1:D12)” into any empty cell of the spreadsheet.
 
The chi-square test is a common statistical method.<ref>''Mathematical Statistics with Applications'' by Wackerly, Mendenhall, and Scheaffer, Section 14.4.</ref> It can be implemented in Microsoft Excel. If the numbers from the last four columns of the table above (excluding the “totals” row) are entered into Excel in rows 1-12 and columns A-D, then the p-value can be computed by entering “=CHITEST(A1:B12,C1:D12)” into any empty cell of the spreadsheet.
 +
 +
==Comparison of p-Values==
 +
 +
The following table compares the p-values reported in Table 2 of Blount et al. to the chi-square p-values for the same experiments. For experiments one and three, the chi-square p-values are much larger than the "mean generation" test p-values from the paper.
 +
 +
{|class="wikitable" style="text-align:center"
 +
|-
 +
|
 +
!Experiment 1
 +
!Experiment 2
 +
!Experiment 3
 +
|-
 +
!p-Value from Paper
 +
|0.0085
 +
|0.0007
 +
|0.082
 +
|-
 +
!Chi-square p-value
 +
|0.19
 +
|0.0004
 +
|0.22
 +
|}
  
 
==References==
 
==References==
Line 112: Line 134:
 
[[Category:Conservapedia Dealings with PNAS and Lenski]]
 
[[Category:Conservapedia Dealings with PNAS and Lenski]]
 
[[Category:Statistics]]
 
[[Category:Statistics]]
 +
 +
==See Also==
 +
http://www.sciencenews.org/index/feature/activity/view/id/40006/title/Molecular_Evolution
 +
http://sciencenews.org/view/generic/id/40649/title/FOR_KIDS_Hitting_the_redo_button_on_evolution

Revision as of 14:10, March 5, 2009

Blount, Borland, and Lenski[1] claimed that a key evolutionary innovation was observed during a laboratory experiment. That claim is false. The claim was based on incorrect measurements of statistical significance. Rather than using a test from the statistics literature, a flawed test was contrived and used to measure significance. The flawed test (“mean mutation generation”) produced artificially low p-values.

The data from experiment one of the paper is shown below (see Table 1 of the paper). The expected outcomes under the null hypothesis (no evolutionary innovation occurs) are also shown.

Generation Trials Mutants Statics Expected Mutants Expected Statics
0 6 0 6 0.333 5.667
10000 6 0 6 0.333 5.667
20000 6 0 6 0.333 5.667
25000 6 0 6 0.333 5.667
27500 6 0 6 0.333 5.667
29000 6 0 6 0.333 5.667
30000 6 0 6 0.333 5.667
30500 6 1 5 0.333 5.667
31000 6 0 6 0.333 5.667
31500 6 1 5 0.333 5.667
32000 6 0 6 0.333 5.667
32500 6 2 4 0.333 5.667
Total 72 4 68 4 68

When the flawed test is used to compute the significance of this data, the p-value is 0.0085 (see Table 2 of the paper). This p-value is considered statistically significant. However, when the data is analyzed using a standard method (the chi-square test) the p-value is 0.19. This p-value is much larger than the one from the paper and indicates that there is no reason to reject the null hypothesis. The chi-square test p-value for experiment two is small (0.0004). However, experiment three is not statistically significant because its p-value is 0.22.

The chi-square test is a common statistical method.[2] It can be implemented in Microsoft Excel. If the numbers from the last four columns of the table above (excluding the “totals” row) are entered into Excel in rows 1-12 and columns A-D, then the p-value can be computed by entering “=CHITEST(A1:B12,C1:D12)” into any empty cell of the spreadsheet.

Comparison of p-Values

The following table compares the p-values reported in Table 2 of Blount et al. to the chi-square p-values for the same experiments. For experiments one and three, the chi-square p-values are much larger than the "mean generation" test p-values from the paper.

Experiment 1 Experiment 2 Experiment 3
p-Value from Paper 0.0085 0.0007 0.082
Chi-square p-value 0.19 0.0004 0.22

References

  1. http://www.pnas.org/content/105/23/7899.full.pdf
  2. Mathematical Statistics with Applications by Wackerly, Mendenhall, and Scheaffer, Section 14.4.

See Also

http://www.sciencenews.org/index/feature/activity/view/id/40006/title/Molecular_Evolution http://sciencenews.org/view/generic/id/40649/title/FOR_KIDS_Hitting_the_redo_button_on_evolution