Statistical significance is “measuring the likelihood that an event occurs by chance” (Statistical Assessment Service, 2000). In statistics, a result is called statistically significant if it is unlikely to have occurred at random. The amount of evidence required to accept that an event is unlikely to have arisen by chance is known as the significance level or p-value: “the p-value measures consistency by calculating the probability of observing the results from your sample of data or a sample with results more extreme, assuming the null hypothesis is true” (Simon, 2007); or in simpler terms, a p-value is a measure of how much evidence there is against the null hypothesis. The null hypothesis, traditionally represented by the symbol HO, “represents the hypothesis of no change or no effect” (Simon, 2007). If the obtained p-value is small then it can be said either the null hypothesis is false or an unusual event has occurred.
A confidence interval “gives an estimated range of values which is likely to include an unknown population parameter, the estimated range being calculated from a given
Citations: Narasimhan , B. (1996, July 22). Student 's t distribution. Retrieved from http://www-stat.stanford.edu/~naras/jsm/TDensity/TDensity.html Statistical Assement Service, . (2000, January 20). Stats. Retrieved from http://stats.org/in_depth/faq/statistical_significance.htm Mackowiak, P.A. (2002, February 19). Confidence intervals. Retrieved from http://www.stat.yale.edu/Courses/1997-98/101/confint.htm Sykes, A.O. (1996). An introduction to regression analysis. Unpublished manuscript, University of Chicago,, Chicago, Illinois. Retrieved from http://www.law.uchicago.edu/files/files/20.Sykes_.Regression.pdf Trochim, W.M.K. (2006, October 20). The t-test. Retrieved from http://www.socialresearchmethods.net/kb/stat_t.php Pearson, L.M. (2002, April 7). t-test. Retrieved from http://changingminds.org/explanations/research/analysis/t-test.htm Easton, V.J., & McColl, J.H. (2003, April 17). Hypothesis testing. Retrieved from http://www.stats.gla.ac.uk/steps/glossary/hypothesis_testing.html#ts UCLA , , & , . (2009, March 5). What are the differences between one-tailed and two-tailed tests?. Retrieved from http://www.ats.ucla.edu/stat/mult_pkg/faq/general/tail_tests.htm Simon, S. (2007, May 5). What is a p-value?. Retrieved from http://www.childrens-mercy.org/stats/definitions/pvalue.htm