{"id":92881,"date":"2016-10-27T12:20:03","date_gmt":"2016-10-27T16:20:03","guid":{"rendered":"https:\/\/www.bu.edu\/sph\/?p=92881"},"modified":"2020-09-17T10:26:47","modified_gmt":"2020-09-17T14:26:47","slug":"common-statistical-pitfalls-found-in-basic-science-research","status":"publish","type":"bu-article","link":"https:\/\/www.bu.edu\/sph\/news\/articles\/2016\/common-statistical-pitfalls-found-in-basic-science-research\/","title":{"rendered":"&#8216;Common Statistical Pitfalls&#8217; Found in Basic Science Research"},"content":{"rendered":"\n<div class=\"wp-prepress-component-metabar sphnews-prepress-layout-metabar\">\n\t<div class=\"wp-prepress-component-metabar-wrapper\">\n\t\t\t\t\t<div class=\"wp-prepress-component-metabar-date\">October 27, 2016<\/div>\n\t\t\n\t\t\t\t<div class=\"wp-prepress-component-metabar-credits\">\n\t\t\t\t\t<\/div>\n\t\t<div class=\"wp-prepress-component-metabar-share js-bu-prepress-share-tools\">\n\t\t\t<span class=\"icon-twitter\"><span>Twitter<\/span><\/span>\n\t\t\t<span class=\"icon-facebook\"><span>Facebook<\/span><\/span>\n\t\t\t<span class=\"icon-action\"><\/span>\n\t\t<\/div>\n\t<\/div>\n<\/div>\n\n\n<p><img loading=\"lazy\" src=\"\/sph\/files\/2016\/10\/woman-working-on-statisitcs.png\" alt=\"woman-working-on-statisitcs\" class=\"alignleft size-full wp-image-92885\" width=\"400\" height=\"241\" \/>Sample size and power, and careful attention to control groups and confounding factors, are all critical elements of statistical analyses of basic science studies, according to a research paper led by School of Public Health faculty members.<\/p>\n<p>Writing in the <a href=\"http:\/\/jaha.ahajournals.org\/content\/5\/10\/e004142.full.pdf+html\" target=\"_blank\" rel=\"noopener noreferrer\"><em>Journal of the American Heart Association<\/em><\/a>, Lisa Sullivan and Janice Weinberg, professors of biostatistics, and colleagues identified a number of common \u201cstatistical pitfalls\u201d in basic science research. Among them are study design flaws, such as sample sizes that are too small to \u201crobustly detect or exclude meaningful effects,\u201d and a lack of attention to control groups, which can lead to bias and confounding.<\/p>\n<p>The authors caution that researchers should not cast a statistical net too widely, but instead should conduct analyses only on factors of scientific interest. \u201cEach time a statistical test is performed, it is possible that the statistical test will be significant by chance alone, when, in fact, there is no effect,\u201d they write. \u201cBecause each test carries (some) probability of incorrectly claiming significance (i.e., a finite false-positive rate), performing more tests only increases this potential error.\u201d<\/p>\n<p>Sullivan and co-authors said basic science studies often are more complex than clinical studies because they may span several scientific disciplines, involving biochemistry, cell culture, model animal systems, and even selected clinical samples. Summarizing evidence and drawing conclusions based on the data are \u201cparticularly challenging\u201d because of the complexity of study designs, small sample size,s and novel outcome measures.<\/p>\n<p>\u201cCareful attention to the research question, outcomes of interest, relevant comparisons (experimental condition vs. an appropriate control), and unit of analysis (to determine sample size) is critical for determining appropriate statistical tests to support precise inferences,\u201d the authors say.<\/p>\n<p>John Keaney Jr. of the division of cardiovascular medicine, University of Massachusetts Medical School, was a co-author on the report.<\/p>\n<p><em>\u2014<a href=\"mailto:chedekel@bu.edu\" target=\"_blank\" rel=\"noopener noreferrer\">Lisa Chedekel<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sample sizes that are too small and lack of attention to control groups among key problems. <\/p>\n","protected":false},"author":8472,"featured_media":92885,"comment_status":"closed","ping_status":"open","template":"","meta":{"bu_prepress_billboard":"","_bu_prepress_primary_term":"","_bu_prepress_primary_term_manual":""},"tags":[2213],"bu-publication":[3516],"sphnews-article-category":[3519,3521,3531,3540],"sphnews-topic":[],"bu_edition":[],"media_type":[],"profile_tax":[2019,487],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/bu-article\/92881"}],"collection":[{"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/bu-article"}],"about":[{"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/types\/bu-article"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/users\/8472"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/comments?post=92881"}],"version-history":[{"count":7,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/bu-article\/92881\/revisions"}],"predecessor-version":[{"id":174059,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/bu-article\/92881\/revisions\/174059"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/media\/92885"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/media?parent=92881"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/tags?post=92881"},{"taxonomy":"bu-publication","embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/bu-publication?post=92881"},{"taxonomy":"sphnews-article-category","embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/sphnews-article-category?post=92881"},{"taxonomy":"sphnews-topic","embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/sphnews-topic?post=92881"},{"taxonomy":"bu_edition","embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/bu_edition?post=92881"},{"taxonomy":"media_type","embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/media_type?post=92881"},{"taxonomy":"profile_tax","embeddable":true,"href":"https:\/\/www.bu.edu\/sph\/wp-json\/wp\/v2\/profile_tax?post=92881"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}