Manipulating the alpha level cannot cure significance testing – comments on "Redefine statistical significance"
-
Trafimow, David
Department of Psychology, New Mexico State University, Las Cruces, U.S.A.
-
Amrhein, Valentin
Zoological Institute, University of Basel, Basel, Switzerland
-
Areshenkoff, Corson N.
Centre for Neuroscience Studies, Queens University, Ontario, Canada
-
Barrera-Causil, Carlos
Faculty of Applied and Exact Sciences, Metropolitan Technological Institute, Medellín, Colombia
-
Beh, Eric J.
ORCID
School of Mathematical & Physical Sciences, University of Newcastle, Callaghan, Australia
-
Bilgiç, Yusuf
Department of Mathematics, State University of New York at Geneseo, Geneseo, U.S.A.
-
Bono, Roser
ORCID
Faculty of Psychology, University of Barcelona, Barcelona, Spain
-
Bradley, Michael T.
Department of Psychology, University of New Brunswick, Saint John, Canada
-
Briggs, William M.
Independent Researcher, New York, U.S.A.
-
Cepeda-Freyre, Héctor A.
School of Psychology, Benemérita Universidad Autónoma de Puebla, Puebla, México
-
Chaigneau, Sergio E.
ORCID
School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
-
Ciocca, Daniel R.
Oncology Laboratory, CCT CONICET Mendoza, Mendoza, Argentina
-
Carlos Correa, Juan
ORCID
School of Statistics, National University of Colombia, Medellín, Colombia
-
Cousineau, Denis
School of Psychology, University of Ottawa, Ottawa, Canada
-
de Boer, Michiel R.
Department of Health Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
-
Dhar, Subhra Sankar
Department of Mathematics and Statistics, IIT Kanpur, Kanpur, India
-
Dolgov, Igor
ORCID
Department of Psychology, New Mexico State University, Las Cruces, U.S.A.
-
Gómez-Benito, Juana
ORCID
Faculty of Psychology, University of Barcelona, Barcelona, Spain
-
Grendar, Marian
ORCID
Jessenius Faculty of Medicine, Comenius University, Bratislava, Slovakia
-
Grice, James
Department of Psychology, Oklahoma State University, Stillwater, U.S.A.
-
Guerrero-Gimenez, Martin E.
ORCID
Oncology Laboratory, CCT CONICET Mendoza, Mendoza, Argentina
-
Gutiérrez, Andrés
Faculty of Statistics, Saint Thomas University, Bogotá, Colombia
-
Huedo-Medina, Tania B.
Department of Allied Health Sciences, University of Connecticut, Storrs, U.S.A.
-
Jaffe, Klaus
Simón Bolívar University, Caracas, Venezuela
-
Janyan, Armina
Department of Cognitive Science and Psychology, New Bulgarian University, Sofia, Bulgaria
-
Karimnezhad, Ali
Department of Biochemistry, Microbiology, and Immunology, University of Ottawa, Ottawa, Canada
-
Korner-Nievergelt, Fränzi
Oikostat GmbH, Ettiswil, Switzerland
-
Kosugi, Koji
ORCID
Department of Education, Yamaguchi University, Yamaguchi, Japan
-
Lachmair, Martin
Multimodal Interaction Lab, Leibniz Knowledge Media Research Center, Tübingen, Germany
-
Ledesma, Rubén
Facultad de Psicología, Universidad Nacional de Mar del Plata, Buenos Aires, Argentina
-
Limongi, Roberto
ORCID
School of Pedagogy, Pontifical Catholic University of Valparaíso, Valparaíso, Chile
-
Liuzza, Marco Tullio
ORCID
Department of Medical and Surgical Sciences, “Magna Graecia” University of Catanzaro, Catanzaro, Italy
-
Lombardo, Rosaria
ORCID
Economics Department, University of Campania “Luigi Vanvitelli”, Capua, Italy
-
Marks, Michael
Department of Psychology, New Mexico State University, Las Cruces, U.S.A.
-
Meinlschmidt, Gunther
ORCID
Department of Psychosomatic Medicine, University of Basel, Basel, Switzerland
-
Nalborczyk, Ladislas
ORCID
Laboratoire de Psychologie et NeuroCognition, Univ. Grenoble Alpes, Grenoble, France
-
Nguyen, Hung T.
Faculty of Economics, Chiang Mai University, Chiang Mai, Thailand
-
Ospina, Raydonal
ORCID
Department of Statistics, Universidade Federal de Pernambuco, Recife, Brazil
-
Perezgonzalez, Jose D.
Business School, Massey University, Massey, New Zealand
-
Pfister, Roland
ORCID
Department of Psychology III, University of Würzburg, Würzburg, Germany
-
Rahona, Juan José
Multimodal Interaction Lab, Leibniz Knowledge Media Research Center, Tübingen, Germany
-
Rodríguez-Medina, David A.
School of Psychology, National Autonomous University of Mexico, Mexico City, Mexico
-
Romão, Xavier
ORCID
Faculty of Engineering, University of Porto, Porto, Portugal
-
Ruiz-Fernández, Susana
Multimodal Interaction Lab, Leibniz Knowledge Media Research Center, Tübingen, Germany
-
Suarez, Isabel
Department of Psychology, Universidad del Norte, Barranquilla, Colombia
-
Tegethoff, Marion
Department of Psychology, University of Basel, Basel, Switzerland
-
Tejo, Mauricio
Facultad de Ciencias Naturales y Exactas, Universidad de Playa Ancha, Valparaíso, Chile
-
van de Schoot, Rens
ORCID
Department of Methods and Statistics, Utrecht University, Utrecht, The Netherlands
-
Vankov, Ivan
ORCID
Department of Cognitive Science and Psychology, New Bulgarian University, Sofia, Bulgaria
-
Velasco-Forero, Santiago
Centre for Mathematical Morphology, MINES Paristech, Paris, France
-
Wang, Tonghui
Department of Mathematical Sciences, New Mexico State University, Las Cruces, U.S.A.
-
Yamada, Yuki
Faculty of Arts and Science, Kyushu University, Hakozaki, Japan
-
Zoppino, Felipe C.
Oncology Laboratory, CCT CONICET Mendoza, Mendoza, Argentina
-
Marmolejo-Ramos, Fernando
ORCID
School of Psychology, The University of Adelaide, Adelaide, Australia
Show more…
English
We argue that depending on p-values to reject null hypotheses, including a recent call for changing the canonical alpha level for statistical significance from .05 to .005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable criterion levels both are problematic, it is sensible to dispense with significance testing altogether. There are alternatives that address study design and determining sample sizes much more directly than significance testing does; but none of the statistical tools should replace significance testing as the new magic method giving clear-cut mechanical answers. Inference should not be based on single studies at all, but on cumulative evidence from multiple independent studies. When evaluating the strength of the evidence, we should consider, for example, auxiliary assumptions, the strength of the experimental design, or implications for applications. To boil all this down to a binary decision based on a p-value threshold of .05, .01, .005, or anything else, is not acceptable.
-
Language
-
-
Open access status
-
green
-
Identifiers
-
-
Persistent URL
-
https://sonar.ch/global/documents/42555
Statistics
Document views: 89
File downloads: