How accurate is that academic study? 'Replication crisis' reveals false findings in modern research | Utterly Moderate Podcast

kAm~? E9:D 6A:D@56 @7 E96 kDEC@?8mk6>mk2 9C67lQ9EEADi^^HHH]4@??@CD7@CF>]@C8^A@542DEQm&EE6C=J |@56C2E6 !@542DEk^2mk^6>mk^DEC@?8m H6 2C6 8@:?8 E@ 36 E2=<:?8 23@FE D@>6E9:?8 42==65 E96 k2 9C67lQ9EEADi^^HHH]E962E=2?E:4]4@>^D4:6?46^2C49:G6^a_`g^``^ADJ49@=@8JD\C6A=:42E:@?\4C:D:D\C62=^dfeaab^QmkDEC@?8m“C6A=:42E:@? 4C:D:D]”k^DEC@?8mk^2mk^Am

kAm|@DE A6@A=6 H:== ?@E 36 72>:=:2C H:E9 E9:D D:?46 :E 92D 366? 92AA6?:?8 :? 24256>:2 3FE H6 AC@>:D6 :E :D ?@E @?=J BF:E6 :?EC:8F:?8 2?5 7F== @7 ;F:4J 56E2:=D 3FE :E 2=D@ 92D D@>6 AC6EEJ 3:8 :>A=:42E:@?D 7@C E96 =2C86C D@4:6EJ]k^Am

kAm$@ H92E :D E96 C6A=:42E:@? 4C:D:Dnk^Am

kAmx? E96 A2DE `d J62CD @C D@ :E 92D 366? 5:D4@G6C65 E92E >2?J C6D62C49 7:?5:?8D :? >2;@C 24256>:4 ;@FC?2=D 24EF2==J 5@?’E 9@=5 FA E@ D4CFE:?J]k^Am

kAm(96? 2? 24256>:4 AF3=:D96D 2 DEF5J E96J 2C6 C6BF:C65 E@ 56D4C:36 E96:C C6D62C49 >6E9@5@=@8J :? 56E2:=] x7 2?@E96C C6D62C496C EC:6D E@ 4@?5F4E E96 D2>6 DEF5J FD:?8 E96 D2>6 >6E9@5@=@8J[ E9:D :D 2? 2EE6>AE 2E “C6A=:42E:@?]” x7 E96 C6A=:42E:@? 7:?5D E96 D2>6 C6DF=ED[ E9:D :D 7FCE96C 6G:56?46 E92E E96 @C:8:?2= DEF5J H2D @? E@ D@>6E9:?8] x7 E96J 5@?’E 7:?5 E96 D2>6 C6DF=ED[ :E DF886DED E92E E96 @C:8:?2= DEF5J >2J ?@E 92G6 7@F?5 E96 E9:?8 E92E :E 925 4=2:>65 E@ 7:?5]k^Am

kAmx? a__d[ k2 9C67lQ9EEADi^^>65]DE2?7@C5]65F^AC@7:=6D^;@9?\:@2??:5:DQmkDEC@?8my@9? x@2??:5:Dk^DEC@?8mk^2m[ 2 AC@76DD@C :? E96 $E2?7@C5 &?:G6CD:EJ $49@@= @7 |65:4:?6[ AF3=:D965 2? 2CE:4=6 E92E 8@E 2 =@E @7 2EE6?E:@? E:E=65[ kDEC@?8mk2 9C67lQ9EEADi^^;@FC?2=D]A=@D]@C8^A=@D>65:4:?6^2CE:4=6n:5l`_]`bf`^;@FC?2=]A>65]__a_`acQm“(9J |@DE !F3=:D965 #6D62C49 u:?5:?8D pC6 u2=D6]”k^2mk^DEC@?8mk^Am

kAmx? :E 96 HC@E6 E92Eik^Am

k3=@4<BF@E6mkAm“%96C6 :D :?4C62D:?8 4@?46C? E92E :? >@56C? C6D62C49[ 72=D6 7:?5:?8D >2J 36 E96 >2;@C:EJ @C 6G6? E96 G2DE >2;@C:EJ @7 AF3=:D965 C6D62C49 4=2:>D] ] ] E9:D D9@F=5 ?@E 36 DFCAC:D:?8] xE 42? 36 AC@G6? E92E >@DE 4=2:>65 C6D62C49 7:?5:?8D 2C6 72=D6]”k^Amk^3=@4<BF@E6m

kAm%96?[ :? a_``[ E96C6 H2D 2 D:8?:7:42?E 4@?EC@G6CDJ kDEC@?8mk2 9C67lQ9EEADi^^D=2E6]4@>^962=E9\2?5\D4:6?46^a_`f^_e^52CJ=\36>\AC@G65\6DA\:D\C62=\D9@H65\D4:6?46\:D\3C@<6?]9E>=Qm@G6C 2 A2A6Ck^2mk^DEC@?8m 3J D@4:2= ADJ49@=@8:DE s2CJ= q6> E92E 4=2:>65 E92E A6@A=6 42? 92G6 “AC64@8?:E:@?[” @C t$![ 2?5 324<65 FA E9:D 4=2:> FD:?8 E96 2446AE65 >6E9@5D @7 9:D 7:6=5 @7 ADJ49@=@8J] %9:D =65 >2?J C6D62C496CD E@ BF6DE:@? 5@>:?2?E C6D62C49 >6E9@5D[ 9@H E96 A66C C6G:6H AC@46DD 4@F=5 72:= D@ >:D6C23=J[ 2?5 H96E96C E9:D AC@3=6> H2D >F49 3:886C E92? 2 76H A2A6CD]k^Am

kAmx? a_`d[ C6D62C496CD AF3=:D965 2? 2CE:4=6 :? E96 kDEC@?8mk2 9C67lQ9EEADi^^HHH]D4:6?46]@C8^5@:^`_]``ae^D4:6?46]224cf`eQmAC6DE:8:@FD ;@FC?2= k6>m$4:6?46k^6>mk^2m k^DEC@?8m:? H9:49 E96J 56E2:=65 E96:C 2EE6>AED E@ C6AC@5F46 `__ ADJ49@=@8J DEF5:6D] p=2C>:?8=J[ E96J 7@F?5 E92E E96J H6C6 @?=J 23=6 E@ DF446DD7F==J C6A=:42E6 bh @7 E9@D6 DEF5:6D] ~E96C D:>:=2C 677@CED D:?46 E96? 92G6 2=D@ D9@H? E92E >2?J >2;@C AF3=:D965 DEF5:6D E92E 92G6 364@>6 2446AE65 724ED 42??@E 36 C6A=:42E65 2?5 D9@F=5 36 42==65 :?E@ BF6DE:@?]k^Am

kAm~G6C E96 A2DE 76H J62CD[ 24256>:4 7:6=5D 92G6 366? 8C2AA=:?8 H:E9 E96 C6A=:42E:@? 4C:D:D 2?5 5632E:?8 H2JD E@ DEC6?8E96? E96 8F2C5C2:=D :? 24256>:4 C6D62C49 2?5 AF3=:D9:?8 D@ E92E 76H6C 7=2H65 DEF5:6D 364@>6 2446AE65 <?@H=6586]k^Am

kAm~? E9:D k6>mk2 9C67lQ9EEADi^^HHH]4@??@CD7@CF>]@C8^A@542DEQmkDEC@?8m&EE6C=J |@56C2E6k^DEC@?8mk^2mk^6>m 6A:D@56 H6 2C6 ;@:?65 3J #FE86CD &?:G6CD:EJ ADJ49@=@8:DE 2?5 7C:6?5 @7 E96 D9@H kDEC@?8mk2 9C67lQ9EEADi^^ADJ49]CFE86CD]65F^724F=EJ\AC@7:=6D\2\4@?E24ED^`ag\492:C\=66\;FDD:>QmsC] {66 yFDD:>k^2mk^DEC@?8m E@ 5:D4FDD 2== @7 E9:D]k^Am

kAmk6>ms@?VE 7@C86E E@ DF3D4C:36 E@ @FC k2 9C67lQ9EEADi^^4@??@CD7@CF>]DF3DE24<]4@>^QmkDEC@?8mu#tt }t(${t%%t#k^DEC@?8mk^2mP %96 kDEC@?8mk2 9C67lQ9EEADi^^HHH]4@??@CD7@CF>]@C8^Qmr@??@CD u@CF>k^2mk^DEC@?8m :D 2? :?56A6?56?E 6?E:EJ 7C@> E96 :?DE:EFE:@?D E92E H6 A2CE?6C H:E9] %96 G:6HD 6IAC6DD65 :? @FC ?6HD=6EE6CD 2?5 A@542DED 2C6 E9@D6 @7 E96 :?5:G:5F2= 4@?EC:3FE@CD 2=@?6 2?5 ?@E @7 @FC A2CE?6C :?DE:EFE:@?D]k^6>mk^Am

k9C ^m

k9C ^m

kAmtA:D@56 pF5:@ik^Am

kF=mk=:m“!=62D6 {:DE6? r2C67F==J” 3J y29KK2C Wk2 9C67lQ9EEADi^^7C66>FD:42C49:G6]@C8^QmuC66 |FD:4 pC49:G6k^2mXk^=:mk=:m“$E2C q=6DD65 }:89E” 3J z6ED2 Wk2 9C67lQ9EEADi^^7C66>FD:42C49:G6]@C8^QmuC66 |FD:4 pC49:G6k^2mXk^=:mk=:m“sC2H E96 $<J” 3J !2F= z62?6 W=:46?D65 E9C@F89 k2 9C67lQ9EEADi^^E2<6E@?6D]4@>^Qm%2<6%@?6Dk^2mXk^=:mk=:mkAm“qJ vC246” 3J !@5:?8E@? q62C Wk2 9C67lQ9EEADi^^7C66>FD:42C49:G6]@C8^QmuC66 |FD:4 pC49:G6k^2mXk^Amk^=:mk=:m“w2AAJ %C2:=D W%@ *@FX” 3J k2 9C67lQ9EEADi^^HHH]C:56CD:?E96D<J]4@>^QmE96 #:56CD :? E96 $<Jk^2m WFD65 H:E9 2CE:DE’D A6C>:DD:@?Xk^=:mk^F=m