Skip Navigation
Skip to contents

Restor Dent Endod : Restorative Dentistry & Endodontics

OPEN ACCESS

Articles

Page Path
HOME > Restor Dent Endod > Volume 40(2); 2015 > Article
Open Lecture on Statistics Statistical notes for clinical researchers: post-hoc multiple comparisons
Hae-Young Kim
2015;40(2):-176.
DOI: https://doi.org/10.5395/rde.2015.40.2.172
Published online: March 24, 2015

Department of Health Policy and Management, College of Health Science, and Department of Public Health Sciences, Graduate School, Korea University, Seoul, Korea.JFIFddDuckydqhttp://ns.adobe.com/xap/1.0/ Adobed     ! 1AQa"q 2#w8B36v7XRr$9bCt%u&Ws'(xy4T5fH  !1AQaq"2B Rbr#u67Ѳ3sTt5v8Sc$4ĂCÔ%UӅFV ?_Aנj- H>>,m*>fzp"TrKkr^r.|_&]|*vPuܶvoQ1mwVJUhu-I"=LniAƕ8"۲ k*ҿ[yu:.vUQ+)%F DHyVBk>Hy8jݹ q~9D4KRmzQ)^ʔ.J%k_tVi5NTjg!'ky|5asOȻ)R۸ߩFMԿ3L4j6dڜ#NIwUF]JqB/(FafJRzq3\G՛ ?~\ 6)6W4m[O^L0E&rRMض*C .]Unl-1 1r#Rj/&QɈ׉˩s6Rj=5Tg.y.·Pӡ:JJS:C8-2u]d&vUz;7p9 5VnL֢"y)">iי(IDDd| Yj0; LRfS:ktYK%*N2^m|&dğth":ey)uPQZW)gcC3Pv&MMWd&Ŵ۲mvTRoժM03*F3Yd6\8,\hݻ kߔi<k NTwSԪmljj[>->ptU%'LR>&EBH$MQAUx[$Z6vi&_a.KIQ{hyƒ j"JOC9eFҝfj;˚Ω<[3_m% lQ@4g=5$(J]Yc-OMq<Ǎ wSzڗ)k$7VIP붾ͯnV+卵*t]iЎD31~SA1éC2u)ʼnQn-Uoi3:grI8ؓWm*G zܕ)ZקJ}Y YlGeJ6cB2I NS3Q>k=KTBT]W6+SOXQgGR? telˊ%-Re\hѯ2TF"C/OJΩ6r[N.0{SpljjX1“jOsӥ;ҭhe}xu`Ք&.)yO̒ Fߑ.$Qw;9Iw2o+RVJMSOj[SoҌZ%;`d$blQ{Ro{Imڌ>3egf\O֝Uzx"䢸g+mv%Gʆ:|V[N'&ס-ޝ'kfE|K,G&˳98Juin/\\Qݿ̋v~Ǩ!rtWU d|E߫R4d}.qPw*Ӭv5YEcn~f5c%MTMkb-F>5JT,})QHg%{("ӔȸWMsYyWNRrkkJr0XドnͫT}r-jj,Ŕʍ\Q2Ri>v$5!]"JB2WɅ)]VԜUc8i|.jeRO6^V.¸ Q&#|ܶ-*uOG%JAtRZRr]FFG\۩w+?'zչSѧt jz>KW&ot{7P&2D;&\\>Q2JzܗAKSfeNn[jRrԕf6,q,F1tRfԗ>vֶևj-&R'Zi2=xv~Elbsvm8=ӛ"ū񕜈BȩlWau[]ٷBߨF~J!|Ipr3R̴#Yp)={7:G{+:\W}n|Q#%)7^-h"Ƒq:M*%J&$T軨I333׎g_- ucBwwjp[6i25$̏bU’ٱRv?G\~#Iͪb7<<}Ezt" q_Inw,7-d,G÷%T* Wg1"䥱kq/A.,_KhqŒxwvo u2ۥۧ.bQ}XκA$֣ +K״ZUNmڸII{.v{5z5ѮRme[moyƾd~cRݾK'j.\i&/S6f|b=5: p!6i_ 4j6=.si˧eƾtS^c.Y^RJVS-Vi3,esi08?H$GvZgg?gi䤟2adw릿:"۪lkSN>q-4kI܋ێe̊qۅgDoѨ9; #T.Q;7#~_Ufstb_'w~Xw1Xk,vcOt._}v}8"(4Z\ۘgk?J?bm_c!g{HZV]Fkk%~gEt)b秴vΰB|꽸}mp~E6ݹv;7P٤v+ri*3Ԣ|'O14_~7nP{7ZU\Vű[ +7󖱅o#:ǥŬ\|3r%TJX]V7ez¨Y]lc|O3V! R zbJ'PnGqVJ"19WVeOF埜EaEJωqCN5Z g-9[S<$sUK5b|7sn\7x qmv##FF\ w[=-43$^ooVSiXօv7iB۴yg>]Vf"r$J3""32!Zh[K%7GvNLs+4nB/B{vlsobJaҺJR:0g%&zR\ S3T[&ִor*ⷳc3ʊO[iozW٨%$gn:ܶWwFBԹjHP&z u&F2\f;ipW73 [; '_̽b;vib!oec dC-tS__$Xs]l9&z$2/N>%'[}b{h/{`{Ji׉׏ YJB/X%}.|+{(S:qz]4_Kѵo`^tY_4S#* ^zvݾMr+TrkQ g.8Ͽ^i>ӈǙvix>$o( ^qt*&t1oJVu-ql5U6jCЉmĻ*"?JT=K'O/|=Vo}l0b}}f?X[?/\JSBe,kP8ETJ==?.p5ފgbU9}ǶdNKk—_$8̸͓ۍ8Di\BԿ-1v{FF]|.^ۅ{vl12׏z7-R7wE?\nh\jN/Kձr_oBw"N QMBZqe-m:ӨSn6j4%!hQ;sv'm4kcM=!8\m[M4{SMliۇ%eֽR&N:{2A8)THLK3Zj[jPBx#BگMf:G1\`edcʮ?|w(-̮vXt,bW2;.ιNHRR#YwTM"<;mk\.foIDjmlJ;vxy7o7i\,KQŊ9d^Mmgc L*.T6tLeIuOH3SJQ3=F/ʿ<9\JM6mN6=<{xkP!F1QR[I$6ُimXu2An2yԒMU q f[IB-'䤯jYm52&JG\zд\~vdg QtHGXw&1Lw+nDEdC1w|YJmvP)HZ>i0BPβә?R:QO["]I_Jʏۍ>QKyu^bycBq4lXF~l [\*N>-J6,Gq(Zr5h]CwYӤU~ʶߑ u*SIv%ZfJ7)! FS*s_\|IŸZ)J ]ܜi4"z[+Z,MOZ))}|Ʀ(RUNIII.S'ˍO~˨rn}M)xxӕ0 eyҵ7YMAB]ӣU:/ѭ*6bcwP͵ "+qēVjŹO|GtY4V j[mLV M -m>",B$ GD1~j6O4|LxnNmqATNR3ε|DŽa[fmn-ڭ+FiK7Pcm;r5 l8r{#-]'nrFh2ruycb;pW=njRqRJ(d mnpckNnʹ+6]tz~E=ʕ l ZZ5jSi3#47.Lcfe`9؏v囜.F\-UZ:*0_<Νu9Lӵm&)_3\^ҹ3"1n1v_|uRʞͫr'iȧN_kH׺8xXrj=\МH)V\ˬ.Xʸ oVRC}ySU9/OBY먌5 ٿwޞ)rw8Ӫi5*5ZΗcGƱ !ZۄlmpjJ -l <R̵/JAպZuq\IdUS 48wXJJtcg4cI~aqߓwŷrm-v)G7yS^7H^-\mŌAq|"m9IBnF㏉9[N+mmy/!KKۉ%n +BdddfFF6FQRN-U5;Sv'm4kcM=Mn)\qιqUd9F%",6MGdT%-+~ f%+y֛^3SrF>6lc(֪vۊN;g._0Sѧ]ETWرkQKzGe9ʨsKA"yC y2\[5 rԭ7Gk5Mzw_4sM3hxЊ'oÍ5jsub )ͪ~tR2H]R͍>̋m6=%(˿(Wrr-܅y5(ܔJ޺YunW̹븹NsqK ]/QR#"ZMDfD|43Qw|._ԡSqTZBg??O Ϥ)/E_U|i}2 9Z?¹0:x'3,whǣ?C y-A~=daJј&M?D1_PS+Oi&;a @;Dž7[ zZC"bv:jjMQk$M RԸ3uA\=wI.AwC"^.{?-\NSiˏ"b}T/}q/ o.1M}R%:-ZniʒL$SgrBW*,Mw'N\ɇ{s\j]VryG'8f`}'N<*/`U숻z CwHq18J+vԕKss4R53/&XTt1bZƟo\=%nO)h$rBi-nKĪ^ ջڜlwkYm[̑+/QrZo%TQ;TLs($2C:s.%+eoNttq۰kK7O0m_t_pZ1SsSM7"mevFZ[w -FJ*T*jФQRg BSu|]g:ɵzjqwmltL.e3sRMچkSmjkmWœިm++¦'tILk*բQ D,PB\lI[9{%Gb R6öۍmX-MaʉA931cs..G4CujQտ[9 }G-xwl)IQz j Ó"rqe&=]꾧֎c)<kӳ+0JrRR3'TnXi^xMF Bު*tIL.[h"2"nKzZe'ZV/RrNYz]8죝n]Ķܩ>^Ժ]u-7^\mZjܣ9+Rmn ߑv?oꋘ?&ƪy^N4o=3-ؔ̿*`}V݁ ƒPu8%$ ݗ]wt;\y\>='OjPIp/nJU8{϶FNMsf"ίNqƹ(+ ݮF2Km |jܴZs%zf*eȫ?]4)I۵nR&FX + [jDh(#哑9q9Eծj8noǕZf\J-l&Z˫}`ӎhyrΉn\űn]9pʌӣ"׮Wt?N4_I_~54#/my1Xr*척aS#DT >q ssΛW;3oUaJSRMDgQnt:Ql,/ ܷfRqiM Ȼ>Cob;A>ڦWقM9X~/!'MW.}Vrߔꔵ!5|iB(0-zF=}okڢE$^wW~nokY߮\6՜̌{i-AF*9)\t9IV6۸5ZUF6R$ŨQIq砳YUZ]eyv >hI櫥N )&l JulwE1GDOuFN2| }馥uC1rޫV+^gdb&W[4<^e4YW,d|htͮsUM)۸8:{3d{AѢ)~ \#J=NdƮꮓ90 |1K$v*?мS ]i$J,C,SG?/_՜pMSƯM|mG1V1$~K>CSvkuj=&) -,yLjuFHK{c駗.SOua;BrSqj-ۍZ#'Jys7[g2z/.u4+XV2VQ.ޕ)$"(%)#Z7suZ%j }BǬݕe)Jvz8zJf:hIN|svO1O#IEcۍjݽ:SdὮvu^@:o^5cs>i/VqmVm]ؔܢn6'vޑ̗J4Wn@OlKbX ;n:hgJ9ŻyǑz8f܌q&Y fN0N;[69 rbׅC2/#kE l&2~èMR.*%g=Ft.%؝e8<.e=Uv{~㻏"EˑnvDѭ͜Lu3u0:U֝$[M5<:oi+V4V9 6nXvx&_ q Qqw3W:uϔ2yb/(ɳ|5zQiJ#r|Hw#.W?4aDŲ\ugWG;Cw鐢K|xg)##=O.dF˟jMUvWĻsr.z]kPc9"]R)mkfOd*uYf١RsB Aîh=k]ʳUrrZsq`d#r$/Ը3o^&lRWȍyuW̦Y4QDUMJ65ƒ[+ygk XK_±k#y:8(TJOSQhJt2.DR}"5[) r)6V6u5k:eXZmv𭤔!푊Q[qQ}ҹLE- 8qIZG|UM4j}Mܕ[Vwm{} Naqµ"ԈM zOpKѰ?IAD3Ir0'/q1itoB5{%wkOBn-ۜduqIzYK60{+DʕܞqIt";r1mG/\/ym[6JƫR \L=S=OT@Ix[TMm{>ݾտ֒ݸӉLYIx>+"JVNzx||5rI?C{oz8۹e\R-^\A2F R+N9 vlT]"ۭ d)t֞i #E2jB@׵=#/N+!ĕhx}I!cM`ąZ*ŻɄҒ߮Y.Z}='/oۙ3IpW̮hT7cTSuz9>B}΄&h!>lӵn~j˅IvU.'v'CSZw8QK3G> ,J59ٷ+HSg䧎hJdzvwv-cvxS5[̊n~ؿ%ַX?O0\6ne 6kn9.ϯ} *h 8_QhLݣ7q +=XBҲ5?[[)+F`=4 }B,sNg==u*Nj9k_GJ)+R~GSPBȒZ:(K]heL=vKPӢwq(NrG^ثϣ?#tC?.ͼ[ۅo؞y#%ǛjVyLSw%T*s92JTM%"YkQО.q)gCͲn8cgi6j1MѾ[{9h^vƘǚםidfi.^RHmg&rׇz:}݃}xT$ضk'5s-狶,\vpbPD،=Okf.c#cdz2FK5T!&)|ntD<+OŹU i-G[EE*FDfeaf2QƤM\UG_{ǹm%\yrGy:.\4wjPGUJޕUV7Do\7Vy_13w;[?c]H\$IJ,*L]3b%L{y.JRKG2sq,B6T}(#nW|km+q5] r㪍bJ@y{byz,b踊3ϻJ,'^xd،)JVw#.Vټc''ÝպWtbRؒJz۠8!o9IۄS95E9ؔ-e9JR{dmnッ<[~n${~Њ$W?&ՐY_? #a.ߑv?oꋘ?&ơ|y^N4o=3t=~7!/M3>n8W홎2M`Qx+ z qy8%]7_~540ۦ彷]Wq CѡwkďyF5Dum_}~P(5.(X,K9vᯐ?leB9;Jhm#3{CxGE-S{;@Fz˙]=O'!ɿ]' r`:7'2bЖ>Iy,/eTy/V<.H?UYY{\^#ѣr9^7?xoRȆ7EoS_&??zϾM?(~Q-K&>"~aߨ t7Emsϛ+?;fCr)fY+>z$tIkjn_>vnrֳki-˹l= t;'EyC¥|/BLwBJdgjۛ$s S1|ɍV%JI6KvəhzIlBYɒ|0"Sy0F>eo5W)O+X˻u';v)2vVq۳kۮws?UʑBǴYO漪e2MIjPAک\b1)DDؚKm6ZWΨgȕ۶yjڳ 2ضN[C[|r@9Jfo<_eI7q.|cÊV߷:i.:$ȋ)1%%)ADZCEBxJ0MJۥy(bNsKM9k43IwNt.\%N簤I'.j|ƃ2$grBEٌ\}9:v*!n7M(ɽ]7c@XxƱԨ37īf62cTTfFK]9wntQHͮvٱI/f|j=7}\_V5U^+:uljSȃY(XI.ȱmo1甅jڎIZ2>#\*:gY|4k\8ZwSqtyA!+];бޞKծË¥e)#5ap.QK^8VdU{*ѽL\=qmjnB5>{ Ӟ`v±5 ^k&O~Oshɷ,;6nOW>u6{RqS`)S%jp\ipdEBLfTWy$GIYw~䲭J.1vSY5z.V>^+Ǎvc.I[R{QsNR3ӎfhd>y?UJ*}~[e\i5U^͛E]G_FS(Iɿ]i8:4zj~շsW,ˆsy:%O}iur]iF5~3M:Ӟ#N06)4ߧgdawIotiz:1r5YDZLHBSi;NQc44la=Y kQIT*ըl:tq2(է9VO4뒳܂~2rq'nrVZŦ[t7\oլfb/mlpc.I8콚q^1iE~䰳mi[dۧw֤ICfdFeCsg:i| 6擣׋* 96lust^{%99UNRvaMܽo ammi$em4D6DD\nA%$$#}۷/ݕr99JMն[oT޲E"KTaP+HGkŴj5TM5xƱOS-k`ۛkٝWz;{kS}F;~q|~^_|euwnE'pSupUP)V]vE+t =ZRaVdG6= *.ϼnj9:UɷbېmF_tޫgHjVS'śǕًdkkѻ_]Kv?nT>)^e=Ar1'3ԔILyD?:-^in):{7.؂\.:V }#뺾.3r̸*xbFM aȵz 6SQ:ײj[ 8nn iFMw rR"5M5I旘35f^j='j:nNW.ʭocZvZKV^ɚJ.cM1ZI7E'6rg탸5oZ=[m Z`\hbMUR١Ȗĉ):Jin!_7Dй+f̷eKҷvͨBPR(V`y6tw*MRΝcB.ڭTnc;P$8nFvm4(D(R#R-L -2:FP lxZKQc6I("Km%$E, 78uXIFA$RQI$JbInG]c[ֹ:ZM+n^')JmJMJRu{e)7jQDw~%yQl}BZujSSf۩QZ+Dzhd5o%BIc'GZ?}΍:>Ɵivז-%݌J5MqGWTVʦh݇ܟ~Օ_6 n'{3~mϬj'J11OȻn߃r Qr\3y٘+WӍ'WxEs^O3 o~[|7>]]H9݇ZomT@]?5B:Z߂'`V_+/MSKX߆ޠk3?o7y:4R/7þ] iG߬aBRU&?r&/} cQߥGj2?C5Yśe7hU=?+ x龳f-܈czW^7p%-(\D4h{UK&ӡn^m]Fݢ:`δvj俜F+) y[{{ 7 tu>gvrěOj'5 iRg[ͶFjGe n~qT$ci ۚ0oԹc*jL[sVWqj\ݻ&6"WoK:cnWmrv)o>66(F>=W^bf#c zzʞtپy%mՉPël e}J.\Zk4ttt>oEM=q)hJjI=ͥ(%]脼_88ф;͛gWG;Cw~˘$4=uWdĜTثNDkiQL9U*O"4XP`02,Ge-k5$h>ܼ]3vr6!9RQPIVSnM(ۓ{>;/Qͱv{3&-[rc)ܚI$n{Sv3[j00)-D3z}MRzVQпj,T[uVs0\}Sid;r(ݝJ>æʺL&c[jPK0~d(FKÝW\m]GTcF|Iׁ)I3~#oX%vҦEݑؼ5Żv2qAZTE^..M{ʐfȏ2##.R}*KʛZz^ӞN*lPťLf\G6[WVQquV]XAi)5J!,$iJ6o$tPZc;Kjx_n3`qIelV~vLy{fn匋Ѿn%;zV.n'-ұdd2߽1bZksPe3TI9)$ԩIN9Vơ\=2885N\ p)/a柛w9g_lױo8ݷ iixJV& ғRi{N^_oAŮE6Y7I$Nk$|Q)-*4Z)^¸%4Qm [I%.c-OV+C֧R#%ѨCe3i;w$G+_dy| Fzj$DI(=OA gj%v/]8qԯNIS*֩',Q%\44ZZ%D|Ǧʴ6&vֵI$%8(ԬƾS&#Z. }6z?b/|Jl{ץv&mpx4Z$”ڝ4-H%dGKfM:sKSRWeJAn]>s6应-W9'H]'uȫYvgK^\czp|My\鏩w/ËQ.)]\QiS`8uL뚛̸=J"ܻi\å'-)54Ue]:K\퓡vK xwBqrH\*֕TnzC.mT=t-H]SČ~Nu╏NÅ3f|͡G~B+Xm[Q7U{9"~jgK Zoʰ7"qJ,ekSeNGgϳ] ^.6:s}_,%eRg<5⿨z{ZPun#jRІ.6g T.!]xa c#jN$Zpl̋H WZu8WmMRýsĮ?Mco~sx TU҆Q :KDG4n42.<3/'^?6/ܠڒ^yrrÿr2\D}}B]^E~^T cɛ7϶Y[<֞[7d}2%QPqOLEQR\CIsj1?\}%tJ0e~ *sk"*)&ۓEi#{1J8Hrt|'ܝRr8)=ƔN'RVz:cf]F7bZyZUȘ4x8,#JG̒?.W9XnO]KO]%]ƻ O5Γ/3qÓj؍/r̺rƵ 5\&m6h.xoeX[=<3%< lZ"2h\Z[&jW3ejm?k&[]ųj+{N{66leu_+lj]q* 7g*knأYv= q ەdxЬZ|%GUrQ3jLŒqET]1% qkXYūYc[7Ś]QY\jko\</Lc7+'hMSUc6qXyؙ~6#ѯv.0$BQi5YyIhɍiy=KD!n3Vm[V%W-B%swa97ajۗ m+9~]fKq|Ddaˑ0A]_v޺mM5* F-BYHJ5}q>ʉ.6hyDmpD׬'-_v5;5[8K[viJ.3dR:oYHHh9I7:۽fi+wm^ [)odPѱ52CZUJicSw\&_s0uBȍh32džzQflcd^m|7GѹE!fO5]]H9݇ZomT@]?5B:Z߂'`V_+/MSKX߆ޠk3?o7y:4R/7þ] iG߬aBRU&?r&/} cQߥGj2?C5Yśe7hU=?+ x龳f-܈czW^7p%5|Y:SJE\U-(a_cƣUǽXXKiȞNlmۊڭڄR!**ܤMeȽ$|X5(Ź\rJ~ܮ]>'HB0cp XFr_c?f?7<ukSgov¥iG>>䙗i.+t+bOjIܶ . i^:nm}s}(3>NZ$2Qg([".>i.ƾ)B̋M8+"- >eE6DݥJnJˣt׻ 5.˅nJGwZD~!i۶a,Db3ZQ3O#KO5/֍ozuK'GbRi᝘NV_ҝcvם ZoX}F6z 7e5_e:ۓj=AB+iܔERadMBq*ԯ DwI/Gy*mĥiRKg6skY/#SN4e$-yXM YL?^ĸNNӪ{$r1JJRSLO]Aqm>V/s[~i/j+m>z}eI"Qvp]{ZԼ:{vPAG2=T͡@ڐ#u"E*>C;o$~C#_d/HBq^YRٽzIKbOm\~żjFFGdiQ(*/i*#.FF]©m=BmpQQQSP&Ҫ!T&^>:y)$ˑÐFčI Bӡ-t!bM WҦŶ'UZ=}zvn~oT/\ǒ'nr8 AJIӆz<^uߖ4eFC1i+v!3qNyߕni?4JZlmYFXFۼO0B\m[ tʄU3s"Sr(NJ;SKW72L4̏BVdf^Ҹj\]ȱ۪(ӷm?J-KEmWڽ^4<8qu%9pŹW~877ܾeVгS(յe^C]yX͹! םm4FGȋ\y'Z FX7e)|Gjt߹#gb\ŧq_([R8[qU$Z (ʻezV2V!iQ,i$JE˂٩ a(GK'O{vnBvryRd-RK4=qxZJMl_CuuIz @Rt㮽޳!|68\-l[џ84-2Pu" RJ_^OL>G1~XnBŬw6J0*Uvlږ1N G1q9IUm*'oWu][&UyYZbBZRZNfEJf"+2nF~Eû7n1xv.RUM$6 lAxSQJ&n5ܞwlEói"#>4׿Q.nEq7Oko[1wg8ZQwZYiqtm&~">Bo?w͡ni2峋NCEy Ҕ+%ZJ ʩq*fpˤl,~^Mχk1+:ݕ z&Y`KLӪУDr3[*Z :(SL&ݻ۬Vqsyԭs x|iI߽zZrg.:mp%6ԜvgmpIUt;QbS.Է) ǨKSV,*lڌ|5Jt3#NP.=+OZ~/G سIgbꥹJnl_DUM\iM!֔wVZuԺ,yV.Q>f v:݇WiaŸN5Ҕ[M7SsrvǣrMW= \8ZW-jsnڕ.ZnF2qt ً[ٻޘY۷Zm"Jxr&NAfA-݌to9s359݆mZ+N1-qS$D=17 x׵+%_ ve4ir6Z$FDڗnFtOr'7'{9C˨ꤡaYoace{Refnft RR"4%ʌm:Sj3)OdInTO>X'vxV#jܮw9Fog;5.~Y5\~18YQܹvj4+~t7S ﬕs %^۵ڴDZV69R^Y+rj$ԇoJKR5wB9C>Y:l+EǎS{ʲ{T6Wi* ^^9k/y/Cs\g*qڵgn4T8mERr|Ti+iPe;;.i\EBEJ 丬i9ɧM-ԼsGDrZ>r#R>~X9y4b棇9JwV۔%m(b[Tjvl}۩~nDԺ{Zo-YuK1vx.nWuO+jN [ٮ0%"΢CdTJK-RަH"$I(*ve &҉FzB,_Vpqp9m8werv')E;o&QE׵^d9˦j\_,ڵugZȻ̧8k+jK{wmr@3ӭ2 wFkzFVqs1؛.v'I%$[iT]D5Dl2 nk7qUxԫLS+sا3/ΖeZYK<["%-g/kRs:f3;*E ت wJ%)5&+&rw*霣i|sMҴ|;R+fm䡩.!**dӶ-6s6,]zAXMWjmnz%SJߴm2UXw7MQ%<!tKys#P,W>s;3IYwx<+i_\\\U6 u7P|xbn_k&ӓVOe䦒 VUr,-㘘"-LZeOSҠթrEvq8Kf%5%&K"#%vD/.ZYYŏ+p$nZkvއuW9㓱Z G wYIFyf)?ƎUm5ԉ/'k84{KO:rQI}XRuԪ|*lu)3qZ[mSm5R3".Xcَ5c®ࢫI*۳~wRϿQWޝ(EJrri&ۥ^ʶ齲Im|[yb;mnm֩uiܘq>E+Ikx߄3r33-5𹻖09ϖ9[Tz~mr5NsWl$oPusޛ^{Z;);sڹf\3oٹZmԉ/'k84{NO:rQIBø8Bݱ3n֤DiK4u& ofSȒܩx<˘|N0Fչ]qsp"}! QWw@t4ӭ+cO5%]'*{eM߲DRO1y*q8w++e!c߶ܪlZWّM欼 CQ̼빶lX{vib/V/ ai;x6~]+z]MWB>re-:lgk}պ!#9?%܋V-c[z!W?c7YNm/jRr[HOzԻefճ0q15Zp#rkQQ0tU-AmڵP/cȕ?0cZYj;:0ZM=D6g ?'UN+ձ[K ܖB2'xq9{|۫N0ku 7xaj;n\ 2[VznMlWiKbSk))f..)Km)&bGZ=>OR܍W:j'rM'wYz&/鶧{Sʵb"vջq[I-ՌZH._x*BagC'T(Q:$ͳQcMCKy?3g'ߝqnT);qs #ؤZ}OOI:cfnc8W~qy.;^pVl]Hԓ>^H^@7-AA܃nmL(uWܻS߿ Td95Bdh4t6*dDh!EhI[iŨ\L.&Nc ܮf^;$R)\rip9I|ٺ?#R.ZDZ;/]nݻqs\QE9M&Bd ]N mN*D>tgbK>+ˏ.!23]BȔR1ɝ^j'k2ƮqBQq[$di]icV/e`޵B.FIIJqbi>Ӥ|p; 6${)RU>_e}^dzdfzi %ekRVUS?6'hׂ)5.\+qUgzE2C˷ecŏ^֔ibk shesFWJ#~> Wk~ݨ}ڶ>ơǚ)׽ZƉo~B-ڼrvoE:Ʃ3ۣK7+Y`WirS):{>ڛ}:wԨ(J_";6R%[u&ƫdZ_\'np| RJwNeTW,=rrbnkڄ[M3ܴz)3- R.?:okۼ0TU'w{6&w7j1z3ON'fGoO?)S_bQ_¿R(^ԴԴG.EtMڇ&RUiW uQjU> Kiu1d<ѥIQ'RQ1:O/lŗᏩiʂv&Jc{D5 Tt)1.n[n۶X}RjqnOʽ(~[Ns{ސ⛌uO,kgo֢dRNQȄ .'6W!׌P朼tdZjFGE"]K@'i۪N;sI[{SOzk>`rRR+!σj8&TjlvA̷Q?HyjyLHNտJMjܶT۽lG?SnKN%<‘ nq[N0Sq[Ta(&t(|HGO~gvkݻTR4&Z$#ViOY1r$6YF?e4U/Mvxų:zbU^gQQ+NW_'4jfz^c'#`rvrڡ(IJ/J ݦ6 ]-CW |_{v*_q3^DZ}Ic6Uڌ8p7{crZq5ki`)mU6|-Z5^iEz3P=:Cu7DF'k%}<C-޹ֲ̱#\,(f88%X-N(ck0VLR~} G"-8ӏ/ϰKq?(#nrVTmZ;zióM4 m |UT'C^_1X.gXM{%ʤd 4\ovN":"y-,T)fLQgۢr=/CƹǨJVr[a+!rT|%Y\ٱzsS>jͱ.oOc6f$q% ǒGo;n[];ߎjrk{~\VۓNIGn:iqxo |~t5)Rxעri{Vi&NUOl_ѮMfsޕkЄay.0P{7N((BaIP$ K"U6Gl ݙqJRu+qN$ m#*p<|{:>-Ev=86N*MM긭U*uѾ?/^o7;'u,h4݌xښRM:5.(/ \իU.{F^rmF-Jɷ.>Q"[4xT^OZ~mK}T0ݛ^SAo9u?lX(' qj%=X}"^e4wˠ|rܫ 6I\Ķ;Ӻw!'ڍWg{ i U_9Avhۣƾ+:vs/MK[ɭīe{`Zgb}r[i'GE2J7Nez579wRq+Un ]J.cJ4M:h箽Wxxm^ pc\wcN%'My $$| :$Fqɏ¾^қP9J6Wxvu}ݵP>Z'FFdg"-; [¢cmWkÎT8nG%ݣ7*\խCLRYZͤiD&J#'ehbSyXK|y*ӞpS̍R`[pTr/Eg)K+92{_ n3zwz'oŸۤ+sOj J:`T>Cf*lwd\fYOP"R E֢̔L4ɥ :;.b(B02rJ蠟9>V'9M%)IqnhP<%,r'P/vNSwr#w"ݨaqc(|{kd=^0jTMR2ULNz|.<|^PfY22##!,K~E BEJۜ&jRNsHަޛg\r,v؜.jK3)[EJ2ii{KEiHP^&]Gn8x=K}Wx/KI9-ϵwQ%spܾ[^R}S3$qvq8M[ ozKxcqmJ/ӿ{_}7&ݨ\f6ZSyQz& 7ۉ[8~UNn|nkiTB+4RI8'Nc%tn{!]Ȋo.nEmʱn𵵥J A+wy#+ikǒڂ;՛s85'KmE:Ђu""Iģ5p=БbTY-ͽڔ詻ngL2Q}$de# fs^o{DUUsfwӶ;s1T,ǤtޒQ\෼J=.tKU,7čJ5 N$y3kdSMQU~mO[03 $zAڟsF5^뜞"Կ QHmrR"ӳηer+ҔZ]hE-6Jmt'ޒ=O[sQj)6K}?e4v_KfZheޓ=BV[bY}lݒTTЬ{ȫvO_qpRApVŗ 6ju=*BR)g "O1yhb=tqJ gtm\b3RY+JQ^Ō֍\յ\>+uSi{=x ^w;uӘ#ĸzLn*$anok߷CBӷ}5Yqvdž<( "_OWit5:EZj2 B ρ1̊fi[n!HQF82q1牙nqnEpT(2RMoM4ϳOu ':֧_Xjsg jP^(ڙ{2%E͖j^}ZU[Q$'U) <܂%!s"m R'G5M0<+zM6qYm$ڕ$3ǧH]?o2N<8F1̻r_my[Rf59NjpzBnl7*{.QP 3N&^BLJPjAHCK2Q}$#~YMq8 k(MFMU)8MEqTy+Tʞ-ar5yܕOXw!e;q-Jqܶ䓊Y:LC UE{/t>r"lI9)3KJjϤA 6SEE$d߇3KG*En|P\ԭTn6I-ƍKTj<1H_zwGr19wF N8ݝ+a9ɫM6mhePi%mmD! """"""*1bRKrD"vnrM۫mmĽm]ӡiG~e"˩ lhRTMk^MX["Jݱk7_ޕ*DqĒ&flՒ}`W}~SմZ{ĕ~wm*/{{ѹ_-0ط#P]xlڱ~Tn5wi*lڪ (JxioϏbqKYR|!|KN53 OS222$jzww%i}>N)E+rۥ7c$Ofl/LNث\6H9: FY󡈾I)fB֔JI_ ֣^: 9mY{66㒢7Uj]:.-os[R&gMF3˸#໹kmjq^8W"PΦURjʄWa˧T!͋ lW48JB2ko+ /Nw QwQzQ ے%$ޓ7^YL|r7!v%Trܥ &|M8~ybrn[RV gSn{{*#2#ԽᢏӴHak" ӌcwҜw&RJ07ױ>Ļ =^ BɆ)v32.M1=#6%̠tҤnzqMwԣ~s*%-j|_m*.Yx9Sz=)qE4 3pk+,`=kNRڥ=B=nŔNAx)Q$ԩȧ4z3t#Z2lҮYn$S%y- JzGpu|LBV7ZW#;Wwipܷ%(6jFG5#{$D"uۭ~]֫SrD܃fҎӾ+Tu>-ZTQ& N|$沸ii>eRWݳu'[O̻j8JۻEѩ[]vni= ڒ,[_%kC7I3Nv$4ɎЈeٸoUu:[}Do5|zNq=Tre%ɧ6&~DȍF]ƞG5q m]/w/ \ʲr8=oʔe9U(W"|S]uZd#?Se[W"ֿh][-7Nu:T=)R}.;ml*5Dlf $fF(̏T hiIUU4Szɕ t(%_|2 ~6eM;TƗK[f&]LK^CE2[ȏBOd;Mi|cx,^6;sیGpQ\NuJIFTJ~đArh* B"$H쉩eXPRj?sl"ԥ)su]xpԴY%VESH"ЋJǰ K&5^Ukzׄ8kEgS2h&Se\ Yl]WҶp-ZUvi7QS:4byqOo+[̺腋[6-_Fo.6[7$p&^ _GZԸߍkc.qqoI[9m߸YxOZЦ1uoiSH)P9Uʄjcq= S>֙NeR><;+ڌk%_qT].srNO?s[=vH[]RZHRMtᩗVؾ:/~u)ԍdg%=edVrISb{6vSu=(ܥ)mTv/J}̇8 S3ad:^hBSf؉OɔLhI_1d8,L><_A0y3rXq"'(۱;mFNII.v5_(^q~X>y{3צ I*Vܛv/jW' T'NR'j%ꔩ:mJ3SB}΋!-H-RJBТQoedi9tjENenPpke.%4]#{:>mkEɱdYWl\\\'nRM4&U>?Ќˉk÷!𴪛]]5}UqG~ݏI"O~s6(Ļ)qO~h}uԕd}Q~G,oE!&G&/]_H-O=o{k\̭bkv.Ô܈+;arZx)m?M\3lU$mk-CFXjTv6u' g:Vn_*qk:VC A%'4JV%EY)#BғO4<e׿jQQ]yUr4=wm[K1r׵%Iũ-O}|kC;/VcݩWZ)EHdžTru]8hgĵ-;=>U_ InvTm_jBM+QiF"9*{DI/iuo(=TzϖmPQl_v4z>T*ȴ>YF;ε\t]EH4ꌇ[VrLzef 2T^V>g2~kg5~Nק;{~Z~W}&ŒBӿS2$J?~(Yœ"˲ߩ\O]: J׉ښT{mmIѩn3˧)4LdFZ/zUG>U> n 5& ϴ-KJi2o]uKljvK3$bԔҚV旧iY5.ίfi96v7!v))FJM4{jG~Jt/lUE%pTAFe4qQk\ve۽/u/Im+W')v{\-E|Pms7߮DZRr۞/mu*1ՙaB܆ -xg3#6ۥtRogʌU)׎]ZҞNnŞr}F1Nnޞ;cZ{N}ۿMiuxʉ*3qi'9KHQ$WJxXyرŔe~[v5~/jN9Q4o6rJv FrdxM*iRjMzUinHdн7ᾞS=S'7 } ̽zt7K|_g J=Lq+/Bw_\ۧx\HJUPzQ<hqF[V0x==CsU7q|^ {)Iq38$_A(VgcKu06Ƅ"%i~_ˉk QCܣB8Ku/񋇵u([w}$F|8TՠI.E !;RJ^}MɒD_q2];Ɖ{5}*n7nEInO{Mwv}&q+v [V}Ĝ@%>#dXQ$f;iep.GquixVt x6bj͵mlKقQ[T]zs/&yەnM'W}!Fp_d^Tu N{ɻ'l{խ2.sTu{W^H&;1s)Pӛ6>$mě;Łnj= fLT)>׸+qReɴ[UR\L*P/!$Ӊ3Q 'K=m~6XqW3^W+ųO_[F$rR*u"T%@O +%# ]˽!aܽz{ͷvQh쩎]hGތ5ɇ*DzJDRNLi 4:{~2FmXY-zzĽ^f=]uū{/+&c:Ma{ĝDp2m܍kHș/(--m_vݮK(V{R}.k&yƴ7i^4@3f sK3^Ř˸B=]?gt5KbZB<e;kQLpxuWC}n 5ҴepB##~q= `x]KWF {GfŲ}?G.I9pjWkU]>={7q{kO/^I3==f1ɏ%nnʫ/Zu_yXN<57ۍ'vy/"8넭M2eԷ&Y,в33%IkjMr7xf nmQkX4踼>a-GcIeތw&U=-:qnW)z¥j :WqSZvԒ#j"KrIU)%qrmRoDGQ~SYRsu*V)  ,/x)MFD6O#]z 96[Ui(JRfw'y$GeUީkdMF-ݻ98F2d[o{Rn0n-xsV6Dh|Eb2E:KCOӪv4SJCr"J!!m,hRLD| ZYFm/X~ΧfrN&4Ƒ=Z9Mh.Mܵw/BdrܥniŪ8ɧ|y%œ[M=_tj?F!z5\evM:\ ~F-sg钬OWq“iiȍ<Gi%%n2rqͻllƑ)okw7}\Uk-:&fj솘XerV9yZuʼşdFC=rmo%~ZN78X(N)_7.Εn1MpJ}62jjJdI";R5&iLԸc:jmqiQj$ujp\{;v5B񥍪Xn Ą4qOERjzN(Ga٠䌡)p*v(J7#ZۻZ8O W uONb+^Qipv9GvֽƼϯrYƖKGJQDNPhRJjᡧC"21"9ѓS1;R_O7/WGz)8fE%F2ukmvSov/iZ&/]~KmI[:^~ͤ\kMi稜\ywJt3W7 8Ʒ~ݥeFgѼw"8VVSج\뻆}ݭ/J6Q)d|)zU3>k\L=;ow֯gN3pKѫ|wmkZ$z^2R:E)f>ς нd|#׆?\ǔpV{;\$ƵE%-ͪm0S6[n< kE[}mvE4DDZ^$OZ0*$~XUv҅B@^?]so#%ojw;Y#SxxueBگy v^i-)s)zV jC{7Gt.w3v,ygg8s]aE_,*E tY5k٨h=o"m泏:\6w噓aiL׎n^c\75AGkЯ0Lf46َ`egZ˓p/k;̛]kq!ݸzpԭG"}R9Ve>ˏHUjJ-&7nrnwG*Xv\˱/vN}O)ʼn&CV͍f̵]r\PMB-6Du-#RͰtRN^)mT _}nSȕC*_xBuTkJW[`ɩ`ejvsngP ڻ.-WUtܑqԹQj)t;vN&RNũT+8%IXӃ5fK՛-d9 ]CƑm|nZ-6=Hz,*aEm W3VzRšdY~Xf׀Xx"]s;)5u*ُHB BRGS6bݶؿ 9j[1*jױga7oX CUI%0v#~\-O-Ꙛuɷ쏪&5mY٦M`LJ2qK~HZbr =N'YobI. (^ ׾{_ ?OJ`S`3BN[}5w6:ǵ/iSlt=4F*d&T4y/#. ɵim5Uֲf 眕6Y7 fơ=3dϕq뚩$qTM-%r!$@A? ޾V0c~{[{;򥧅a~ڵ»&ڄv1ek=wb MLkNAԬw-x>~/r=e73VeVN)K%Sښe"+3uXuچrn ֺVzscJ峻m}vb㶓n\YbIUBT%*,0nov=;z꣓S/nSXSpl##k9mXGrZv^Gde!ŷRԠzQyjC]`gToPov{j~KRBMY}i[߶9KL2ԉO0K#m>wB[ٍ+n[[b٦DX ݲpo] [\m5qdT()mo4Oy9Ie b][wղmM~vmi۱~t \}$яimRk(L c Cvk7r9_r1 ;zv|F@KyZ[&jEji/"6$69ml#e]9s\{ScL}Ȣؿ0q/nZ*t,CLoD߉Njǚy=Pgmu6^]l-["çUʖMlʍp-"qmU>۷uFOJ%Ǔkx 'g=睋k[3u,{³WɘݪF]ՍeFX"Oy\,cچ=w/gn Ļ]#2? vqy-gXnR.^}ݺFs{ŝG]}e|#0mjx"ƬWكm?rgU^xVB":Dt>@LRbun~ݭ,w+v⪕;\U(RYa61>#Jm˞Μ9g9XKaG='u8gf}'qy#ɉw J]We.ʲ-<+&q%s?2dњztҼn`cΤmmqMdz O[-ߩӲ&;[tmܝVnr">{x<8U+p:Ig]zjGkt,uzf}dؠoJaکqEq -(:d<պ=eKy[˗^%ZXkX[C2߱\ITTLGzANM￵i]K>UsOGDDD.ZF6* ҃V Zhz{'xp^`wo8r0h ZmJ5"jb[l=yUu7-;7IT%:jFjߖm0tzU'K)څNۧYJ)4IQ}^KWm7kSP>q;ނ#)'n7&׊r?óM{IwR\j2Qn[v pe#/tAF\ϵ225q֒om6z})6҅*oqDsMf CNIN=T S2t,_ѧ}kveMF0J\Rnnݙܹy[rUc-j{yGtkQ%s]5qB.Nw.JN1LvR Ui5J ZESQԙr):MJ+g}χ!2;q([jAud][ljVK3$ײSJI=/|&tl'*n۽f.frܥ jQO8>&Z];.|7T/C}$ڋUmP2Reҭ8hFF\L 3~e v\۫]ݝNmrnB%*]Z«hKc=BTLG :V74$=Ǘy+EX'4tn(I:Ѝ;Df8c,k1%dJ6.j6ź{N~l6&*fœI7 WAlGOu-ҢH,,(ǔe뿋쩨kM܍ZſgRvQ' 9)?n|er˭|I|-fGK.rΛp8XV1%K6mvG+tc+qE&ǸC_Nm:l=_/m5^[dߌڇ.c<%:)tQ$Ow~-aY;UJ>=F)2[nk؆?훐M=l6[4(O.]2#-H^n#->&mp5~Fӛ+|| S,xag%qkEUzUgæBhߕP(7]kFnq?֖CpruZ6*rEڊtS|*tI*E}7R<,nUU֫^I7Q*mSly%rdȓd8hE<9oHhMfNSRj[i7D[Rj݊+kდq{"$$H?p\̅S?㭻;t~R߁)^/>Qj`yt[w ԛ;²~+ߔ_ YW~|o]?x^ᯛ `ʼn;g)T@vWn]>&4lp+$D̢1l|ȨF%-}.9[}w~ ԠLM9hСablfe&QoW!s?wjLK?s7yO>(=C~_nyǜu?v3vyo oI@qV-jeES^[9WoSܝh"l2C1a͔CiJ@3:Pճw=/7ovuk+\V;lDgն<[A+rX~d;m!_s8ݖ׷;;.0llUC+?i#_crʙ1~C.\–q ul8Hܶ2m`ܻM3Tov|Bs rɵ"oLS- DКw=Tv@f'6|YlD͓Y%׵-#Ѯo%:&!3o%\J<02;K87>^vgƓ# ;ݝmz^Y6=PS39U%~ &f# }o!muH;ʲŇ˷yvP+&.7e[3'vR4Yj̗IZ`e˽3o[WU{ m[sUbۋZǾۆl6~9'V*.\S2<Sd*zY[aŶ`]C$n.v^Ʌ dng>ەZ,Mmϑ :n6nϦezWqUJ4! ۇ4R! =>>Fn|Q[{pRO17ƕ~._I''00k=b՛o}Osðc2'o\3}ݭQ^2 . R1yKȣtAݿ-uܾw!`?1Whn|gzUo[ECWwjUIן)^h#1ɭ!/Z np;o;ΗŻkXs."6E`Z1 עӐ9Kl8qd q} 2Stt;#j>;խabONŗ=fwP1j)l6J̶|gV2`y/0E˛6+ԫ1? 6}KW c\KoKͨ2ۅFw–s*TԞLיuDx .kCzWXhy۶gLu|%TnupǺl-S* PRaLnT+c+*xl.v!.U=|; !_L̎뱚U=4hm:ٯ"y)$:>%(n}X'p[ȴ ^˒4kƓmzDx \ 'NqamP7nyN݅=j7%McSڵj%STy qXymvCg{w/w=wSW5r̹u erծˊsOm=DhEҚRb#n)QOxtվQwe]I}wCa'"[ۂ-z}2UuKP$㜉ԧ:mc<Ý>RoL?wu|%ҷ&K y_!y9 ??:tq3(UU-lkS'ɸ@jdzQˬR] EVPW1DJq2n:,c|ǻ̑;y{X,ۂ.u.b˕u.tKBjQ"[S園S`ٮdNبeJ&9Ơ ~0a(Vm٘L+Jr*vڑE( x0+tp˕ n';wm-ޜMOxX>{#2%jgb2M[`K*\5@8l'e=0u+w ֘鳾{y܀:R*Ya]"Ӧ%ktynlۣ65,3gU}{GYrb;ge'TKwǘ.,rpܚV]Tr,!dp /ԺU,xՉ>s׽~W5oTh yx?xrrx?)?ilbT׬,z$Ԏ.UH٠\U1pU:]JwSrGZq8àd驐,N67QYBӢD㏙W!Q25ϸo9ms-7-%3CihO.J鯽-;MZM8ku-7k9S$8]q2E(}bۏI[DKOK}3KUB^u %Y,u.-&f#]'܆o$x`Yu,dzwM;#oKxn;\[d7}Rb+*Y䛂ZuBӱl{j0O̓}LhK;[aֶaGL{Cb#S.T[>߃F]NK"u^LUʐ_ykW?!GRj29͖qa'0[npcDvV)qz9R)PۨM^aJx W] r>];eN3vxdmĘ(5W2K1䪖weF{mE/QP6\u54x5[hۮ-Nk”i[lUgL]J}5 S:EhiUrgHl!ŒJ$pe=q^b͵Q' ?6|R\,JA ڵ"TDꈭ:ymg`B5t%M] <N_zv2_Ortٵ/i/ReӮ*7[qүqEG* m"[I:6e^p"I$jԴęh!m)]GZkcjS!{e^z}+Cѥ9;R|/ֱeiUԏCNu2Zhcٗg$ݭwvr P8*7/Lk~I'Km1+MW%Bk|oOm>-#qj*|Dbѱkn|n{v#jĮqNpMIUm(7Liz;{ҜݞڝVƚVϬ+sO!OstGvxӉ']uӎ4g_ 1^-8ۦ k!)Ύ5O;YSB#2Zzχ;<.ֵOtge~.(RC#wFZeGZٸ6FFJ4e2ˇpJT$[wgV)q6muDGJ56q\I!̗ y/I~RtJ9kJ]Iy*'FN0s.[l!fw'y(7$œ WƫgyΙdMEU JQJv̋vmrۖ.jWR_M֨djYgSj0^\y'EoECjm$ IƩK>Z28J2TiJ2N#}.s cArl嫶nB.FIJ.)۔\ZiM>/hLĸ=C1s[?YMqp|94- 鮝𦔽/k^#NT(Y LS$6˩}{;5 )B۷W$qpN)qqoot}ZDVә;7TiK|6f3h$dԄ}fqݡ>Nb򗉉+ͶO]>ߡ_VtYf79ڰիF sq~prս|QM)g%l0ocJȨHz V;Bb/kLAcfPJ,ԭ{ƍgpjNR6VSI*$!yV足jᇑ.](EܣqM\qJ2eZT).<9UB/(B0j)mtKEj#׿fDI-=rZړj|'Nڤ]k*i$5qt"ݙPM6E4ke^Z8ۏhz$Q(R Ay2zfRñnpnkbkI:=j &ΝșW?׵d{+ύM'??XqeeĽ.[o=UxFS=ӷdZwenՄ]_X=ĭVa* pKs0ބۍfJ3 gz̚i|wnxtjc¼5${(1fXQ65ȼb̶Zkn>%FQMJXӡ{TZEVNᖣimT/37cNJUPnP҂ZOE~"-Rc4^b- FEͧtf5[)S!OZIښݲ͑;tvܡ+N)AR=hCNn;wL16-:特7M$=Tҕ-.R[HٷnXk sn[ҞD-0WS9p9:-Ϸ-jѬNu{ҹfv)[Ľvwfg(ٷfe+0mYj8Q1\ݧg]Eǎvڿc!4#j5̋C2"}BRriFp7=ô\TZ:\BLfj#I22װ<;صZl j 6:l"6]۸ K'6RTѯ^ئOԓV\?$x7s#r:Oh{ց=MmuHԷd{pN /܅:UE#Yy+(SgQ(Щ)RHzw>^Ѿݻ>mK&^ '$Jۻ&w%F|xfz%˳ L~3N?Cy9 v w/{ƿ kz3x> sXv}vP"@WyC z`'톽Dw%-tt yVY\wmuPYQA0iG-2JP,6/gˢ]u.-n!Zw.N7Q]Df}Q0({a\@=i_X7gFǘ8^⻲}G MZ1)WEfO12G+=-B@z\`||w6ċj߬m}UwRox֢I &c~XGP6Qndpvܻul'V7^FJt^{b^B(L~sѣ6@߿^xqU!ڙ5|Vpvef-uӥ^3  FSDɯKD%0r}FF穛r7 +o"V8tv̖NQU!5uFd"bCr^bJ=֤fM#ʳԷP0O-9xRBm\=`r-:;~3Tl(nXtXi%2Vٛ#vwqƴ`L@"H‹qW.j,JM5B[)WܺUeZFqc'V˷1W7V̾-MHФwn8N;HPSdݷC7&2j.W\τGŎ'Vb]c.x+Rx1%C2T{myg[qU|+m:M:շ8҉yWd)ՋWS%%:iqlʹmGwݹ WnNŤѩ5(9hTٵDdGUi-)vSs2 2{OnT$Xck n:¶(lASLeȔBjμPpTb2~N2~%^k[ܗ[Jzs0ӓHBKq[}JَA-$dFQgjxxFv4r/x*Rm% `4J(&iv7SkԲmSH1YWmx 8n.k']:Z˭_W >ڃXЩ. jTq%Aā[E}amc]D:rmHRiu:uӚӢ\p(5-q%e)(۬ҖȽIf<߽pr&ݫVfY91q2ĭEQgYbTGQ&,yL+N$[q*RVۉQ=FuTܻ>f>f㋳8N6$܌n)9&»iˤsX,݅܍ȩv+sRTpO}d?Wn/Inpȸ%O]StQO|v5\}7Zwb.AIVK^:wb{[uݯcytO߶S<{8KSRׁH̏N7ۚ[xkwYy_'ZӵF+>쌛ZUĦreE9F[24De{}@:ExWs-\ǻ7K-\JNvEk%:s˙#κ].oͳ;լ7wB6nwu:$L; DkI#Wz.:Xp(˅v$Sq,wn\qIN-e<5Oe+vuYTpcojUI_ާP8 O 7&VL8z$_B-H-[uh]T{|8=qVRN-:Ij:7PUtXϷmy鉿:RIM~33ӸS2#׳GdŲ5+/Bx{(WzȨ5Y㞎#|˖+ ط.|e<o/rߔX>7s}VE.OVti׽ .5nNJO"95{#q}Ay9do]R"M6z\tnNS-D!@3N_jicWsy*5uٮRcWv/.,j}=S)j5C^> Ie =gu9ӛqjtz]۪TMoߧI!Ǧ¶m:,"[L!{qAv-o 3{"KʼnrIkfٶj2ƙ؄S`7` k6jzޞ?e5G&6uʷ2%ԒRKE*G\Npom F/V |C0.q_eenƣ<5Oh'67ɪn[SĽ{ڔjǘzs;~׌(ۂ`ܢ1ƣ` _l9Va6%UQWh~P~\F^ZHR@:ۧCJ{ôGeBh;~ۧnU J\O+n2 RҠ)ng}Kh{5+S×ܛ.1ZjG)iRȤIN 4%{oΜ/eO[Nffd ĹK?nnԼMqX'܌nZvq<ķbFnͪaQ`5 s,M_լ?-@_{w{ӺձJ}GF[%v\5[ŒGkOw/ΜM9rjË%2+rd~+󲕛C9U۳r[aJǭm|˒LAʨSCq[XMۺoubfp:t+ΤĻo ][ zt-*67kvS7D·MMCQXm;)܎n_h%]4ܙnRk!]ڵsDUF"`R, &#R_*[z*ZqFXɻ]7|۵w+'pFDەs=r./ᐚm3Hשy yD"jHCr':sA65نѮ^o1V/ f;nFr3VM)e*- s D'H݅fӧ\*޷[k<7u<-]֍Q8R h|p=WlW3s%Q %3l}@U-K6f-NϿu|ڴmWN׮[׸F*mW\%r! C78:޳vBG7ŵ.JթԚ2x)ST!řn~9 W:Wpܢ件{xf8ٳwKE ҰWxVB\qBZ 2wMb[lGSnyԚ~z9ZmያvoN2Afnݽjf>)j3 !;gOYʹK" Wftڎ+׭b*2ϻK>ۢӱeyԪXISUm[z+ugX%0lϏnvg!;t{BqPj>PyvR7Cj]O%+ݲ :qiMj6W}3vC/R=4Som]ŗ=ю, TF6U_-\6MyskwMr&Q\wjKܩyMϣUj0*}RZܷSdY3>Zjqj6TgzpA/M`/Cmл,޻feE[/+uk^Vs1W$G(JsW2ٰu*߻q*Y޵.Wi:ur5T),=0uRmho.twܖiYwrWHntvEj8qhf`Ͻpf(R&>Ki%I7$QӖm-2 ~yߗQ-앑/ x[k8nw.c㩵k}]FkbJl:{.(˩n0Hqvαp7 귎.Gupx[N`Yq'+ruU7[ү+>!xrȫoSo]OC# d^Q]\>!ƛGw^Mx"-+%vdX-:M2UR%d>%l ioSu6lsj7D P>XxHz Ukà(n^Q V>5cVtWj SEiJdznyej[lE' 3kuٌNn4JW)gB {4 j6&]' m-(ZMEz8cz>WZ6#7+[,MR-Z!4ܓtCyE|umj1ƽvƷV\;%>Q :#Le(iVz5 4ũۤUWxX ^(ҔsլB2w-V ^R+; ˂M\z+Uwr+RWY⺧~ Q*JcYSNSλUd8in=v K낫k\IRרSUaCFmϿ5̗P|u ZTԕ}>oYѲ1sfP+sQkX8Gb~6r,s>^\,mGL+7[n-E\.Fqḕcl*Jmjb5 ,m]c}NXfeVlǸJ5eˡ$4%g~N p4Y*WwW٧<8v#;qԩTut,m"#Y D\5V`\\Lȋ];LȇiS6ϝZ l>LruR\v=ǘϔDg=ԈdFZ+M{=|,[;0>RiSi4,S5}yxw&(E7&fݙ4UՕ! ~'Id)]ǽu2K-fޭ \08Vڅ쓬=Vy^^ IhyKR-B#Ըr=]mܻӾ'*Umkoy rTqT_i,/8Q^<ݤ|4ԻO(܄"'5N~#m.(Ҿ2i6Uev&I*<}҄$eNtÛzyWJubW^iBW.܅Wڮg]irO6Ve90sgv.+sV޿aޔ[p?3q*FutUo*eL\KM'EG*ZcAFfG5J 5jj=MJ3OK:k˝'NMB7m3uFҕ\-Ywg%PRqMIyZGY9|μvn߻5cWݷa^+X֥vnݘ\v7m>Fgzv"-;Ew֝}1|RjN𿊀7g#֟*GQQ|#/bo]p$>_Un9гUbn9׃ErQBU-^vDmVh'<R[fdHT]*~}3j;nvjc7s-rӳ Y8[n[1pJx kX[Jk9Mn!_Nю6x:iZ˦U |߉^Ԛ݃hYxk &U^bwKk.[jE+P(˞=9j@snCv7%c_7=xǁ<l {t'酚+1F‹l׭:ݻILruǶkL-L(K0L1&>wXB(pm;1fpnlp֓%Skidkt(U +xulo'/ڕeN r=^pZZ:Pnj8Hf"48ijY[ N[yZٻ+=  ø:3 ?^ܷ^Sr#YK[UF?CuhC b]GM')mڏsNrܗI]ljq6VB. W,UK"YX5{c >Iqā> T:n!,5l2VzCl|+I[*SrjnS6٨y+x,@>П.g+!rn9>N|W>OZT_ut Y""v7|sfި;Pclm EùN,{'fNT%U&LfH8~1v>Il}统u6P˗c(WV~H^bMU.o*oOF0N:_:6Smr_.b+|ݶYY غF,mwjv>f*>QM뭱Sd:`N{l/⎱;n-z~"Gze퇎J5S KG9!Gn;N1 ݎ h6m|S?ɂ5'WOÞ 7|7^ao @mxGmi^jϽ>01Mf0լD3-2T. VXR"ɥV Kl J O7|u?bvа;6.eߓ|[1bmRr,eRz`z 6܎-ͨku͹Fː dPhYgZUj}nvX;z=gVեTv_J }\1n7w2J?ޘγc\E 1Aޑzq;\r]]\Y&[nsNei\uURje*Qk2CSl*xJz-xٶlm+|UjUؓ`Ladqiĩ!Gd\W~fz;Tn*PdRM&T4`չSWq5k훶(N"Ӎ% V]֦wb.nUO!u*J&Oӕ2e|Z=eV쫚΅g#+/RW:طnbi*Wyo)p{:ETKؚR(RY+r웓r(IF) VmȵNB:h Q1ғ|u8E]{,'$-TR[j49l*3"I鯴zhd>Q+\BkNF=.$ZR4Nwհ(IpNi.(Gi33#33e$FXK*NdWrud[r{xnk$v2ıh+J1TQ[#JQl[tRO]LHKٮ NӍnF񨔤֞Em'MILB"ԋ%dBŋ+p̿_17jzT~4pc Vo\ƹb9Rq-'1j;8ܗ)hE%DZKS<璸Bu*%*Yw5ڻ9ۣ^z4U; Ñk\U(o~G?VUĎ:?P?_F_Kߤ~ᓾI |pr.Ok\SklRhҪz{­P .}SktZ7UQ4ڌIM8̈eaӊJZ%FFZu,KZvln廐SNFIVtuNi?CM5]+Ph,{jN JSR$IS^tSUVrORYu.9WyP6 [Kiu m!X|]Y79ӄ)\ģ)pbڳr%*&ꑶ_-H*dzk)1 V3')UAϹٶWRxe'պn۫h7AR9 EAJeGLms!%D| A 5]/Q3eb̄vnVn%za\m kZnv([emqrIҕij|""><hjJשvvǕ|Pޟs}V~2&Z?+2N&Z4w@)4iSڪ_>/JN9Hiۏuf8'It[ȲR.hZ$ȋ_Y ~U<UUO*6b)Ovzڜj\R̋.$FsQuҊj^נ䈈y<zZIuP[}Qm=C?zN(Exqu/kn S-FzKZzOסӽjJ\)F3b!r5ٝ|;6 o=-3*λ]αb\abqRi-w޵⦪~b8Kpo)Z=>)ғ"5/GTZLE-輵f7ݘ۹~+&+w/7GFI:l33fg.N~۲\2|*cnermnnM+Fq"ѪIz%j =YW8@~gc/~?N'?)«qȸs➟n=k" X“m֮VreMh2[uݖ] *FܖN)MȐ`f0 g,C9̑o;ddudJ=In13:ݒvvdMUEJLp^,6t-@͐9'{7m{-3,>hnF;ѰM)->>+Ěz!R* :`e--m7nB\u{b U>[8֪]6^ߤLʦ\DFNo$$dͶlgno8OrsQ\l̯hRo8tuNo+ CTxu!2[>ctFpeޓƻֶR"3QrQuOѳgwQr;S~)6HhZw/GgVTmUf_yt7%$];zLWF̰xy2Ʉu!MCmš_0[W6jf#a-KLi+3Q7c^qg%s<1aYIQeZf+}>;S6L0]Yu_h9߻<ƅpmiM$AVvŚ,*#t2.8Y)-Zhshü97/#Oro"u^/uFgWɺ,p:6a,^x%$Yve^3PƗMnTP&yS}OJ '덫MH^:rXԴJۋ/rI;S*,+yz1hv)Qw^ڍJ2oL׊q(\fDj:^T%vOadɂnS}ZO)N*λdaȜkG_PIEO}нa(^iQX᯦-7^)%g'SJx(.S9zVɴZ{E ))ۅi/s7 VIV-|sj0*UBTHIqRf>FP$KqN0 R̻8j\GcC}IUz\i 6F)Q{Gҧ3qSzKj-Az VЛS-zy:8*mNk|D鿓ND2u+0Yŝ7kqm·?8Ib]u>˗^_>(]vӋzv+ݩ){vZrJ2RQ몋C$z [,pp,8mڊbR]Il .f~d/ݓs㓓mͶ{mgjQwn=Oic9ܚm4Q/6ݨ[TƧ?nԶoytf{@AzT{e{[O'ZRZt~AGD?s3􌿂ՉIw'|~U\ w~di:Kޱ)U/sU%njѩ&GSP^ǝd)..!^U` 1wX[aԇSxoFV6_扐)T 2Mfd=ۖͭiZ7KK Bi9%7@<3<ճԻU,},a}FRqɛr i@ONJvK KLN M, ʖv0n-]DwlI-X6ܶ$Jʴh5O+mOI+Ra瞠\ MG7BفjYo1#͖0V`Ѱ2M?c8>-Crt*JkIGS:e#hPKx[鱼>{5m;wcն&>j-M֥^َ) 6yȜl_w{-ō̱r> U=]iw3)r*]:K]6BdCTZ|>gf}LW}[$'Y5 &c -j.z6R 67MԷFMnÌwI7w5E}o޽+K ֵy4܌ȥW"COyR[q5Ӱ͙f[v"_#q{MV6܍3"u9BK(41ӯqˇc${ߝCi6I(OmθzҜ5k^:>Jzw.>qV8{vU[ڶEm|DžBz].KHjI]x;Mɗ{m,qZXr忇2u^RO2Z}ZێS[2Jen!*NDcrBUً4<ǼMҲs1Zw57c3&ĖڻzmP*FuJG1-dN:|OU}ҵgi2t~F^^Z.VxjvŧnNNh<:]^~NN+ge^g.SԔGFe߯'[vn'(ScJ]kܗ7eJOlRrfziݮq̋S"\*U<*W]k$FջV}? 7g#֟*GQQ|#/bo]p$>_Un9;l S VvQU%OLU{οmU6bZ1MTx%!֙Q7, J=!3 ;Q,ڌ;6ͱ݅q^&ߔ·n #WbwӖX.HtG)N&d̵zpI,n cu ޖUj+VXUp[w]N o.J6Z8Ts&utxln;~HPHS/xw`G\ʡ¿rj Z^vt"[L:SD\h0sUwR,}[x^X,R2Vn< ]2YDr[SRKs8tXb̷G?Ps Tv 3be,zVz D[/I.KOEQrm'$7|[J>r S`5յwT#\w1FTz\Ԛ &"ׅhSHrD\'r]~/>p;:Piuu:"9ő=tTaS7V2rӷk7mb[^WmPp*[y.Þ6f]cizJCgRR@UVl큝.WJP1N{/\whZ ػϧӱE7|E֫Sί.x-Y&pi%v''-x6r'Ws*6=DwwUu]=C?MK [yrtܒG$!WGqJ*%SAz ED[^)/tė/g=#Omd.|^n/sl׉g DZqemqowݮRzUܜ=ڽ-o/Iۖ;qVʘgPp|mm;6zGl9.8pwWgsJ2qPbe}}UpNjٯ}7TMQKrؽtEx%v w߾8%|j;~|}pK]ơ/ w߾8%|j;~|}pK]ơ/ w&~e_H 8PL7:%ʭ5Kw&U2vwR_+rm'}C7#rWoO&HoG?M$UR7{FU]u ;# !Wk`|W>׹潇9Vn)6)*ҹ{%qV4q>W1vi#T"Qk&GwxcJBJ- Ϸ^ˁxkU}ԣ/3.;]J=<*)cS)ROK9H=,r zX @)cS)Da^ԽQ gxJI=w֣gf*TRj

Correspondence to Hae-Young Kim, DDS, PhD. Associate Professor, Department of Health Policy and Management, College of Health Science, and Department of Public Health Sciences, Graduate School, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul, Korea 136-701. TEL, +82-2-3290-5667; FAX, +82-2-940-2879; kimhaey@korea.ac.kr

©Copyrights 2015. The Korean Academy of Conservative Dentistry.

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

  • 7,032 Views
  • 97 Download
  • 125 Crossref
prev next
For comparison of three or more group means we apply the analysis of variance (ANOVA) method to decide if all means are equal or there is at least one mean which is different from others. If we get a significant result, we can conclude a global decision that there is difference in group means. However then we need to know what specific pairs of group means show differences and what pairs do not. The procedure is performed by post-hoc multiple comparison procedures.
Multiple comparisons are procedures of comparing many group means simultaneously. For an example, when we are interested in comparing means of A, B and C groups, we may consider performing a set of three comparisons as following:
Hypothesis 1: mean values of group A and group B are equal (comparison of A and B).
Hypothesis 2: mean values of group A and group C are equal (comparison of A and C).
Hypothesis 3: mean values of group B and group C are equal (comparison of B and C).
The set of comparisons is referred as a 'family of test'. The multiple comparison procedure that tests a set of hypotheses at the same time is also called a 'simultaneous test'. The most important issue in multiple comparisons is the control of type I error. Type I error is defined as the probability of committing error that a true null hypothesis is rejected. We call the type I error as α error. An α error level of 0.05 is frequently used for assessing a hypothesis. The overall error level for the family of tests is different from the α error level for a comparison (Table 1).
If the same α error level is adopted for each comparison (αPC) in multiple k comparisons, the overall α error level for the family of tests (αFW) is calculated as following procedure:
  1. Probability of no α error for a comparison = 1 - (probability of α error per comparison [αPC]

  2. Probability of no α error for overall family of k tests = (1 - αPC) × (1 - αPC) × … × (1 - αPC) = (1 - αPC)k, for comparisons independent of each other.

  3. Probability of α error for overall family of k independent tests (αFW) = 1 - (1 - αPC)k

For the example of family of independent three tests, if we set αPC at the conventional α error level 0.05, αFW is obtained as 1 - (1 - 0.05)3 = 1 - 0.8574 = 0.1426. The familywise α level is not only greater than the αPC but also greater than an acceptable α error level. If we want to control the below 5 percent (0.05), we need to reduce αPC to a certain degree. For example if we set αPC at 0.01, the αFW is calculated as 1 - (1 - 0.01)3 = 1 - 0.9703 = 0.0297, which is smaller than 0.05.
Many statisticians have devised various multiple comparison methods to correct the αFW within an acceptable level of 0.05. The methods can be categorized into three types according to the size and nature of family of tests, such as restricted sets of contrasts, pairwise comparisons, and post-hoc error correction. Table 2 shows the category and characteristics of various multiple comparison tests.
1. Restricted sets of contrasts
The multiple comparison methods in 'Restricted sets of contrasts' are appropriate for relatively small families of tests composed of less than ten tests (or contrasts) approximately. The results by the methods in the category can be somewhat conservative when applied for a large number of tests. Therefore before the test, the contrasts of specific interest should be chosen such as a set of planned comparisons or comparisons between a control group and other experimental groups.
Before introducing each specific method a brief overview of related terms in statistics may help.
  • - Liberal/conservative: 'Liberal' refers to a tendency that rejection of null hypothesis is relatively easy. A liberal test has a large power in accepting true alternative hypothesis. Contrarily, 'conservative' refers a relative difficulty in rejecting null hypothesis and possession of small power.

  • - Balanced design/unbalanced design: Balanced design refers a condition that all the compared groups have equal sample sizes; unbalanced design refers that the groups have unequal sample sizes.

  • - Single-step/step-down methods: A single step test refers a test which is implemented by a single test procedure; a step-down method refers a test which is performed according to repeated sequential steps. Generally while a single step test provides a confidence interval, a step-down method does not.

  • - Common step of step-down methods: At first step, all k means are tested at a αFW level considering comparison of k means. If the result is significant, then the following step starts; if insignificant, it stops. Next, each subset of k - 1 means is tested at an increased αFW level considering comparison of k - 1 means. Continue in this manner until no subsets remain to be tested.

1.1. Single step methods

1.1.1. The Bonferroni procedure

The Bonferroni correction of α error is a completely general method which is widely applicable to any sort of statistical procedures other than multiple comparisons following ANOVA. The α error for overall family of k independent tests (αFW) '1 - (1 - αPC)k' is the largest value among αFW of any set of tests including both independent and correlated tests. After some algebra the Bonferroni inequality for any set of tests is expressed as αFW < kαPC. Therefore, to control the αFW to be smaller than 0.05, we apply α error level for each comparison as αPC = αFW/k. For a family of three tests as the example above, we apply αPC=0.00530.0167rde-40-172-i003.jpg to control αFW as 0.05. The limitation of the Bonferroni procedure is that the result tends to be too conservative and do not have enough power when the set of tests is large.

1.1.2. The Šidák-Bonferroni procedure

The Šidák-Bonferroni procedure was developed to improve the power of tests because the Bonferroni procedure produces conservative results. The significance level per comparison is applied as αPC=1-1-αFW1krde-40-172-i004.jpg. For a family of three tests as the example above, we apply αPC=1-1-0.05131-0.9830=0.0170rde-40-172-i005.jpg to control αFW as 0.05. By applying a slightly higher αPC level, the result produces a less conservative result compared to the Bonferroni procedure. Let's consider an example of comparing three groups. We got a p-value 0.0168 for a comparison of two group means. If we apply the Bonferroni procedure, we conclude that difference between two group means is insignificant because the calculated p-value is over the level (αPC = 0.0167). However if we apply the Šidák-Bonferroni procedure, we reach the conclusion of a significant difference.

1.1.3. Dunnett's test

Specifically when one control group is being compared to all other experiment groups, the Dunnett's test is appropriate. In the situation the Dunnett's test shows a large power. The standard t which is uncorrected is used as a test statistic, and compared with the particular value of tDunnett that Charles Dunnett devised.

1.2. Step-down procedures

1.2.1. Holm-Bonferroni procedure

A step-down repeated test similar to the Bonferroni procedure is performed according to ordered p-value of each comparison. As the step progress, comparisons are assessed with successively increased α error levels. It shows more power compared to the Bonferroni procedure.

1.2.2. Shaffer's modified sequentially rejective Bonferroni procedure

It is a modification of Holm-Bonferroni procedure by partly adopting increased α error levels, having more power compared to the Holm-Bonferroni procedure.
2. Pairwise comparisons
The pairwise comparison is comparing all possible pairs of group means. If we want to compare all possible pairs from k groups, then the total number of comparisons is k(k - 1)/2. Following procedures are appropriate for all pairwise comparison and are expected to obtain reasonable results. Though it is possible to apply Bonferroni correction, overcorrected result is expected.

2.1. Single step methods

2.1.1. Tukey's honestly significant difference (HSD) procedure

Tukey's HSD procedure provides the simplest way to control αFW and is considered as the most preferable method when all pairwise comparisons are performed. The studentized range statistic (q statistic) is used to determine the critical values based on number of groups and number of observations in a group. As Tukey's HSD procedure assumes equal size of all compared groups, a modified Tukey-Kramer method can be applied for comparisons of unequal-sized groups.

2.2. Step-down procedure

2.2.1. Student-Newman-Keuls (SNK) procedure

The Student-Newman-Keuls (SNK) procedure is a step-down procedure which constructs equivalent subset similar to Tukey's procedure. The SNK procedure is following a very complex process. Though it shows an increased power, it often comes with an increased family-wise error level and may result in a too liberal tendency.

2.2.2. Duncan's multiple range test

The Duncan's multiple range test is performed using steps similar to SNK procedure. Changed α error levels are applied following the step-down procedure. It shows more liberal tendency than the SNK procedure. Generally Duncan's multiple range test is not recommended when sample sizes are unequal because of the liberal tendency.

2.2.3. Ryan-Einot-Gabriel-Walsch (REGW) procedure

The REGW procedure is a modification of SNK procedure by introducing more strict control of family-wise α error. The REGW procedure is considered to be recommendable because it shows not only good power and but also tight error control. The REGWF uses F statistic and REGWQ uses the studentized range statistic (q statistic).
3. Post-hoc error correction
The procedure in this category is performed as a completely post-hoc analysis after all planned comparisons are assessed. The procedure explores all possible complex relationships and applies with the most stringent error control.

3.1 Scheffé's procedure

The Scheffé's procedure comprises all possible contrasts not only paired comparisons. Its advantage is that it covers a broad range of complex tests including post-hoc relationships among many groups. The procedure tends to be too conservative and power is less than other methods. Generally Scheffé's procedure is not recommended when only pairwise comparisons are of interest.
4. No control of family-wise α error level

4.1. Least Significant Difference (LSD) test

The LSD method does not control family-wise α error level. Therefore it is inappropriate for multiple comparison procedure where the control of family-wise α error level is necessary.
In the choice of multiple comparison methods, it is important to consider the exact situation. The standard of choice is the ability to control family-wise α error level and the degree of power detecting significant difference.
  1. For usual post-hoc pairwise comparisons, Tukey's HSD procedure or REGWQ may be preferable.

  2. For comparisons of small number of group means or preplanned comparisons of selected groups, the Bonferroni procedure or Šidák-Bonferroni procedure may be preferable.

  3. When a control group is compared with other experimental groups, Dunnett's test may be of choice.

  4. If interested in a broad range of complex tests, Scheffé's procedure may be appropriate.

Note: For practical convenience, most statistical packages show adjusted p-values which are comparable with a conventional α error level instead of the reduced αPC. Clinical researchers may simply compare p-values provided by statistical packages with conventional α error level such as 0.05 and may make decisions comfortably.
  • 1. Keppel G, Wickens TD. Design and analysis: a researcher's handbook. 4th ed. New Jersey: Pearson Education Inc.; 2004. p. 111-130.
Table 1

Type I error rates according to the range of comparison

Category Definition
Type I error rate per comparison (αPC) Probability of incorrect rejection of true null hypothesis when a comparison is tested
Family-wise type I error rate (αFW) The probability of type I error occurs when a set (family) of tests is performed
Table 2

Category and characteristics of various multiple comparison tests

Category Usage Method Step Procedure
Restricted set of contrasts Appropriate for relatively small families of tests Bonferroni Single-step Adjust αPC = αFW / k
Holm-Bonferroni Step-down Repeated tests according to the p-values of comparisons and assess with increased α error level
Shaffer's modified sequentially rejective Bonferroni Step-down Modification of Holm-Bonferroni procedure.
More powerful.
Šidák-Bonferroni Single-step Adjust αPC = 1 - (1 - αFW)1/K
Šidák-Holm Step-down Step-down procedure of Šidák-Bonferroni
Dunnett's test Single-step Interested in comparison with control and other experimental groups
Pairwise comparison Perform all pairwise comparisons Tukey's honestly significance difference (HSD) Single-step Based on studentized range statistics (q statistics).
For unequal group size Tukey-Kramer method is applied.
Tukey's b Step-down Step-down procedure of Tukey method. Widely significance difference (WSD) method
Student-Newman-Keuls (SNK) procedure Step-down Step-down procedure of modified Tukey method.
Lower critical values are applied as steps repeated.
Very liberal.
Duncan's multiple range test Step-down Modified SNK method. Adjust significance level as steps repeated.
Hochberg's GF2 Single-step Similar to Tukey method but critical values are based on the studentized maximum modulus distribution. appropriate for balanced or unbalanced design
Gabriel Single-step Equivalent to GF2 test for balanced one-way ANOVA.
For unbalanced design, less conservative than GF2
Ryan-Einot-Gabriel-Walsch (REGW) Step-down Modification of the SNK procedure (more strict control of family-wise α error)
REGWF: based on F statistics (available only in SPSS)
REGWQ: based on q statistics (maximum range distribution)
Post-hoc error correction For a completely post-hoc analysis Scheffé Single-step Complex comparison
Most stringent error control
No control of error Inappropriate for control of family-wise error LSD (Least Significant Difference) Single-step No control of family-wise error

αPC, α error level per comparison; αFW, family-wise α error level; k, number of comparisons.

Tables & Figures

REFERENCES

    Citations

    Citations to this article as recorded by  
    • Inferential statistics for cardiothoracic surgeons: Part 3 - drawing valid conclusions from clinical data
      H. Shafeeq Ahmed
      Indian Journal of Thoracic and Cardiovascular Surgery.2025; 41(2): 233.     CrossRef
    • A user experience evaluation of a mobile application for disseminating site‐specific impact‐based flood warnings: The A4alerts app
      Erika R. Meléndez‐Landaverde, Daniel Sempere‐Torres
      Journal of Flood Risk Management.2025;[Epub]     CrossRef
    • Comparing eating and mealtime experiences in families of children with autism, attention deficit hyperactivity disorder and dual diagnosis
      Zoe Matthews, Donna Pigden-Bennett, Teresa Tavassoli, Sarah Snuggs
      Autism.2025; 29(2): 518.     CrossRef
    • The Distance Effect in Focus of Attention: Spatial or Temporal Distance?
      Yonjoong Ryuh, Cole Geschwender, Joonhee Kim, Kevin Becker
      Research Quarterly for Exercise and Sport.2025; 96(2): 401.     CrossRef
    • Coverage error and shade-match accuracy in three ceramic gingival systems
      Alejandra Díaz Hernández, Alicia Celemín Viñuela, Miguel Gómez-Polo, Ana María Martín Casado, Cristina Gómez-Polo
      The Journal of Prosthetic Dentistry.2025; 133(1): 264.     CrossRef
    • Hierarchical clustering of groups’ collaborative discourses during the computer-supported collaborative concept mapping process
      Fan Ouyang, Luyi Zheng, Xinyu Dai, Weiqi Xu, Pengcheng Jiao
      Educational technology research and development.2025; 73(1): 465.     CrossRef
    • A Preliminary Study of Brain Developmental Features of Bipolar Disorder Familial Risk and Subthreshold Symptoms
      Zhongwan Liu, Weicong Lu, Wenjin Zou, Yanling Gao, Xiaoyue Li, Guiyun Xu, Kwok-Fai So, Roger S. McIntyre, Kangguang Lin, Robin Shao
      Biological Psychiatry: Cognitive Neuroscience and Neuroimaging.2025; 10(7): 769.     CrossRef
    • Measuring Children’s Reward and Punishment Sensitivity: An Initial Psychometric Evaluation of the Contingency Response Rating Scale
      Daniel A. Waschbusch, Vanessa T. Cao, Delshad M. Shroff, Pevitr S. Bansal, Michael T. Willoughby
      Assessment.2025; 32(4): 561.     CrossRef
    • Corticosteroid Use in Randomized Clinical Trials of Biologics and Small Molecules in Inflammatory Bowel Disease: A Systematic Review
      Bruno César da Silva, Sam Papasotiriou, Stephen B Hanauer
      Inflammatory Bowel Diseases.2025; 31(5): 1430.     CrossRef
    • Insight on novel sulfamoylphenyl pyrazole derivatives as anticancer carbonic anhydrase inhibitors
      Rehab F. Ahmed, Walaa R. Mahmoud, Nagwa M. Abdelgawad, Amany Belal, Reem I. Alsantali, Mona F. Said
      Molecular Diversity.2025; 29(5): 4705.     CrossRef
    • From the Rust Belt to the Sun Belt: The Predictive Accuracy of the Arizona Youth Assessment System (AZYAS-Reentry) for Juveniles on Parole Supervision
      Deborah Kurth Jones, Michael D. Reisig
      Criminal Justice and Behavior.2025; 52(3): 391.     CrossRef
    • Transforming personalized weight forecasting: From the Personalized Metabolic Avatar to the Generalized Metabolic Avatar
      A. Abeltino, C. Serantoni, A. Riente, M. De Giulio, S. Capezzone, R. Esposito, M. De Spirito, G. Maulucci
      Computers in Biology and Medicine.2025; 188: 109879.     CrossRef
    • Selective Modulation of PAR-2-Driven Inflammatory Pathways by Oleocanthal: Attenuation of TNF-α and Calcium Dysregulation in Colorectal Cancer Models
      Rajashree Patnaik, Riah Lee Varghese, Yajnavalka Banerjee
      International Journal of Molecular Sciences.2025; 26(7): 2934.     CrossRef
    • Quantifying uncertainty in multi-scale energy analysis of residential archetypes: A stochastic occupancy approach
      Divyanshu Sood, Ibrahim Alhindawi, Usman Ali, Donal Finn, James A. McGrath, Miriam A. Byrne, Anna Mavrogianni, James O’Donnell
      Building and Environment.2025; 279: 113026.     CrossRef
    • Digital assessment of marginal gingival thickness after grafting with subepithelial connective tissue graft versus laser deepithelialized gingival graft in multiple RT2 gingival recession: a split-mouth randomized clinical trial
      Mohamed G. Akawy, Omnia A. Dahab, Marwa Hegab
      Tanta Dental Journal.2025; 22(1): 86.     CrossRef
    • Minority Stress, Resilience, and Trouble Falling Asleep Among Gender and Sexual Minority Adolescents
      Will J. Beischel, René‐Marc Lavigne, Alexa Martin‐Storey, Jean‐Pascal Lemelin, Ryan J. Watson
      Journal of Adolescence.2025; 97(6): 1581.     CrossRef
    • Protein function prediction using GO similarity-based heterogeneous network propagation
      Sai Hu, Bihai Zhao
      Scientific Reports.2025;[Epub]     CrossRef
    • Epexegesis to the Norwegian Orthopaedic Register
      Joshua Mallets, Tarun Goswami
      Advances in General Practice of Medicine.2025; 6(1): 134.     CrossRef
    • Bonferroni’s method, not Tukey’s, should be used to control the total number of false positives when making multiple pairwise comparisons in experiments with few replicates
      Adam Zweifach
      SLAS Discovery.2025; 35: 100253.     CrossRef
    • Smartphone accelerometer-measured physical activity and adiposity indicators among female university students
      Ahlam Saleh Alhajri
      DIGITAL HEALTH.2025;[Epub]     CrossRef
    • Learning Styles and Emotional Intelligence in University Students Studying Dentistry, Medicine and Pharmacy
      Cristina Gómez Polo, Javier Montero, María Portillo Muñoz, María Lobato, Beatriz Pardal, Álvaro Zubizarreta, Ana María Martín Casado
      European Journal of Dental Education.2025;[Epub]     CrossRef
    • Spatio-Temporal Assessment of Vegetation Dynamics in the Zouagha Forest, Northeastern Algeria (2000-2020)
      Norhane Chouiter, Maya Benoumeldjadj, Malika Rached-Kanouni
      Journal of Landscape Ecology.2025; 18(4): 129.     CrossRef
    • Curcumin Inhibits Protease Activated Receptor 2-Induced ERK Phosphorylation Calcium Mobilization and Anti-Apoptotic Signaling in Inflammation-Driven Colorectal Cancer Cells
      Rajashree Patnaik, Riah Varghese, Ahad Al-Kabani, Shirin Jannati, Yajnavalka Banerjee
      Cells.2025; 14(18): 1451.     CrossRef
    • Impact of Effective Probiotic Microorganisms (EPMs) on Growth Performance, Hematobiochemical Panel, Immuno-Antioxidant Status, and Gut Cultivable Microbiota in Striped Catfish (Pangasianodon hypophthalmus)
      Mahmoud Abdullah Elnakeeb, Ahmed Mohamed Ashry, Ahmed Mohamed El-Zayat, Abdel Wahab Abdel-Moez Abdel-Warith, Mahmoud Mohamed Habiba, Elsayed Mohamed Ibrahim Younis, Simon John Davies, Ibrahim Mohamed Ibrahim, Fatma Elzhraa, Ahmed Mohammed El-Sebaey
      Fishes.2025; 10(11): 573.     CrossRef
    • Street view search engine: A data-driven framework for urban imagery analysis and exploration
      Lan Ma, Xu Zhao, Xiwen Zhang, Mingzhen Lu, Chao Xie
      Building Simulation.2025;[Epub]     CrossRef
    • Seasonal Dynamics of Marine Habitats: Structuring Role in Biodiversity and Ecological Resilience of Wetlands in a Mediterranean Lagoon
      Zakariaa Saddiki, Mostafa Layachi, Mustapha Akodad, Bouchra Oujidi, Mourad Baghour, Jean-Etienne Le Guillou, Ali Skalli, Mohamed Maanan
      Wetlands.2025;[Epub]     CrossRef
    • Real-Time Implementation of Accelerated HCP-MMA for Deep Learning-Based ECG Arrhythmia Classification Using Contour-Based Visualization
      Basab Bijoy Purkayastha, Shovan Barma
      IEEE Journal of Biomedical and Health Informatics.2025; 29(11): 8112.     CrossRef
    • Network-based clustering and statistical evaluation to elucidate structure-activity relationships of EZH2 inhibitors
      Danishuddin, M.A. Haque, G. Madhukar, S. Khan, Q.M.S. Jamal, S. Srivastava, J.J. Kim, K. Ahmad
      SAR and QSAR in Environmental Research.2025; 36(9): 827.     CrossRef
    • Biomechanical comparison between rim plating and posterior buttress plating for posterolateral tibia plateau fractures
      Yong-Cheol Yoon, Youngwoo Kim, Chang-Soo Chon, Jae-Woo Cho, Chang-Wug Oh, Jong-Keon Oh
      Scientific Reports.2025;[Epub]     CrossRef
    • Physical Activity Levels and Barriers Among Young People with Mental Disorders: A Mixed Methods Analysis Supporting the Development of a National Sport Mental Health Clinic
      Daniel Vella Fondacaro, Paul Mansell, Michela Agius, Karl Apap Gatt, Nicole Borg, Roberto Galea, Catherine Gatt, Gertrude Fenech, Adrian Richard, Caroline Vassallo, Matthew Slater
      Sports.2025; 13(11): 399.     CrossRef
    • Distinguishing Fowler’s and Semi-Fowler’s Patient Postures Within Continuous-Wave Functional Near-Infrared Spectroscopy During Auditory Stimulus and Resting State
      Seth Bolton Crawford, Daniel X. Liu, Caroline Joyce Caveness, Rachel Eimen, Audrey K. Bowden
      Brain Sciences.2025; 15(11): 1172.     CrossRef
    • Do patients with renal calculi exhibit viscerosomatic reflexes as evident on CT imaging?
      Dillon R. Haughton, Akhil K. Gupta, Bader R. Nasir, Adrienne M. Kania
      Journal of Osteopathic Medicine.2025;[Epub]     CrossRef
    • Experimental investigation of the tensile properties of steel foam hollow sphere assemblies
      Thomas Kalpakoglou, Georgios Constantinides, Stylianos Yiatros
      Journal of Materials Research and Technology.2025; 39: 7588.     CrossRef
    • Promoting Sustainable Transportation: A Transtheoretical Examination of Active Transport Modes
      Tooba Batool, Veerle Ross, Jade Van Blerk, An Neven, Paul Dendale, Davy Janssens, Geert Wets, Kris Brijs
      Sustainability.2024; 16(2): 472.     CrossRef
    • Death competence profiles and influencing factors among novice oncology nurses: a latent profile analysis
      Qing Guo, Yanhui Wang, Ruishuang Zheng, Jun Wang, Ping Zhu, Li Wang, Fengqi Dong
      BMC Nursing.2024;[Epub]     CrossRef
    • Early-life exposure to mycotoxin zearalenone exacerbates aberrant immune response, oxidative stress, and mortality of Caenorhabditis elegans under pathogen Bacillus thuringiensis infection
      Chun Ming How, Yong-Shan Li, Wei-Yun Huang, Chia-Cheng Wei
      Ecotoxicology and Environmental Safety.2024; 272: 116085.     CrossRef
    • The impact of bottom water light exposure on electrical and sediment remediation performance of sediment microbial fuel cells
      Rashida Misali, Nurfarhana Nabila Mohd Noor, Nur Indradewi Oktavitri, Kyunghoi Kim
      Chemosphere.2024; 362: 142720.     CrossRef
    • Dietary effect of powdered herbal seeds on zootechnical performance, hemato-biochemical indices, immunological status, and intestinal microbiota of European sea bass (Dicentrarchus labrax)
      Ahmed M. Ashry, Mahmoud M. Habiba, Abdel-wahab A. Abdel-Warith, Elsayed M. Younis, Simon J. Davies, Mahmoud A. Elnakeeb, Mohamed F. Abdelghany, Ahmed M. El-Zayat, Ahmed M. El-Sebaey
      Aquaculture Reports.2024; 36: 102074.     CrossRef
    • Ambivalent Bias at Work: Managers’ Perceptions of Older Workers across Organizational Contexts
      Hila Axelrad, Alexandra Kalev, Noah Lewin-Epstein
      Work, Employment and Society.2024; 38(4): 1148.     CrossRef
    • Direct nitrous oxide emissions from a crop rotation of maize and mung bean after different long-term fertilizer applications in Thailand
      Patikorn Sriphirom, Amnat Chidthaisong, Kazuyuki Yagi, Wanida Nobuntou, Suphakarn Luanmanee, Nimaradee Boonapatcharoen, Wantanasak Suksong
      Field Crops Research.2024; 312: 109382.     CrossRef
    • Effect of dynamic taping on neck pain, disability, and quality of life in patients with chronic non-specific neck pain: a randomized sham-control trial
      Mohammad Sidiq, Aksh Chahal, Balamurugan Janakiraman, Faizan Kashoo, Sharad Kumar Kedia, Neha Kashyap, Richa Hirendra Rai, Neha Vyas, T.S. Veeragoudhaman, Krishna Reddy Vajrala, Megha Yadav, Shahiduz Zafar, Sanghamitra Jena, Monika Sharma, Shashank Baranw
      PeerJ.2024; 12: e16799.     CrossRef
    • From trials to statistical insights: Bortezomib's story in childhood T‐cell lymphoid malignancies
      Shyam Srinivasan
      Hematological Oncology.2024;[Epub]     CrossRef
    • Effects of one-week bilateral cerebellar iTBS on resting-state functional brain network and multi-task attentional performance in healthy individuals: A randomized, sham-controlled trial
      Meiliang Liu, Chao Yu, Jinping Shi, Yunfang Xu, Zijin Li, Junhao Huang, Zhengye Si, Li Yao, Kuiying Yin, Zhiwen Zhao
      NeuroImage.2024; 295: 120648.     CrossRef
    • Paleoenvironment and paleoecology associated with the early phases of the Great American Biotic Interchange based on stable isotope analysis of fossil mammals and new U–Pb ages from the Pampas of Argentina
      Dánae Sanz-Pérez, Claudia I. Montalvo, Adriana E. Mehl, Rodrigo L. Tomassini, Manuel Hernández Fernández, Laura Domingo
      Palaeogeography, Palaeoclimatology, Palaeoecology.2024; 634: 111917.     CrossRef
    • Role of Branched and Aromatic Amino Acids, Diet Inflammatory Index, and Anthropometric Indices on Mental Health
      Golnaz Majdizadeh, Mina Beytollahi, Abolghasem Djazayery, Ariyo Movahedi
      International Journal of Preventive Medicine.2024;[Epub]     CrossRef
    • Emotional Intelligence and Personality Traits of University Students in Dentistry, Medicine and Pharmacy Degrees
      Cristina Gómez-Polo, Javier Montero, María Portillo Muñoz, Maria Lobato Carreño, Beatriz Pardal-Peláez, Álvaro Zubizarreta-Macho, Ana María Martín Casado
      European Journal of Investigation in Health, Psychology and Education.2024; 14(6): 1757.     CrossRef
    • Effects of 12 weeks of head-down strong abdominal breathing on motor and cognitive performance during dual-tasking in patients with chronic obstructive pulmonary disease: Study protocol for a randomised controlled trial
      Kexin Ding, Feiyun Song, Wei Qi, Hongrui Liu, Mingyun Sun, Rui Xia
      Heliyon.2024; 10(14): e34255.     CrossRef
    • Post-hoc tests in one-way ANOVA: The case for normal distribution
      Joel Juarros-Basterretxea, Gema Aonso-Diego, Álvaro Postigo, Pelayo Montes-Álvarez, Álvaro Menéndez-Aller, Eduardo García-Cueto
      Methodology.2024; 20(2): 84.     CrossRef
    • Data-driven evolution of water quality models: An in-depth investigation of innovative outlier detection approaches-A case study of Irish Water Quality Index (IEWQI) model
      Md Galal Uddin, Azizur Rahman, Firouzeh Rosa Taghikhah, Agnieszka I. Olbert
      Water Research.2024; 255: 121499.     CrossRef
    • Assessing the Impact of UAV Flight Altitudes on the Accuracy of Multispectral Indices
      Zoran Stamenković, Krstan Kešelj, Marko Kostić, Vladimir Aćin, Dragana Tekić, Mladen Ivanišević, Tihomir Novaković
      Contemporary Agriculture.2024; 73(3-4): 157.     CrossRef
    • Association between expiratory mouth pressure and abdominal muscle activity in healthy young males
      Kentaro Chino, Toshiyuki Ohya, Yasuhiro Suzuki
      European Journal of Applied Physiology.2024; 124(7): 2139.     CrossRef
    • Rickets, resorption and revolution: An investigation into the relationship between vitamin D deficiency in childhood and osteoporosis in adulthood in an 18th-19th century population
      Alexandra Bowers, Rebecca Gowland, Karen Hind
      International Journal of Paleopathology.2024; 47: 27.     CrossRef
    • Short-Term Hydrolytic Degradation of Mechanical Properties of Absorbable Surgical Sutures: A Comparative Study
      Jakub Szabelski, Robert Karpiński
      Journal of Functional Biomaterials.2024; 15(9): 273.     CrossRef
    • NEEDS ANALYSIS FOR DESIGNING AND DEVELOPING AN EFL TEACHING-SPEAKING MODULE FOR THE UNIQUE LINGUISTIC TAPESTRY OF CHINESE BUSINESS ENGLISH UNDERGRADUATES
      Ke Hu, Asmaa AlSaqqaf
      Problems of Education in the 21st Century.2024; 82(4): 456.     CrossRef
    • Transcriptional analysis of C. elegans fmos at different life stages and their roles in ageing
      Mohamed Said, Bill T. Ferrara, Andreea Aprodu, Filipe Cabreiro, Elinor P. Thompson, Jeremy Everett
      Molecular Genetics and Genomics.2024;[Epub]     CrossRef
    • Input modality matters: A comparison of touch, speech, and gesture based in-vehicle interaction
      Tingru Zhang, Xing Liu, Weisheng Zeng, Da Tao, Guofa Li, Xingda Qu
      Applied Ergonomics.2023; 108: 103958.     CrossRef
    • Drought-Alleviating Effects of Endophytic Bacteria Isolated from Xerophytic Plants on Capsicum annuum L. Seedlings
      Silju Juby, Radhakrishnan Edayileveetil Krishnankutty, Jayachandran Kochupurakkal
      Current Microbiology.2023;[Epub]     CrossRef
    • Effect of Two Years of Doxycycline Treatment on Infrarenal Aortic Neck Diameter
      Annalise M. Panthofer, Sydney L. Olson, Brooks L. Rademacher, Larry W. Kraiss, William C. Blackwelder, B. Timothy Baxter, Jason N. MacTaggart, Barry T. Katzen, Scott S. Berman, Jon S. Matsumura
      EJVES Vascular Forum.2023; 59: 43.     CrossRef
    • The impact of self-efficacy on the well-being of primary school teachers: a Greek-Cypriot study
      Glykeria Reppa, Marilena Mousoulidou, Eirini Tzovla, Christiana Koundourou, Andri Christodoulou
      Frontiers in Psychology.2023;[Epub]     CrossRef
    • Personalized digital behaviour interventions increase short-term physical activity: a randomized control crossover trial substudy of the MyHeart Counts Cardiovascular Health Study
      Ali Javed, Daniel Seung Kim, Steven G Hershman, Anna Shcherbina, Anders Johnson, Alexander Tolas, Jack W O’Sullivan, Michael V McConnell, Laura Lazzeroni, Abby C King, Jeffrey W Christle, Marily Oppezzo, C Mikael Mattsson, Robert A Harrington, Matthew T W
      European Heart Journal - Digital Health.2023; 4(5): 411.     CrossRef
    • Prompted hands-free drinking improves simulated race car driving in a hot environment
      David P. Ferguson, Paul R. Alex, Julia M. Castrucci, Annabella M. Akouri, Gabriella R. Januszewski, Jacob D. Danes, Faith L. Houck
      Journal of Sports Sciences.2023; 41(11): 1093.     CrossRef
    • Are gains in emotional symptoms and emotion-regulation competencies after the REThink therapeutic game maintained in the long run? A 6-month follow-up
      Oana A. David, Liviu A. Fodor
      European Child & Adolescent Psychiatry.2023; 32(10): 1853.     CrossRef
    • Chemical, Physical, and Technological Characteristics of Palm Olein and Canola Oil Blends
      Ayman Younes Allam, Zakir Showkat Khan, Mohmad Sayeed Bhat, Bindu Naik, Sajad Ahmad Wani, Sarvesh Rustagi, Tahmeed Aijaz, Mohamed Farouk Elsadek, Tse-Wei Chen, Walid Elfalleh
      Journal of Food Quality.2023; 2023: 1.     CrossRef
    • Automatic music signal mixing system based on one-dimensional Wave-U-Net autoencoders
      Damian Koszewski, Thomas Görne, Grazina Korvel, Bozena Kostek
      EURASIP Journal on Audio, Speech, and Music Processing.2023;[Epub]     CrossRef
    • Exploring novel anticancer pyrazole benzenesulfonamides featuring tail approach strategy as carbonic anhydrase inhibitors
      Rehab F. Ahmed, Walaa R. Mahmoud, Nagwa M. Abdelgawad, Marwa A. Fouad, Mona F. Said
      European Journal of Medicinal Chemistry.2023; 261: 115805.     CrossRef
    • In the Arms of a Robot: Designing Autonomous Hugging Robots with Intra-Hug Gestures
      Alexis E. Block, Hasti Seifi, Otmar Hilliges, Roger Gassert, Katherine J. Kuchenbecker
      ACM Transactions on Human-Robot Interaction.2023; 12(2): 1.     CrossRef
    • Concerning Trends in Likert Scale Usage in Human-robot Interaction: Towards Improving Best Practices
      Mariah Schrum, Muyleng Ghuy, Erin Hedlund-botti, Manisha Natarajan, Michael Johnson, Matthew Gombolay
      ACM Transactions on Human-Robot Interaction.2023; 12(3): 1.     CrossRef
    • Cluster analysis of negative symptoms identifies distinct negative symptom subgroups
      Nina B. Paul, Gregory P. Strauss, Jessica J. Woodyatt, Michelle G. Paul, Jennifer R. Keene, Daniel N. Allen
      Schizophrenia Research.2022; 246: 207.     CrossRef
    • Comparison of the Effects of Kinesio Taping Versus Dry Needling on Pain Intensity, Shoulder range of Motion, and upper Limb Function in Patients with Myofascial Pain Syndrome in the Trapezius Muscle: A Randomized Controlled Trial
      Abdurrahim Yildiz, Rustem Mustafaoglu, Sensu Dincer, Omer Batın Gozubuyuk, Gokhan Metin
      Medical Bulletin of Haseki.2022; 60(5): 398.     CrossRef
    • Highly efficient and precise two-step cell selection method for tetramethylenedisulfotetramine-specific monoclonal antibody production
      Yuan Li, Ling Yang, Wenbo Yu, Xuezhi Yu, Kai Wen, Bing Shao, Jiefang Sun, Jianzhong Shen, Zhanhui Wang
      Journal of Hazardous Materials.2022; 424: 127689.     CrossRef
    • Artificial intelligence in Emergency Medical Services dispatching: assessing the potential impact of an automatic speech recognition software on stroke detection taking the Capital Region of Denmark as case in point
      Mirjam Lisa Scholz, Helle Collatz-Christensen, Stig Nikolaj Fasmer Blomberg, Simone Boebel, Jeske Verhoeven, Thomas Krafft
      Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine.2022;[Epub]     CrossRef
    • Comparison of Tensile Properties and Knot Security of Surgical Sutures: An In Vitro Mechanical Study
      Muyao Wang, Xu Xiang, Yuxia Wang, Yuanlin Ren, Li Yang, Yan Zhang
      Journal of Oral and Maxillofacial Surgery.2022; 80(7): 1215.     CrossRef
    • Distribution of chigger mites (Acari: Trombiculidae) over hosts, parasitopes, collection localities, and seasons in northern Iran
      Alexandr A. Stekolnikov, Mohsen Shamsi, Alireza Saboori, Azadeh Zahedi Golpayegani, Masoud Hakimitabar
      Experimental and Applied Acarology.2022; 86(1): 21.     CrossRef
    • Prevalence of Anxiety and Depression in Patients With Primary Glaucoma in Western India
      Ashutosh Dayal, Kalyani V.K. Sodimalla, Vidya Chelerkar, Madan Deshpande
      Journal of Glaucoma.2022; 31(1): 37.     CrossRef
    • Geomorphic controls on shallow groundwater arsenic contamination in Bengal basin, India
      Ayan Das, Sandip Mondal
      Environmental Science and Pollution Research.2021; 28(31): 42177.     CrossRef
    • Sleep during infancy, inhibitory control and working memory in toddlers: findings from the FinnBrain cohort study
      Isabel Morales-Muñoz, Saara Nolvi, Tiina Mäkelä, Eeva Eskola, Riikka Korja, Michelle Fernandes, Hasse Karlsson, E. Juulia Paavonen, Linnea Karlsson
      Sleep Science and Practice.2021;[Epub]     CrossRef
    • Does an Audiovisual Dissection Manual Improve Medical Students' Learning in the Gross Anatomy Dissection Course?
      Christian F. A. Koop, Michael Marschollek, Andreas Schmiedl, Phileas J. Proskynitopoulos, Marianne Behrends
      Anatomical Sciences Education.2021; 14(5): 615.     CrossRef
    • TreeMap: a structured approach to fine mapping of eQTL variants
      Li Liu, Pramod Chandrashekar, Biao Zeng, Maxwell D Sanderford, Sudhir Kumar, Greg Gibson, Schwartz Russell
      Bioinformatics.2021; 37(8): 1125.     CrossRef
    • Dietary Arginine Supplementation during Gestation and Lactation Increases Milk Yield and Mammary Lipogenesis in Rats
      Thomas Sevrin, Charlène Sirvins, Agnès David, Audrey Aguesse, Alexis Gandon, Blandine Castellano, Dominique Darmaun, Clair-Yves Boquien, Marie-Cécile Alexandre-Gouabau
      The Journal of Nutrition.2021; 151(8): 2188.     CrossRef
    • Influence of basin-wide geomorphology on arsenic distribution in Nadia district
      Ayan Das, Santanu Majumder, Sandipan Barman, Debashis Chatterjee, Sutapa Mukhopadhyay, Pinaki Ghosh, Chandra Nath Pal, Gopinath Saha
      Environmental Research.2021; 192: 110314.     CrossRef
    • Effects of soy isoflavone on cardiac dysfunction in geripause-like rats
      Nashwa M. Saied, Marwa M. Abd-Rabo
      Egyptian Pharmaceutical Journal.2021; 20(3): 232.     CrossRef
    • TAGUCHI-BASED OPTIMIZATION OF HEAD AND NECK CT ANGIOGRAPHY: IN-VIVO ENHANCED TRIGGERED TIMING FOR 600 PATIENTS
      CHIH-SHENG LIN, YUNG-FU CHEN, JIE DENG, DENG-HO YANG, MING-HSIANG CHEN, YA-HUI LIN, LUNG-KWANG PAN
      Journal of Mechanics in Medicine and Biology.2021;[Epub]     CrossRef
    • Evaluation of Non-Uniform Image Quality Caused by Anode Heel Effect in Digital Radiography Using Mutual Information
      Ming-Chung Chou
      Entropy.2021; 23(5): 525.     CrossRef
    • Multivariate analysis of variance: An advanced chemometric approach to differentiate dose‐dependent antioxidant activities of grape ( Vitis labruscana ) skin extracts
      Kandi Sridhar, Albert Linton Charles
      Journal of Food Processing and Preservation.2021;[Epub]     CrossRef
    • A case for measuring negative willingness to pay for consumer goods
      Daniel A. Bass, Brandon R. McFadden, Kent D. Messer
      Food Policy.2021; 104: 102126.     CrossRef
    • The Impact of Roads on the Redistribution of Plants and Associated Arthropods in a Hyper-Arid Ecosystem
      Shahar Cohen, Elli Groner, Aviva Peeters, Michal Segoli, Phyllis Weintraub
      Journal of Insect Science.2021;[Epub]     CrossRef
    • Performance evaluation of pipelines for mapping, variant calling and interval padding, for the analysis of NGS germline panels
      Maria Zanti, Kyriaki Michailidou, Maria A. Loizidou, Christina Machattou, Panagiota Pirpa, Kyproula Christodoulou, George M. Spyrou, Kyriacos Kyriacou, Andreas Hadjisavvas
      BMC Bioinformatics.2021;[Epub]     CrossRef
    • Potential of rosmarinic acid to ameliorate toxic effects of diethyl methoxy thio‑phosphoryl thio‑succinate on albino wistar rats’ lung, mast cell infiltration inhibitory pathway
      Ahmed S. Ahmed, Marwa M. Mona, Mona A. Abdel‑Kareem, Rasha A. Elsisy
      Food Science & Nutrition.2021; 9(7): 3593.     CrossRef
    • Optimizing the Synergistic Effects of Cannabidiol and Δ9-Tetrahydrocannabinol for the Treatment of Neuropathic Pain in Mouse Behavioural Models
      Fang-Chi Chang, Philip Q. Ding, Stephanie Tam, Lauren R. Xu
      Undergraduate Research in Natural and Clinical Science and Technology (URNCST) Journal.2020; 4(6): 1.     CrossRef
    • Distribution of arsenic, silver, cadmium, lead and other trace elements in water, sediment and macrophytes in the Kenyan part of Lake Victoria: spatial, temporal and bioindicative aspects
      James Omondi Outa, Chrispin O. Kowenje, Christof Plessl, Franz Jirsa
      Environmental Science and Pollution Research.2020; 27(2): 1485.     CrossRef
    • Active and passive work breaks during simulated laparoscopy among laparoscopic surgeons: study protocol for a controlled, randomised cross-over laboratory trial
      Tessy Luger, Monika A Rieger, Rosina Bonsch, Bernhard Krämer, Robert Seibt, Benjamin Steinhilber
      BMJ Open.2020; 10(11): e038952.     CrossRef
    • Trace Elements in Crustaceans, Mollusks and Fish in the Kenyan Part of Lake Victoria: Bioaccumulation, Bioindication and Health Risk Analysis
      James Omondi Outa, Chrispin O. Kowenje, Annemariè Avenant-Oldewage, Franz Jirsa
      Archives of Environmental Contamination and Toxicology.2020; 78(4): 589.     CrossRef
    • Does robot-assisted gait training improve mobility, activities of daily living and quality of life in stroke? A single-blinded, randomized controlled trial
      Rustem Mustafaoglu, Belgin Erhan, Ipek Yeldan, Berrin Gunduz, Ela Tarakci
      Acta Neurologica Belgica.2020; 120(2): 335.     CrossRef
    • Response to Hypoxic Preconditioning of Glial Cells from the Roof of the Fourth Ventricle
      Marymar Becerra-González, Ragu Varman Durairaj, Aline Ostos Valverde, Emilio J. Gualda, Pablo Loza-Alvarez, Wendy Portillo Martínez, Gabriela Berenice Gómez-González, Annalisa Buffo, Ataúlfo Martínez-Torres
      Neuroscience.2020; 439: 211.     CrossRef
    • Fenugreek Stimulates the Expression of Genes Involved in Milk Synthesis and Milk Flow through Modulation of Insulin/GH/IGF-1 Axis and Oxytocin Secretion
      Thomas Sevrin, Clair-Yves Boquien, Alexis Gandon, Isabelle Grit, Pierre de Coppet, Dominique Darmaun, Marie-Cécile Alexandre-Gouabau
      Genes.2020; 11(10): 1208.     CrossRef
    • Anti-inflammatory potential of the aqueous extract of Cyamopsis tetragonoloba against the MSU-induced arthritis in female Wistar albino rats
      Jerine Peter Simon, Ram Kumar Katturaja, Arunraj Namachivayan, Sangeetha Nithyanandham, Manisha Parthasarathy, Sabina Evan Prince
      Asia Pacific Journal of Molecular Biology and Biotechnology.2020; : 1.     CrossRef
    • Apolipoprotein E regulates the maturation of injury-induced adult-born hippocampal neurons following traumatic brain injury
      Yacine Tensaouti, Tzong-Shiue Yu, Steven G. Kernie, Stephen D. Ginsberg
      PLOS ONE.2020; 15(3): e0229240.     CrossRef
    • The Relationship Between Student Teachers’ Career Choice Motives and Stress-Inducing Thoughts: A Tentative Cross-Cultural Model
      Teresa Tillmann, Sabine Weiß, Jonas Scharfenberg, Ewald Kiel, Manuela Keller-Schneider, Meeri Hellsten
      Sage Open.2020;[Epub]     CrossRef
    • Therapeutic management of adults with atopic dermatitis: comparison with psoriasis and chronic urticaria
      C. Pascal, D. Maucort‐Boulch, S. Gilibert, D. Bottigioli, V. Verdu, C. Jaulent, F. Hacard, F. Bérard, J.‐F. Nicolas, A. Nosbaum
      Journal of the European Academy of Dermatology and Venereology.2020; 34(10): 2339.     CrossRef
    • Localization of Brain Networks Engaged by the Sustained Attention to Response Task Provides Quantitative Markers of Executive Impairment in Amyotrophic Lateral Sclerosis
      Roisin McMackin, Stefan Dukic, Emmet Costello, Marta Pinto-Grau, Antonio Fasano, Teresa Buxo, Mark Heverin, Richard Reilly, Muthuraman Muthuraman, Niall Pender, Orla Hardiman, Bahman Nasseroleslami
      Cerebral Cortex.2020; 30(9): 4834.     CrossRef
    • Evidence‐based statistical analysis and methods in biomedical research (SAMBR) checklists according to design features
      Alok Kumar Dwivedi, Rakesh Shukla
      Cancer Reports.2020;[Epub]     CrossRef
    • The association of prenatal folate and vitamin B12 levels with postnatal neurodevelopment varies by maternal MTHFR 677C>T genotype
      Giovanna Gatica-Domínguez, Stephen J. Rothenberg, Luisa Torres-Sánchez, Lourdes Schnaas, Aryeh D. Stein, Rebecca J. Schmidt, Lizbeth López-Carrillo
      International Journal of Behavioral Development.2020; 44(2): 127.     CrossRef
    • Assessment of psychosocial impact of primary glaucoma and its effect on quality of life of patients in Western India
      VK S Kalyani, Ashutosh Dayal, Vidya Chelerkar, Madan Deshpande, Anwesha Chakma
      Indian Journal of Ophthalmology.2020; 68(11): 2435.     CrossRef
    • The effect of digital physical activity interventions on daily step count: a randomised controlled crossover substudy of the MyHeart Counts Cardiovascular Health Study
      Anna Shcherbina, Steven G Hershman, Laura Lazzeroni, Abby C King, Jack W O'Sullivan, Eric Hekler, Yasbanoo Moayedi, Aleksandra Pavlovic, Daryl Waggott, Abhinav Sharma, Alan Yeung, Jeffrey W Christle, Matthew T Wheeler, Michael V McConnell, Robert A Harrin
      The Lancet Digital Health.2019; 1(7): e344.     CrossRef
    • Rutin and orlistat produce antitumor effects via antioxidant and apoptotic actions
      Amira Saleh, Hassan M. ElFayoumi, Mahmoud Youns, Waleed Barakat
      Naunyn-Schmiedeberg's Archives of Pharmacology.2019; 392(2): 165.     CrossRef
    • The relationship between students’ perception of the educational environment and their subjective happiness
      Dong-Mi Yoo, Do-Hwan Kim
      BMC Medical Education.2019;[Epub]     CrossRef
    • Glycocalyx Breakdown Is Associated With Severe Disease and Fatal Outcome in Plasmodium falciparum Malaria
      Tsin W Yeo, J Brice Weinberg, Daniel A Lampah, Enny Kenangalem, Peggy Bush, Youwei Chen, Richard N Price, Sarah Young, Hao Y Zhang, David Millington, Donald L Granger, Nicholas M Anstey
      Clinical Infectious Diseases.2019; 69(10): 1712.     CrossRef
    • A day in the life of mitochondria reveals shifting workloads
      Tobias W. Weinrich, Jaimie Hoh Kam, Bill T. Ferrara, Elinor P. Thompson, John Mitrofanis, Glen Jeffery
      Scientific Reports.2019;[Epub]     CrossRef
    • Isolated, small, and large hospitals have fewer nursing resources than urban hospitals: Implications for rural health policy
      Jessica G. Smith, Colin M. Plover, Moira C. McChesney, Eileen T. Lake
      Public Health Nursing.2019; 36(4): 469.     CrossRef
    • Comparative Effect of Two Problem-solving Instructional Strategies on Students’ Achievement in Stoichiometry
      Shadreck Mandina, Chukunoye Ochonogor
      EURASIA Journal of Mathematics, Science and Technology Education.2018;[Epub]     CrossRef
    • The exposure to water with cigarette residue changes the anti-predator response in female Swiss albino mice
      Letícia Silva Cardoso, Fernanda Neves Estrela, Thales Quintão Chagas, Wellington Alves Mizael da Silva, Denys Ribeiro de Oliveira Costa, Igor Pereira, Boniek Gontijo Vaz, Aline Sueli de Lima Rodrigues, Guilherme Malafaia
      Environmental Science and Pollution Research.2018; 25(9): 8592.     CrossRef
    • Insights about the toxic effects of tannery effluent on Lithobates catesbeianus tadpoles
      Diogo Ferreira do Amaral, Mateus Flores Montalvão, Bruna de Oliveira Mendes, Joyce Moreira de Souza, Thales Quintão Chagas, Aline Sueli de Lima Rodrigues, Guilherme Malafaia
      Science of The Total Environment.2018; 621: 791.     CrossRef
    • Age-related changes in upper limb motion during typical development
      Cristina Simon-Martinez, Gabriela Lopes dos Santos, Ellen Jaspers, Ruth Vanderschueren, Lisa Mailleux, Katrijn Klingels, Els Ortibus, Kaat Desloovere, Hilde Feys, Tiago M Barbosa
      PLOS ONE.2018; 13(6): e0198524.     CrossRef
    • Genetic polymorphisms in bone morphogenetic protein receptor type IA gene predisposes individuals to ossification of the posterior longitudinal ligament of the cervical spine via the smad signaling pathway
      Hao Wang, Weitao Jin, Haibin Li
      BMC Musculoskeletal Disorders.2018;[Epub]     CrossRef
    • Physical activity is associated with higher sleep efficiency in the general population: the CoLaus study
      Cédric Gubelmann, Raphael Heinzer, José Haba-Rubio, Peter Vollenweider, Pedro Marques-Vidal
      Sleep.2018;[Epub]     CrossRef
    • Psychometric properties of the Italian version of the Cognitive Reserve Scale (I-CRS)
      Manuela Altieri, Mattia Siciliano, Simona Pappacena, María Dolores Roldán-Tapia, Luigi Trojano, Gabriella Santangelo
      Neurological Sciences.2018; 39(8): 1383.     CrossRef
    • Cloning and Expression Analysis of HbPR-1b and HbPR-3 in Hevea brasiliensis During Inoculation with Rigidoporus microporus
      Natthakorn Woraathasi, Korakot Nakkanong, Charassri Nualsri
      Pakistan Journal of Biological Sciences.2017; 20(5): 233.     CrossRef
    • Are the Outcomes of Revision Knee Arthroplasty for Flexion Instability the Same as for Other Major Failure Mechanisms?
      Ashok Rajgopal, Taufiq R. Panjwani, Arun Rao, Vivek Dahiya
      The Journal of Arthroplasty.2017; 32(10): 3093.     CrossRef
    • The anatomy of an article
      Angela Sauaia, Ernest Eugene Moore, Jennifer Crebs, Ronald Maier, David B. Hoyt, Steven R. Shackford
      Journal of Trauma and Acute Care Surgery.2017; 83(3): 543.     CrossRef
    • Cell density modulates intracellular mass transport in neural networks
      Patricia Cintora, Jyothi Arikkath, Mikhail Kandel, Gabriel Popescu, Catherine Best‐Popescu
      Cytometry Part A.2017; 91(5): 503.     CrossRef
    • Clonal integration facilitates spread of Paspalum paspaloides from terrestrial to cadmium‐contaminated aquatic habitats
      F.‐L. Luo, Y.‐P. Xing, G.‐W. Wei, C.‐Y. Li, F.‐H. Yu, Z.‐B. Luo
      Plant Biology.2017; 19(6): 859.     CrossRef
    • Effects of Leaf Extracts of Ocimum gratissimum L. on Quality of Fresh Cut Cucumis sativus L.
      Oluwagbenga Oluwasola , Alfred Maroyi, Anthony Jide Afola
      Asian Journal of Plant Pathology.2017; 11(4): 174.     CrossRef
    • Associations of age, aerobic fitness, and body mass index with injury in an operational Army brigade
      Catherine Rappole, Tyson Grier, Morgan K. Anderson, Veronique Hauschild, Bruce H. Jones
      Journal of Science and Medicine in Sport.2017; 20: S45.     CrossRef
    • M2 macrophages induce ovarian cancer cell proliferation via a heparin binding epidermal growth factor/matrix metalloproteinase 9 intercellular feedback loop
      Molly J. Carroll, Arvinder Kapur, Mildred Felder, Manish S. Patankar, Pamela K. Kreeger
      Oncotarget.2016; 7(52): 86608.     CrossRef
    • Study design for a randomised controlled trial to explore the modality and mechanism of Tai Chi in the pulmonary rehabilitation of chronic obstructive pulmonary disease
      Juan-Juan Fu, Jie Min, Peng-Ming Yu, Vanessa M McDonald, Bing Mao
      BMJ Open.2016; 6(8): e011297.     CrossRef

    • ePub LinkePub Link
    • Cite
      CITE
      export Copy Download
      Close
      Download Citation
      Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.

      Format:
      • RIS — For EndNote, ProCite, RefWorks, and most other reference management software
      • BibTeX — For JabRef, BibDesk, and other BibTeX-specific software
      Include:
      • Citation for the content below
      Statistical notes for clinical researchers: post-hoc multiple comparisons
      Restor Dent Endod. 2015;40(2):172-176.   Published online March 24, 2015
      Close
    • XML DownloadXML Download
    Statistical notes for clinical researchers: post-hoc multiple comparisons
    Statistical notes for clinical researchers: post-hoc multiple comparisons

    Type I error rates according to the range of comparison

    CategoryDefinition
    Type I error rate per comparison (αPC)Probability of incorrect rejection of true null hypothesis when a comparison is tested
    Family-wise type I error rate (αFW)The probability of type I error occurs when a set (family) of tests is performed

    Category and characteristics of various multiple comparison tests

    CategoryUsageMethodStepProcedure
    Restricted set of contrastsAppropriate for relatively small families of testsBonferroniSingle-stepAdjust αPC = αFW / k
    Holm-BonferroniStep-downRepeated tests according to the p-values of comparisons and assess with increased α error level
    Shaffer's modified sequentially rejective BonferroniStep-downModification of Holm-Bonferroni procedure.
    More powerful.
    Šidák-BonferroniSingle-stepAdjust αPC = 1 - (1 - αFW)1/K
    Šidák-HolmStep-downStep-down procedure of Šidák-Bonferroni
    Dunnett's testSingle-stepInterested in comparison with control and other experimental groups
    Pairwise comparisonPerform all pairwise comparisonsTukey's honestly significance difference (HSD)Single-stepBased on studentized range statistics (q statistics).
    For unequal group size Tukey-Kramer method is applied.
    Tukey's bStep-downStep-down procedure of Tukey method. Widely significance difference (WSD) method
    Student-Newman-Keuls (SNK) procedureStep-downStep-down procedure of modified Tukey method.
    Lower critical values are applied as steps repeated.
    Very liberal.
    Duncan's multiple range testStep-downModified SNK method. Adjust significance level as steps repeated.
    Hochberg's GF2Single-stepSimilar to Tukey method but critical values are based on the studentized maximum modulus distribution. appropriate for balanced or unbalanced design
    GabrielSingle-stepEquivalent to GF2 test for balanced one-way ANOVA.
    For unbalanced design, less conservative than GF2
    Ryan-Einot-Gabriel-Walsch (REGW)Step-downModification of the SNK procedure (more strict control of family-wise α error)
    REGWF: based on F statistics (available only in SPSS)
    REGWQ: based on q statistics (maximum range distribution)
    Post-hoc error correctionFor a completely post-hoc analysisSchefféSingle-stepComplex comparison
    Most stringent error control
    No control of errorInappropriate for control of family-wise errorLSD (Least Significant Difference)Single-stepNo control of family-wise error

    αPC, α error level per comparison; αFW, family-wise α error level; k, number of comparisons.

    Table 1 Type I error rates according to the range of comparison

    Table 2 Category and characteristics of various multiple comparison tests

    αPC, α error level per comparison; αFW, family-wise α error level; k, number of comparisons.


    Restor Dent Endod : Restorative Dentistry & Endodontics
    Close layer
    TOP