Question

Now that you have learned a bit about how Amazon uses A/B tests, what do you think are some of the risks and challenges associated with performing so many hypothesis tests? What would you do to mitigate those risks? Think about the results of the tests. What were the effects? Look at the size of the effects. Were they small or large? Why were the sample sizes so large?

Answer 1

Poge No. Risk & challengeo anwecictee uith Se many hypatheata deat pesteuig The baie appusash hos a numbear ot shentonp Syptem (D the they may ama h They may be alorgesious imposs Pbla be Metegate Size .At fisst, baur mary op the weapon Jeat may be Coshly environment, (3 , (a) Consickaaona atten nake st Colteat Sompleo even the Sama ime aually System pecfemanse muat Cefalihana Thus mrtmizng the expedted Sampk sze astiele a n leve qSignificole fsequent heaedo to hebl dPHla oalaltfena intomahn need t0 ighly desisable Jaat that abat Adoo aseat Jeast fmprc test seault Jthe deats etten sequentia tecauoe examinec asus bataue ckatalung whette mace teafy i Tequised n hio Stuotten, the Sequenta) nahuse the eot uaually ecogtred anl Rot heres re nommal 5gúfican Jee io alfustec, tesulng astual th iiconce ouel thet ae slealgned Jevet haly coat amociake t heg Hing queateo about heo much hge o ole would be bottea adoloremed by ghalisffesl by staint hypshicain kulty ditfeawnt ouem the bec auseob signifiant dectsten thesg Jhon

Te mitfaals thene xfaka Waakshap paotipent uoge tat tha olepaamend Male beyars the lypetheain dealng pasodn to Comafoley theae geneal appatsashes anfictens fores A 9 fmp te altesinathe thot avafaln sthe necersity b powes caleulatras Conticfensa frieaual Tame ap pesfoiaunanse leel Sonaistent uth the eot uthaut the atffera) aapest af test System ttat asie Teseult Tfesticn saylen. Soquanhiel Racthes Fmpavement stanalasal hypotheaic deattng squenta analysio, whišh mintnizee the expectel numbes fests neechol ste esteblih sianiticon at pertunskely, sequenttel maltisal may te clat en krel because theae ase pme to luoe u OTa E, ehen tthe Sleault ePesviolus opssifional cdeats Knawn belo0 the next teat net be teacly sto begin Pacisfen analyss feat fouer mlrtsy Syptem oftee deshuste the adekel fnfeymain pooil test and the benefit thot ub io Compar ase expenofue & by uth the coat e thst teat