[SOLVED] 4.-Latent-Variable-Models-and-EM.pdf

4.-Latent-Variable-Models-and-EM.pdf

L

/DWHQW9DULDEOH0RGHOVDQG
(0

*KRODPUH]D+DbDUL

LL

/DWHQW9DULDEOH0RGHOVDQG(0

*KRODPUH]D+DdDUL

*HQHUDWHGE$OH[DQGULDKWWSVZZZDOH[DQGULDUHSRVLWRURUJRQ0DUFKDWSP$(7

$SSHQGL[$&RQVWUDLQHG2SWLPLVDWLRQ

LLL

&RQWHQWV
7LWOH L
&RSULJKW LL
&OXVWHULQJDQG.PHDQV
*DXVVLDQ0L[WXUH0RGHOVDQG([SHFWDWLRQ0D[LPLVDWLRQ
$*HQHUDO9LHZWR(0
$FWLYLW(0IRU*00
/DWHQW9DULDEOH0RGHOVIRURFXPHQW$QDOVLV
$FWLYLWRFXPHQW&OXVWHULQJ
$SSHQGL[$&RQVWUDLQHG2SWLPLVDWLRQ

L

&OXVWHULQJDQG.PHDQV

&OXVWHULQJDQG.PHDQV

DWD&OXVWHULQJ
DWDFOXVWHULQJRUFOXVWHUDQDOVLVLVRQHRIWKHPRVWFRPPRQIRUPVRIXQVXSHUYLVHGOHDUQLQJWKDWDLPVWR
eQGDVHQVLEOHVWUXFWXUHIURPXQODEHOHGGDWD,QRWKHUZRUGVDFOXVWHULQJDOJRULWKPJURXSVGDWDLQWRWKHLU
QDWXUDOFDWHJRULHVEDVHGRQWKHVLPLODULWLHVEHWZHHQWKHPZLWKRXWNQRZLQJWKHLUDFWXDOJURXSV&OXVWHULQJ
DOJRULWKPVKHOSGDWDVFLHQWLVWVWRGRVHYHUDOWDVNVVXFKDVUHYHDOLQJWKHVWUXFWXUHRIWKHGDWDZKLFKKDV
PDQDSSOLFDWLRQVLQKSRWKHVLVJHQHUDWLRQDQGDQRPDOGHWHFWLRQFDWHJRUL]LQJGDWDZKHQODEHOLQJHJ
EKXPDQH[SHUWVDUHFRVWODQGFRPSUHVVLQJGDWDRQOVWRULQJWKHFOXVWHUUHSUHVHQWDWLYHVSURWRWSHV
RUWKHSDUDPHWHUVRIWKHJHQHUDWLYHPRGHOV

6RPHRIWKHFKDOOHQJHVLQGDWDFOXVWHULQJDUHVFDODELOLWWRELJGDWDWKHFDSDELOLWWRKDQGOHGLdHUHQW
WSHVRIGDWDZLWKDYDULHWRIGLVWULEXWLRQVDQGLQVHQVLWLYLWWRQRLVHDQGRXWOLHUV6RIDUKHDSVRI
FOXVWHULQJDOJRULWKPVDUHGHYHORSHGEVWDWLVWLFLDQDQGFRPSXWHUVFLHQWLVWV&HQWHUEDVHGKWWS&HQWHUEDVHG
SDUWLWLRQLQJHJ.0HDQVGHQVLWEDVHGKWWSVHQZLNLSHGLDRUJZLNL&OXVWHUBDQDOVLVHQVLWEDVHGBFOXVWHULQJ
FOXVWHULQJHJ%6&$1KLHUDUFKLFDOKWWSVHQZLNLSHGLDRUJZLNL+LHUDUFKLFDOBFOXVWHULQJFOXVWHULQJDQGJUDSK
EDVHGKWWSZZZVOLGHVKDUHQHWVVDNSLJUDSKEDVHGFOXVWHULQJFOXVWHULQJDUHMXVWDIHZH[DPSOHVRISRSXODUFOXVWHULQJ
DSSURDFKHV)LJXUHFRPSDUHVWKHSDUWLWLRQLQJFOXVWHULQJWKHOHIWVLGHYHUVXVWKHKLHUDUFKLFDO
FOXVWHULQJWKHULJKWVLGH

KWWSZZZVOLGHVKDUHQHWDRUULROVOHFWXUH
)LJXUH3DUWLWLRQLQJOHIWYVKLHUDUFKLFDOFOXVWHULQJULJKW6RXUFH
KWWSZZZVOLGHVKDUHQHWDRUULROVOHFWXUH

,QWKLVFKDSWHUZHIRFXVRQWKH.0HDQVDOJRULWKPQRWRQOEHFDXVHRILWVVLPSOLFLWEXWDOVREHFDXVHLW
SURYLGHVXVVRPHXVHIXODQFKRUVWRLPSRUWDQWFRQFHSWVDQGWHFKQLTXHVWKDWZLOOEHGLVFXVVHGLQWKHQH[W
FKDSWHUV

7KH.0HDQV$OJRULWKP
6XSSRVH XQODEHOHGGDWDSRLQWV DUHJLYHQDQGWKHJRDOLVWRSDUWLWLRQWKHPLQWR GLVWLQFWJURXSV
RUFOXVWHUVVXFKWKDWVLPLODUSRLQWVDUHJURXSHGWRJHWKHU7KHVLPLODULWLVPHDVXUHGXVXDOOEWKH

LQYHUVHRIDGLVWDQFHPHDVXUH HJ(XFOLGHDQGLVWDQFH7KHVLPSOHVWFHQWHUEDVHGDOJRULWKPVWR

&OXVWHULQJDQG.PHDQV

VROYHWKHFOXVWHULQJSUREOHPLV.0HDQV

.0HDQVLVDQLWHUDWLYHDOJRULWKPWKDWVWDUWVZLWKLQLWLDOUDQGRPJXHVVHVRI FOXVWHUFHQWHUV

DQGFRQWLQXHVELWHUDWLYHOH[HFXWLQJWKHIROORZLQJWZRVWHSVXQWLODVWRSSLQJ
FULWHULRQLVPHW

8SGDWH$VVLJQPHQWRIDWDSRLQWVWR&OXVWHUV&DOFXODWHWKHGLVWDQFHRIHDFKGDWDSRLQW
WRDOOFOXVWHUFHQWHUVDQGDVVLJQWKHGDWDSRLQWWRWKHFOXVWHUZLWKWKHPLQLPXPGLVWDQFH
8SGDWH&HQWHUVRIWKH&OXVWHUV)RUHDFKFOXVWHUFDOFXODWHWKHQHZFHQWHUDVWKHDYHUDJHRIDOO
GDWDSRLQWVDVVLJQHGWRLW0RUHIRUPDOO

ZKHUH LQGLFDWHVZKHWKHU LVDVVLJQHGWR FOXVWHU

%DVHGRQWKHDERYHGHVFULSWLRQLQRQHVWHS.0HDQVDVVLJQVGDWDSRLQWVWRWKHLUFORVHVWFHQWUHVDQGLQWKH
FRQVHFXWLYHVWHSLWXSGDWHVWKHHDFKFOXVWHUPHDQEVLPSODYHUDJLQJRYHUDOOWKHGDWDSRLQWVWKDWDUH
FXUUHQWODVVLJQHGWRWKDWFOXVWHU)LJXUHLOOXVWUDWHVWKH.0HDQVVWHSV

&OXVWHULQJDQG.PHDQV

)LJXUH,OOXVWUDWLRQRI.0HDQVVWHSV

7KHJUHHQSRLQWVLQ3ORWDIURP)LJXUHDUHXQODEHOHGGDWDSRLQWVDQGWKHFURVVHVDUHWKH
UDQGRPOJHQHUDWHGFOXVWHUFHQWHUVZKLFKDUHIDUIURPWKHFHQWHURIWKHFOXVWHUV7KHUHGDQGEOXHSRLQWV
LQ3ORWELQGLFDWHWKHVDPSOHVWKDWDUHDVVLJQHGWRWKHFORVHVWFOXVWHUVWRWKHPDQGWKHSLQNVROLGOLQHLV
WKHERUGHUEHWZHHQWKHWZRVRIRXQGFOXVWHUV3ORWFVKRZVWKHFOXVWHUSURWRWSHVLHFURVVHVDIWHUDQ
XSGDWH3ORWVGKLOOXVWUDWHWKHQH[WVWHSVRIWKH.0HDQVDQG3ORWLGHPRQVWUDWHVWKHeQDOFOXVWHU
FHQWHUVDQGFOXVWHUHGSRLQWV

,PSRUWDQW5HPDUNV
:HFDQYLHZ.0HDQVDVDQRSWLPLVDWLRQDOJRULWKPWRPLQLPLVHKHIROORZLQJREMHFWLYHIXQFWLRQ

&OXVWHULQJDQG.PHDQV

ZLWKWKHFRQVWUDLQWVWKDW DQG IRUDOO 1RWHWKDW LVDIXQFWLRQRI

WKHFOXVWHUFHQWUHV DQGWKHFOXVWHUDVVLJQPHQWV
DQGLVRSWLPLVHGZLWKUHVSHFWWRWKHVHYDULDEOHV

.0HDQVLVVHQVLWLYHWRLQLWLDOYDOXHVZKLFKPHDQVWKHGLdHUHQWH[HFXWLRQRI.0HDQVZLWKGLdHUHQW
LQLWLDOFOXVWHUFHQWHUVPDUHVXOWLQGLdHUHQWVROXWLRQV
.0HDQVLVDQRQSUREDELOLVWLFDOJRULWKPZKLFKRQOVXSSRUWVKDUGDVVLJQPHQW7KLVPHDQVDGDWD
SRLQWFDQRQOEHDVVLJQHGWRRQHDQGRQORQHRIWKHFOXVWHUV

$SSOLFDWLRQ
)LJXUHVKRZVDQDSSOLFDWLRQRI.0HDQVLQLPDJHFRPSUHVVLRQ,QWKLVSDUWLFXODUDSSOLFDWLRQWKH
SL[HOVFRORUVLH5*%LQWHQVLWLHVDUHWUHDWHGDVWKHGDWDSRLQWV:HFDQFOXVWHUWKHSL[HOFRORUVLQWRVRPH
FOXVWHUVDQGWKHQUHSODFHWKHFRORUVLQDFOXVWHUZLWKWKHFOXVWHUFHQWURLG7KHUHIRUHWKHFRORUUHVROXWLRQ
RIWKHSLFWXUHLVUHGXFHGZKLFKLQWXUQOHDGVWRFRPSUHVVLRQ$SSDUHQWOWKHORZHUWKH LVVHWWKH
FRPSUHVVLRQUDWHZRXOGEHKLJKHUDQGDFFRUGLQJOWKHLPDJHTXDOLWZRXOGEHORZHU

)LJXUH$SSOLFDWLRQRI.0HDQVDOJRULWKPLQLPDJHFRPSUHVVLRQ

*DXVVLDQ0L[WXUH0RGHOVDQG([SHFWDWLRQ0D[LPLVDWLRQ

*DXVVLDQ0L[WXUH0RGHOVDQG([SHFWDWLRQ
0D[LPLVDWLRQ
&RQVLGHUWKHFOXVWHULQJSUREOHPWKDWZHVDZLQWKHSUHYLRXVFKDSWHUZKHUHZHZDQWHGWRSDUWLWLRQDVHW

RIWUDLQLQJGDWDSRLQWV LQWR JURXSVRIVLPLODUGDWDSRLQWV7KLQNLQJGLdHUHQWOZH

ZRXOGOLNHWRDVVLJQRQHRIWKHODEHOV WRHDFKGDWDSRLQWZKHUHDODEHOLVDJURXSLGHQWLeHU
$VRSSRVHGWRVXSHUYLVHGOHDUQLQJZHDUHQRWJLYHQODEHOVIRUWUDLQLQJGDWDSRLQWVLQWKHFOXVWHULQJ
SUREOHP,QRWKHUZRUGVWKHODEHORIWKHWUDLQLQJGDWDSRLQWVDUHODWHQWRUKLGGHQZKLFKZHGHQRWHE
ODWHQWYDULDEOHV/DWHQWYDULDEOHLVDQLPSRUWDQWFRQFHSWLQSUREDELOLVWLFPRGHOOLQJDQGLWVXVDJHJRHV
EHRQGWKHFOXVWHULQJSUREOHP

,QWKLVFKDSWHUZHJLYHDSUREDELOLVWLFPRGHOOLQJYLHZSRLQWWRWKHFOXVWHULQJSUREOHPZKLFKLQYROYHVODWHQW
YDULDEOHV7KHSDUDPHWHUVRIWKHSUREDELOLVWLFPRGHODQGEHVWYDOXHVIRUWKHODWHQWYDULDEOHVDUHWKHQ
OHDUQHGEDVHGRQWKHPD[LPXPOLNHOLKRRGSULQFLSOH7KLVLVLQFRQWUDVWWRWKH.PHDQVDOJRULWKPIRU
FOXVWHULQJZKLFKLVPHUHOGHVLJQHGEDVHGRQPLQLPLVLQJDQLQWXLWLYHOUHDVRQDEOHREMHFWLYHIXQFWLRQ
DQGLVQRWEDVHGRQDQSUREDELOLVWLFSULQFLSOH

*DXVVLDQ0L[WXUH0RGHOV*00V
$*HQHUDWLYH6WRU&RQVLGHUWKHIROORZLQJKSRWKHWLFDOJHQHUDWLYHVWRUIRUJHQHUDWLQJDODEHO

GDWDSRLQWSDLU

)LUVWJHQHUDWHDFOXVWHUODEHO EWRVVLQJDGLFHZLWK IDFHVZKHUHHDFKIDFHRIWKHGLFH
FRUUHVSRQGVWRDFOXVWHUODEHO

6HFRQGJHQHUDWHWKHGDWDSRLQW EVDPSOLQJIURPWKHGLVWULEXWLRQ FRUUHVSRQGLQJWRWKH
FOXVWHUODEHO

:HXVHRUDFOHWRUHIHUWRWKHSHUVRQZKRKDVKSRWKHWLFDOOJHQHUDWHGWKHGDWDEDVHGRQWKHDERYH
SURFHVV$IWHUJHQHUDWLQJWKHGDWDWKHRUDFOHKLGHVWKHODEHO IURPXVDQGRQOJLYHVXVWKHGDWDSRLQW

:HGHQRWHWKHODEHOZKLFKLVKLGGHQIURPXVEDUDQGRPYDULDEOH ZKLFKZHFDOO
ODWHQWYDULDEOH1RZJLYHQWKHWUDLQLQJGDWDZHZRXOGOLNHWReQGWKHEHVWYDOXHIRUWKHODWHQWYDULDEOHV
DQGWKHEHVWHVWLPDWHVIRUWKHSDUDPHWHUVRIWKHDERYHJHQHUDWLYHVWRU

7KH3UREDELOLVWLF*HQHUDWLYH0RGHO/HWXVIRUPXODWHWKHSUREDELOLVWLFPRGHOFRUUHVSRQGLQJWRWKH
DERYHJHQHUDWLYHVWRU

7RVVLQJDGLFHZLWK IDFHVLVWKHVDPHDVVDPSOLQJIURPDPXOWLQRPLDOGLVWULEXWLRQRQ
HOHPHQWVWKHSDUDPHWHUVRIWKHPXOWLQRPLDODUHWKHSUREDELOLW RIVHOHFWLQJHOHPHQWVZKHUH

DQG

)RUWKHIDFH ZHDVVXPHGDWDSRLQWVDUHVDPSOHGIURP*DXVVLDQGLVWULEXWLRQV

*DXVVLDQ0L[WXUH0RGHOVDQG([SHFWDWLRQ0D[LPLVDWLRQ

ZKHUHSDUDPHWHUVLQFOXGHPHDQ DQGFRYDULDQFH 1RWHWKDWZHKDYHDFROOHFWLRQRIWKHVH
*DXVVLDQGLVWULEXWLRQVHDFKRIZKLFKFRUUHVSRQGVWRRQHRI GLFHIDFHV

$VVDLGWKHRUDFOHKLGHVWKHODEHOVDQGRQOJLYHVXVWKHGDWDSRLQWV DQGZHDLPWR

EHVWJXHVVWKHODWHQWYDULDEOHV ZKHUHHDFK UHSUHVHQWVWKHODWHQW
ODEHOIRUDGDWDSRLQW )XUWKHUPRUHZHZRXOGOLNHWReQGWKHEHVWHVWLPDWHIRUPRGHOSDUDPHWHUV

:HDFKLHYHWKHVHWZRJRDOVEUHVRUWLQJWRWKHPD[LPXP
OLNHOLKRRGSULQFLSOH

*DXVVLDQ0L[WXUH0RGHODQGWKH/LNHOLKRRG,IZHZHUHJLYHQDFRPSOHWHGDWDSRLQW ZKHUH
WKHODEHOZDVQRWKLGGHQWKHQWKHSUREDELOLWRIWKHSDLUDFFRUGLQJWRRXUJHQHUDWLYHVWRUZRXOGEH

ZKHUHWKHSUREDELOLWRIWKHGLFHIDFH LV DQGWKHSUREDELOLWRIWKHGDWDSRLQW JLYHQWKHGLFH

IDFHLV

,QSUDFWLFHWKHRUDFOHKDVQRWJLYHQXVWKHFRPSOHWHGDWDSRLQWLQVWHDGLWKDVJLYHQXVRQODQLQFRPSOHWH
GDWDRUREVHUYHGGDWD HQRWLQJWKHODWHQWODEHOEWKHODWHQWYDULDEOH ZHFDQZULWH

ZKHUHZHKDYHPDUJLQDOLVHGRXWWKHUDQGRPYDULDEOHWRJHWWKHSUREDELOLWRIWKHLQFRPSOHWHGDWD7KLV
PRGHOLVFDOOHGWKH*DXVVLDQPL[WXUHPRGHOZKLFKLVFRPSRVHGRIPL[LQJFRHcFLHQWVFRUUHVSRQGLQJWR
WKHPXOWLQRPLDOGLVWULEXWLRQSDUDPHWHULVHGE DQGDFROOHFWLRQRI*DXVVLDQFRPSRQHQWV:HFDQQRZ
ZULWHGRZQWKHORJOLNHOLKRRGRIWKHREVHUYHGGDWD

ZKHUH DUHWKHPRGHOSDUDPHWHUV

7KH3UHGLFWLRQ5XOH$IWHUHVWLPDWLQJWKHPRGHOSDUDPHWHUVZHFDQDVNWKHTXHVWLRQWRZKLFKFOXVWHU
DQREVHUYHGGDWDSRLQWVKRXOGEHDVVLJQHGWR8VLQJWKHWKH%DHV
UXOHZHFDQeQGWKHFRQGLWLRQDO
SUREDELOLWRIDFOXVWHU IRUDJLYHQGDWDSRLQW

*DXVVLDQ0L[WXUH0RGHOVDQG([SHFWDWLRQ0D[LPLVDWLRQ

ZKHUH ,QWHUHVWLQJOWKLVJLYHVXVDSDUWLDODVVLJQPHQWDOVRFDOOHGVRIWDVVLJQPHQWRI
DGDWDSRLQWWRDFOXVWHUVEDVHGRQRXUSUREDELOLVWLFPRGHO5HFDOOWKDWLQ.PHDQVDGDWDSRLQWEHORQJV
RQOWRRQHFOXVWHULHKDUGDVVLJQPHQWDQGWKHUHZDVQRQRWLRQRISDUWLDODVVLJQPHQW

$OWHUQDWLYHOZHVKDOOYLHZ DVWKHSULRUSUREDELOLWRI DQGWKHTXDQWLW DVWKH

FRUUHVSRQGLQJSRVWHULRUSUREDELOLWRQFHZHKDYHREVHUYHG :HUHIHUWR DVWKHUHVSRQVLELOLW
WKDWFOXVWHU WDNHVIRUH[SODLQLQJWKHREVHUYDWLRQ

:HZLOOVHHLQWKHQH[WVHFWLRQWKDWFOXVWHUSUHGLFWLRQLVLQWHUWZLQHGZLWKSDUDPHWHUHVWLPDWLRQLHWKH
DUHERWKGRQHVLPXOWDQHRXVOLQDQLWHUDWLYHDOJRULWKPFDOOHGWKH([SHFWDWLRQ0D[LPLVDWLRQ$OJRULWKP
ZKLFKeQGVERWKWKHEHVWODWHQWYDULDEOHDVVLJQPHQWDQGWKHEHVWSDUDPHWHUHVWLPDWHV

([SHFWDWLRQ0D[LPLVDWLRQ(0IRU*00V
7KHPD[LPXPOLNHOLKRRGSULQFLSOHLQVWUXFWVXVWRPD[LPLVHWKHOLNHOLKRRG DVDIXQFWLRQRIPRGHO
SDUDPHWHUV/HWXVEHJLQEZULWLQJGRZQWKHFRQGLWLRQVWKDWPXVWEHVDWLVeHGDWDPD[LPXPRIWKHORJ
OLNHOLKRRGIXQFWLRQ

7KH0HDQ3DUDPHWHUV)LUVWOVHWWLQJWKHJUDGLHQWRI ZLWKUHVSHFWWRWKHPHDQV RIWKH
*DXVVLDQFRPSRQHQWVWR]HURZHREWDLQ

ZKHUHWKHUHVSRQVLELOLWTXDQWLWLHVQDWXUDOODSSHDURQWKHULJKWKDQGVLGH5HDUUDQJLQJWKHWHUPVZH
REWDLQ

ZKHUHZHKDYHGHeQHG :HFDQLQWHUSUHW DVWKHHbHFWLYHQXPEHURISRLQWV
DVVLJQHGWRFOXVWHU 1RWHFDUHIXOOWKHIRUPRIWKLVVROXWLRQ:HVHHWKDWWKHPHDQ IRUWKH WK
*DXVVLDQFRPSRQHQWLVREWDLQHGEWDNLQJDZHLJKWHGPHDQRIDOORIWKHSRLQWVLQWKHGDWDVHWLQZKLFK

*DXVVLDQ0L[WXUH0RGHOVDQG([SHFWDWLRQ0D[LPLVDWLRQ

WKHZHLJKWLQJIDFWRUIRUGDWDSRLQW LVJLYHQEWKHSRVWHULRUSUREDELOLW WKDWFRPSRQHQW ZDV
UHVSRQVLEOHIRUJHQHUDWLQJ

7KH&RYDULDQFH0DWULFHV6HFRQGOVHWWLQJWKHJUDGLHQWRI ZLWKUHVSHFWWR WR]HURDQG
IROORZLQJDVLPLODUOLQHRIUHDVRQLQJZHREWDLQ

ZKLFKKDVWKHVDPHIRUPDVWKHFRUUHVSRQGLQJUHVXOWIRUDVLQJOH*DXVVLDQeWWHGWRWKHGDWDVHWEXW
DJDLQZLWKHDFKGDWDSRLQWZHLJKWHGEWKHFRUUHVSRQGLQJSRVWHULRUSUREDELOLWDQGZLWKWKHGHQRPLQDWRU
JLYHQEWKHHdHFWLYHQXPEHURISRLQWVDVVRFLDWHGZLWKWKHFRUUHVSRQGLQJFRPSRQHQW

7KH0L[LQJ&RHcFLHQWV)LQDOOZHPD[LPLVH ZLWKUHVSHFWWRWKHPL[LQJFRHgFLHQWV +HUH
ZHPXVWWDNHDFFRXQWRIWKHFRQVWUDLQWWKDWWKHPL[LQJFRHgFLHQWVKDYHWRVXPWRRQH7KLVFDQEH
DFKLHYHGXVLQJD/DJUDQJHPXOWLSOLHU DQGPD[LPL]LQJWKHIROORZLQJREMHFWLYHIXQFWLRQ

ZKLFKDIWHUVHWWLQJWKHJUDGLHQWWR]HURJLYHV

0DNLQJXVHRIWKHFRQVWUDLQW ZHeQG +HQFHHOLPLQDWLQJ ZHREWDLQ

VRWKDWWKHPL[LQJFRHgFLHQWIRUWKH WKFRPSRQHQWLVJLYHQEWKHDYHUDJHUHVSRQVLELOLWZKLFKWKDW
FRPSRQHQWWDNHVIRUH[SODLQLQJWKHGDWDSRLQWV

(0$OJRULWKPIRU*DXVVLDQ0L[WXUH0RGHOV,WLVZRUWKHPSKDVL]LQJWKDWWKHDERYHUHVXOWVIRUWKH

*DXVVLDQ0L[WXUH0RGHOVDQG([SHFWDWLRQ0D[LPLVDWLRQ

RSWLPDOSDUDPHWHUHVWLPDWHGRQRWFRQVWLWXWHDFORVHGIRUPVROXWLRQEHFDXVHWKHUHVSRQVLELOLWLHV
GHSHQGRQWKRVHSDUDPHWHUVLQDFRPSOH[ZD+RZHYHUWKHVHUHVXOWVGRVXJJHVWDVLPSOHLWHUDWLYH
VFKHPHIRUeQGLQJDVROXWLRQWRWKHPD[LPXPOLNHOLKRRGSUREOHPZKLFKDVZHVKDOOVHHWXUQVRXWWREH
DQLQVWDQFHRIWKH([SHFWDWLRQ0D[LPLVDWLRQ(0DOJRULWKPIRUWKHSDUWLFXODUFDVHRIWKH*DXVVLDQ
PL[WXUHPRGHO

+HUHLVWKH(0DOJRULWKPIRU*DXVVLDQPL[WXUHPRGHOV:HeUVWFKRRVHVRPHLQLWLDOYDOXHVIRUWKHPHDQV
FRYDULDQFHVDQGPL[LQJFRHgFLHQWV7KHQZHDOWHUQDWHEHWZHHQWKHIROORZLQJWZRXSGDWHVWKDWZHVKDOO
FDOOWKH(VWHSDQGWKH0VWHSIRUUHDVRQVWKDWZLOOEHFRPHDSSDUHQWVKRUWOXQWLODVWRSSLQJFRQGLWLRQLV
PHW

,QWKHH[SHFWDWLRQVWHSRU(VWHSZHXVHWKHFXUUHQWYDOXHVIRUWKHSDUDPHWHUVWRHYDOXDWHWKH
SRVWHULRUSUREDELOLWLHV
,QWKHPD[LPLVDWLRQVWHSRU0VWHSWRUHHVWLPDWHWKHPHDQV FRYDULDQFHV DQGPL[LQJ
FRHgFLHQWV XVLQJWKHDERYHUHVXOWV

5HODWLRQWR.0HDQV7KHDERYHDOJRULWKPLVUHPLQLVFHQWRIWKH.PHDQVDOJRULWKPZLWKVRPH
GLdHUHQFHVL7KHRQOSDUDPHWHUVLQ.PHDQVDUHWKHFOXVWHUPHDQV WKHUHDUHQR DQG DQG
LL7KHDVVLJQPHQWRIGDWDSRLQWVWRFOXVWHUVDUHKDUGLQ.PHDQVZKHUHHDFKGDWDSRLQWLVDVVRFLDWHG
XQLTXHOZLWKRQHFOXVWHUKRZHYHUWKH(0DOJRULWKPPDNHVVRIWDVVLJQPHQWVEDVHGRQWKHSRVWHULRU
SUREDELOLWLHV

,PSRUWDQW5HPDUNV

(DFKXSGDWHWRWKHSDUDPHWHUVUHVXOWLQJIURPDQ(VWHSIROORZHGEDQ0VWHSLVJXDUDQWHHGWR
LQFUHDVHWKHORJOLNHOLKRRGIXQFWLRQZHGRQRWSURYHLWKHUH
,QSUDFWLFHWKHDOJRULWKPLVGHHPHGWRKDYHFRQYHUJHGZKHQWKHFKDQJHLQWKHORJOLNHOLKRRG
IXQFWLRQRUDOWHUQDWLYHOLQWKHSDUDPHWHUVIDOOVEHORZVRPHWKUHVKROG
7KH(0DOJRULWKPWDNHVPDQPRUHLWHUDWLRQVWRUHDFKFRQYHUJHQFHFRPSDUHGWRWKH.PHDQV
DOJRULWKPDQGWKDWHDFKFFOHUHTXLUHVVLJQLeFDQWOPRUHFRPSXWDWLRQV

([DPSOH:HLOOXVWUDWHWKH(0DOJRULWKPIRUDPL[WXUHRIWZR*DXVVLDQVRQWKHGDWDSRLQWVLQ)LJXUH
+HUHDPL[WXUHRIWZR*DXVVLDQVLVXVHGZLWKFHQWUHVLQLWLDOL]HGXVLQJWKHVDPHYDOXHVDVIRUWKH
.PHDQVDOJRULWKPLQ)LJXUHDQGZLWKFRYDULDQFHPDWULFHVLQLWLDOL]HGWREHSURSRUWLRQDOWRWKHXQLW
PDWUL[

*DXVVLDQ0L[WXUH0RGHOVDQG([SHFWDWLRQ0D[LPLVDWLRQ

)LJXUH,OOXVWUDWLRQRI(0VWHSVLQ*00

3ORWDVKRZVWKHGDWDSRLQWVLQJUHHQWRJHWKHUZLWKWKHLQLWLDOFRQeJXUDWLRQRIWKHPL[WXUHPRGHOLQ
ZKLFKWKHRQHVWDQGDUGGHYLDWLRQFRQWRXUVIRUWKHWZR*DXVVLDQFRPSRQHQWVDUHVKRZQDVEOXHDQGUHG
FLUFOHV

3ORWEVKRZVWKHUHVXOWRIWKHLQLWLDO(VWHSLQZKLFKHDFKGDWDSRLQWLVGHSLFWHGXVLQJDSURSRUWLRQRI
EOXHLQNHTXDOWRWKHSRVWHULRUSUREDELOLWRIKDYLQJEHHQJHQHUDWHGIURPWKHEOXHFRPSRQHQWDQGD
FRUUHVSRQGLQJSURSRUWLRQRIUHGLQNJLYHQEWKHSRVWHULRUSUREDELOLWRIKDYLQJEHHQJHQHUDWHGEWKH
UHGFRPSRQHQW7KXVSRLQWVWKDWKDYHDVLJQLeFDQWSUREDELOLWIRUEHORQJLQJWRHLWKHUFOXVWHUDSSHDU
SXUSOH

7KHVLWXDWLRQDIWHUWKHeUVW0VWHSLVVKRZQLQSORWFLQZKLFKWKHPHDQRIWKHEOXH*DXVVLDQKDVPRYHG
WRWKHPHDQRIWKHGDWDVHWZHLJKWHGEWKHSUREDELOLWLHVRIHDFKGDWDSRLQWEHORQJLQJWRWKHEOXHFOXVWHU
LQRWKHUZRUGVLWKDVPRYHGWRWKHFHQWUHRIPDVVRIWKHEOXHLQN6LPLODUOWKHFRYDULDQFHRIWKHEOXH
*DXVVLDQLVVHWHTXDOWRWKHFRYDULDQFHRIWKHEOXHLQN$QDORJRXVUHVXOWVKROGIRUWKHUHGFRPSRQHQW

3ORWVGHDQGIVKRZWKHUHVXOWVDIWHUDQGFRPSOHWHFFOHVRI(0UHVSHFWLYHO,Q3ORWI
WKHDOJRULWKPLVFORVHWRFRQYHUJHQFH

$*HQHUDO9LHZWR(0

$*HQHUDO9LHZWR(0
,QWKLVVHFWLRQZHSUHVHQWDJHQHUDOYLHZRIWKH(0DOJRULWKPWKDWUHFRJQL]HVWKHNHUROHSODHGE
ODWHQWYDULDEOHV:HGLVFXVVWKLVDSSURDFKeUVWRIDOOLQDQDEVWUDFWVHWWLQJDQGWKHQIRULOOXVWUDWLRQZH
FRQVLGHURQFHDJDLQWKHFDVHRI*DXVVLDQPL[WXUHV

7KH(0$OJRULWKP*HQHUDO&DVH
7KH7UDLQLQJ2EMHFWLYH7KHJRDORIWKH(0DOJRULWKPLVWReQGPD[LPXPOLNHOLKRRGVROXWLRQIRUPRGHOV
KDYLQJODWHQWYDULDEOHV:HGHQRWHWKHREVHUYHGGDWDE DQGVLPLODUOZHGHQRWHWKHODWHQWYDULDEOHV
E 7KHVHWRIDOOPRGHOSDUDPHWHUVLVGHQRWHGE DQGVRWKHORJOLNHOLKRRGIXQFWLRQLVJLYHQE

1RWHWKDWRXUGLVFXVVLRQZLOODSSOHTXDOOZHOOWRFRQWLQXRXVODWHQWYDULDEOHVVLPSOEUHSODFLQJWKHVXP
RYHU ZLWKDQLQWHJUDO

6XSSRVHWKDWIRUWKHREVHUYDWLRQ ZHZHUHWROGWKHFRUUHVSRQGLQJYDOXHRIWKHODWHQWYDULDEOH :H

VKDOOFDOO WKHFRPSOHWHGDWDVHWDQGZHVKDOOUHIHUWRWKHDFWXDOREVHUYHGGDWD DV

LQFRPSOHWH7KHOLNHOLKRRGIXQFWLRQIRUWKHFRPSOHWHGDWDVHWVLPSOWDNHVWKHIRUP DQG
ZHVKDOOVXSSRVHWKDWPD[LPL]DWLRQRIWKLVFRPSOHWHGDWDORJOLNHOLKRRGIXQFWLRQLVVWUDLJKWIRUZDUG

0D[LPLVLQJWKH/LNHOLKRRGRI,QFRPSOHWHDWD,QSUDFWLFHZHDUHQRWJLYHQWKHFRPSOHWHGDWDVHW

EXWRQOWKHLQFRPSOHWHGDWD 2XUVWDWHRINQRZOHGJHRIWKHYDOXHVRIWKHODWHQWYDULDEOHVLQ

LVJLYHQRQOEWKHSRVWHULRUGLVWULEXWLRQ %HFDXVHZHFDQQRWXVHWKHFRPSOHWHGDWDORJ
OLNHOLKRRGZHFRQVLGHULQVWHDGLWVH[SHFWHGYDOXHXQGHUWKHSRVWHULRUGLVWULEXWLRQRIWKHODWHQWYDULDEOH
ZKLFKFRUUHVSRQGVWRWKH(VWHSRIWKH(0DOJRULWKP,QWKHVXEVHTXHQW0VWHSZHPD[LPL]HWKLV
H[SHFWDWLRQDVDIXQFWLRQRIPRGHOSDUDPHWHUV,IWKHFXUUHQWHVWLPDWHIRUWKHSDUDPHWHUVLVGHQRWHG

WKHQDSDLURIVXFFHVVLYH(DQG0VWHSVJLYHVULVHWRDUHYLVHGHVWLPDWH 7KHDOJRULWKPLV

LQLWLDOL]HGEFKRRVLQJVRPHVWDUWLQJYDOXHIRUWKHSDUDPHWHUV 7KHH[SHFWDWLRQDQGPD[LPLVDWLRQ
VWHSVDUHLWHUDWHGXQWLODFRQYHUJHQFHFRQGLWLRQLVPHW

7KH(0$OJRULWKP0RUHVSHFLeFDOOLQWKH(VWHSZHXVHWKHFXUUHQWSDUDPHWHUYDOXHV WReQG

WKHSRVWHULRUGLVWULEXWLRQRIWKHODWHQWYDULDEOHVJLYHQE :HWKHQXVHWKLVSRVWHULRU
GLVWULEXWLRQWReQGWKHH[SHFWDWLRQRIWKHFRPSOHWHGDWDORJOLNHOLKRRGHYDOXDWHGIRUVRPHJHQHUDO

SDUDPHWHUYDOXH 7KLVH[SHFWDWLRQGHQRWHG LVJLYHQE

$*HQHUDO9LHZWR(0

,QWKH0VWHSZHGHWHUPLQHWKHUHYLVHGSDUDPHWHUHVWLPDWHcQHZEPD[LPLVLQJWKLVIXQFWLRQ

1RWHWKDWLQWKHGHeQLWLRQRI WKHORJDULWKPDFWVGLUHFWORQWKHMRLQWGLVWULEXWLRQ

DQGVRWKHFRUUHVSRQGLQJ0VWHSPD[LPL]DWLRQZLOOEVXSSRVLWLRQEHWUDFWDEOH

7RVXPPDULVHWKHJHQHUDO(0DOJRULWKPLVDVIROORZV

&KRRVHDQLQLWLDOVHWWLQJIRUWKHSDUDPHWHUV

:KLOHWKHFRQYHUJHQFHLVQRWPHW

(VWHS(YDOXDWH
06WHS(YDOXDWH JLYHQE

7KHLQFRPSOHWHGDWDORJOLNHOLKRRGLVJXDUDQWHHGWRLQFUHDVHLQHDFKFFOHRIWKH(0DOJRULWKPZHGRQ
W
SURYHLWKHUH

7KH+DUG(0$OJRULWKP,QWKH+DUG(0$OJRULWKPWKHUHLVQRH[SHFWDWLRQLQRYHUWKHODWHQWYDULDEOHV

LQWKHGHeQLWLRQRIWKH IXQFWLRQ,QVWHDGRQOWKHPRVWSUREDEOHYDOXHIRUWKHODWHQWYDULDEOHLVFKRVHQ

WRGHeQHWKH IXQFWLRQ,QVXPPDUWKLVDOJRULWKPLVDVIROORZV

&KRRVHDQLQLWLDOVHWWLQJIRUWKHSDUDPHWHUV

:KLOHWKHFRQYHUJHQFHLVQRWPHW

(VWHS6HW

06WHS6HW

,WFDQEHVKRZQWKDWWKHLQFRPSOHWHGDWDORJOLNHOLKRRGLVJXDUDQWHHGWRLQFUHDVHLQHDFKFFOHRIWKH
+DUG(0DOJRULWKPZHGRQ
WSURYHLWKHUH

$*HQHUDO9LHZWR(0

(0IRU*00V5HYLVLWHG
7KH&RPSOHWHDWD/LNHOLKRRG$VVXPHWKDWLQDGGLWLRQWRWKHREVHUYHGGDWDVHW

ZHZHUHDOVRJLYHQWKHYDOXHVRIWKHFRUUHVSRQGLQJODWHQWYDULDEOHV

WKHQ

ZKHUH LVWKHFOXVWHUDVVLJQPHQWYHFWRUIRUWKH WKGDWDSRLQWLQZKLFK
LIWKLVGDWDSRLQWEHORQJVWRWKHFOXVWHU DQG]HURRWKHUZLVH1RWHWKDWRQORQHHOHPHQWRIWKH

FOXVWHUDVVLJQPHQWYHFWRULVDQGWKHUHVWDUH]HUR

0D[LPLVLQJWKHFRPSOHWHGDWDOLNHOLKRRGWReQGWKHSDUDPHWHUVRIWKHPRGHOLVVWUDLJKWIRUZDUG

7KHPL[LQJFRPSRQHQWV ZKHUH

7KHPHDQSDUDPHWHUV

7KHFRYDULDQFHPDWULFHV

7KH IXQFWLRQ,QSUDFWLFHZHDUHQRWJLYHQWKHYDOXHVIRUWKHODWHQWYDULDEOHVDQGZHQHHGWRUHVRUW
WRWKH(0DOJRULWKPWReQGWKHEHVWYDOXHVIRUWKHSDUDPHWHUVDQGWKHODWHQWYDULDEOHV

ZKHUH LVLQGHHGWKHUHVSRQVLELOLWWKDWZHGHeQHGEHIRUH

$*HQHUDO9LHZWR(0

0D[LPLVLQJWKH IXQFWLRQOHDGVWRWKHIROORZLQJXSGDWHGSDUDPHWHUV

7KHPL[LQJFRPSRQHQWV ZKHUH

7KHPHDQSDUDPHWHUV

7KHFRYDULDQFHPDWULFHV

7KH(0$OJRULWKPIRU*00V7KH(0$OJRULWKPVWKXVLVDVIROORZV

&KRRVHDQLQLWLDOVHWWLQJIRUWKHSDUDPHWHUV

:KLOHWKHFRQYHUJHQFHLVQRWPHW

(VWHS6HW EDVHGRQ

06WHS6HW EDVHGRQ

7KLVLVH[DFWOWKH(0$OJRULWKPWKDWZHVDZLQWKHSUHYLRXVFKDSWHU

$FWLYLW(0IRU*00

$FWLYLW(0IRU*00
,QWKLVDFWLYLWZHLPSOHPHQWVRIWDQGKDUGH[SHFWDWLRQPD[LPLVDWLRQIRUWUDLQLQJJDXVVLDQPL[WXUH
PRGHOV7KLVDFWLYLWKHOSVRXWRFRPSOHWH$VVLJQPHQW

3OHDVHGRZQORDGWKLVKWWSVZZZDOH[DQGULDUHSRVLWRURUJZSFRQWHQWXSORDGV$FWLYLW]LS]LSeOHULJKW
FOLFNDQGWKHQFKRRVHVDYHOLQNDVWKDWFRQWDLQVWKHGDWDVHWFVY5VFULSWU-XSWHUQRWHERRN
LSQEDQGRXWSXWeOHKWPO,IRXKDYHDFFHVVWRD-XSWHULQVWDQFHWKHQRWHERRNDQGGDWDVHWLV
HQRXJKWRUXQWKHH[SHULPHQWV2WKHUZLVHRXPDUHDGWKHLQVWUXFWLRQVDQGGLVFXVVLRQVIURPWKH+70/
eOHDQGH[HFXWHWKH5VFULSW

)RUGHWDLOHGGLVFXVVLRQDERXWVHWWLQJRXUSURJUDPPLQJHQYLURQPHQWXSSOHDVHUHIHUWR$SSHQGL[%
6HWWLQJXS