ŅY}& ............................................................................... h1********************************************** MIXPDTACLUSPAC-MIXTURE-MODELCLUSTERINGOF CASESVARYINGCOVARIANCEMATRICES8AUTOMATICSETTINGOFINITIALPARAMETERESTIMATES\H Copyright1991Stanley LouisSclove.qDevelopedandprogrammedby:0Prof.StanleyL.Sclove, Ph.D.Phone (312)996-2681&0.Information&DecisionSciences Dept.M/C2940CollegeofBusinessAdministration+0UniversityofIllinoisatChicago0Box 4348,Chicago,IL60680-43480QProgramVersion:2.9411-May-92){0(VM/CMS)/y݌& ..............................................................................._-PROBLEM TITLEISMBER1177 data:Shipmentweightsandnumberofbags`' 7/20/1992AT0:11:52Yd}hNUMBEROFVARIABLES............/2NUMBEROFOBSERVATIONS(SAMPLESIZE),N..15hmMINIMUMOFEACHVARIABLE:q 4900.100.uMAXIMUMOFEACHVARIABLE:x8\ 28000.600.H FIRSTFOURDATAPOINTSq -------------------ĝ5050.100.Sh01C&10249.205.Sh02G20000.450.Sh037420.150.Sh04K0NUMBEROFCLUSTERSTOREPORT........1TO9OQ{ySSTATISTICSFOR WHOLE(UNCLUSTERED)SAMPLE:W-MEANVECTOR:13437.20287.002COVARIANCEMATRIX:657522378.2931253703.267Y1253703.26727766.000}  MINUS2LOGLIKELIHOOD=n444.5NUMBEROFPARAMETERS=J5 h 0AIC=n454.5SCHWARZCRITERION=n458.0  & ...............................................................................8\HK=2CLUSTERSqNUMBEROFPARAMETERS=B11INITIAL MEANS &<MEANVECTORFORCLUSTER1:|0 5050.100.Q{$y^MEANVECTORFORCLUSTER2: 16100.400.-, ITERATION1? MINUS2LOGLIKELIHOOD=n503.5 0AIC=n525.5:YSCHWARZCRITERION=n533.2=}bfCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:hSh010.9360.064kSh020.6340.366o Sh030.0180.982Sh040.8440.156Sh050.0040.996~8Sh060.6480.352v\Sh070.8460.154zHSh080.9370.063[Sh090.8500.150qSh100.0050.995Sh110.9380.062Sh120.2150.785]&Sh130.0010.999ASh140.0540.946ESh150.0640.936I0}Q CLUSTERING:M{Qy CASESANDLABELS:--\Sh01:1Sh02:1Sh03:2Sh04:1Sh05:2Sh06:1Sh07:1U-YSh08:1Sh09:1Sh10:2Sh11:1Sh12:2Sh13:2Sh14:20Sh15:247YNUMBERSINCLUSTERS:87} ITERATION2h MINUS2LOGLIKELIHOOD=n423.6 0AIC=n445.6SCHWARZCRITERION=n453.4 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:8\Sh010.9850.015HSh020.9010.099Sh030.0001.000qSh040.9770.023Sh050.0001.000Sh060.8620.138&Sh070.9770.023Sh080.9840.016Sh090.9730.027Sh100.0001.0000Sh110.9830.017(QSh120.2230.777{Sh130.0001.000ySh140.0001.000Sh150.0001.000)/-ݫ CLUSTERING:_ CASESANDLABELS:--YSh01:1Sh02:1Sh03:2Sh04:1Sh05:2Sh06:1Sh07:1}@Sh08:1Sh09:1Sh10:2Sh11:1Sh12:2Sh13:2Sh14:2dhSh15:2hMIXINGPROBABILITIES:0.520.48 MEANVECTORFORCLUSTER1:m7287.016147.274qMEANVECTORFORCLUSTER2:820215.425440.995\tHxCOMMONCOVARIANCEMATRIX(MLE):q7671436.615148630.194148630.1943028.480&CLUSTERMEMBERSHIPOFEACH CASE:CCASELABELDATAF0QSh01:15050.000100.000{Sh02:110249.000205.000KySh03:220000.000450.000OSh04:17420.000150.000Sh05:224685.000500.000-Sh06:110206.000200.000SSh07:17325.000150.000WSh08:14958.000100.000Sh09:17162.000150.000 ŎSh10:224000.000500.0001YSh11:14900.000100.0005}Sh12:214501.000300.0009Sh13:228000.000600.000Sh14:217002.000400.000hSh15:216100.000400.000 CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION2.  CLUSTER18 Sh01\ Sh02H Sh04 Sh06q Sh07 Sh08 Sh09& Sh11CLUSTER2 Sh03  Sh050 Sh10Q Sh12.{ Sh13|y Sh14 Sh15$-& ...............................................................................^,K=3CLUSTERS>Y}NUMBEROFPARAMETERS=B17:INITIAL MEANS=hbf MEANVECTORFORCLUSTER1: 5050.100.kn8r\HMEANVECTORFORCLUSTER2:~ 4958.100.vqz[&MEANVECTORFORCLUSTER3: 16100.400.] ITERATION1{0DQ MINUS2LOGLIKELIHOOD=n517.7H{ 0AIC=n551.7ySCHWARZCRITERION=n563.8}MQ-CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:\Sh010.3710.6290.000USh020.3840.6130.003YSh030.0000.0001.000YSh040.3770.6230.000}Sh050.0000.0001.0003Sh060.3840.6140.0027Sh070.3770.6230.000hSh080.3700.6300.000Sh090.3760.6240.000Sh100.0000.0001.000 Sh110.3700.6300.000 Sh120.0000.0001.000Sh130.0000.0001.0008Sh140.0000.0001.000\Sh150.0000.0001.000Hq CLUSTERING: CASESANDLABELS:--&Sh01:2Sh02:2Sh03:3Sh04:2Sh05:3Sh06:2Sh07:2Sh08:2Sh09:2Sh10:3Sh11:2Sh12:3Sh13:3Sh14:30QSh15:3{yNUMBERSINCLUSTERS:087( ITERATION2- MINUS2LOGLIKELIHOOD=n407.0) 0AIC=n441.0/SCHWARZCRITERION=n453.0Y%}CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:׼Sh010.3670.6330.000hSh020.3850.6140.001@Sh030.0000.0001.000Sh040.3760.6240.000d Sh050.0000.0001.000hSh060.3930.6050.001Sh070.3750.6240.0008Sh080.3680.6320.000l\Sh090.3770.6230.000pHSh100.0000.0001.000Sh110.3700.6300.000qSh120.0000.0001.000tSh130.0000.0001.000xSh140.0000.0001.000&Sh150.0000.0001.000 CLUSTERING:0Q CASESANDLABELS:--B{FySh01:2Sh02:2Sh03:3Sh04:2Sh05:3Sh06:2Sh07:2ˌSh08:2Sh09:2Sh10:3Sh11:2Sh12:3Sh13:3Sh14:3K-OSh15:3 MIXINGPROBABILITIES:0.200.330.47SMEANVECTORFORCLUSTER1:VY7202.749145.227Z}MEANVECTORFORCLUSTER2:7131.028143.8381MEANVECTORFORCLUSTER3:5h20608.756449.9109  COMMONCOVARIANCEMATRIX(MLE):  5421321.84399725.435 899725.4351957.136 \ H CLUSTERMEMBERSHIPOFEACH CASE: qCASELABELDATA  Sh01:25050.000100.000 &Sh02:210249.000205.000 Sh03:320000.000450.000 Sh04:27420.000150.000 Sh05:324685.000500.000 0Sh06:210206.000200.000 QSh07:27325.000150.000 {Sh08:24958.000100.000 ySh09:27162.000150.000 Sh10:324000.000500.000 .Sh11:24900.000100.000 |-Sh12:314501.000300.000 Sh13:328000.000600.000 Sh14:317002.000400.000 $Sh15:316100.000400.000 ^ YCONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION2. } >CLUSTER1 hCLUSTER2 Sh01 : Sh02 = Sh04 b Sh06 f Sh07 i8 Sh08 \ Sh09 jH Sh11 nCLUSTER3 rq Sh03 Sh05 ~ Sh10 v& Sh12 z Sh13 [ Sh14  Sh15 0 Q& ............................................................................... { {y D HK=4CLUSTERS - }NUMBEROFPARAMETERS=B23 M QINITIAL MEANS Y T} XMEANVECTORFORCLUSTER1: 5050.100. h 3 7 MEANVECTORFORCLUSTER2:  24685.500.8\HMEANVECTORFORCLUSTER3: 24000.500.q&MEANVECTORFORCLUSTER4: 16100.400.  ITERATION10Q MINUS2LOGLIKELIHOOD=n489.2{ 0AIC=n535.2ySCHWARZCRITERION=n551.5-CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:(Sh011.0000.0000.0000.000Sh020.9990.0000.0000.001Sh030.0000.2750.4770.248*YSh041.0000.0000.0000.000-}Sh050.0000.5110.4890.000Sh061.0000.0000.0000.000Sh071.0000.0000.0000.000%hSh081.0000.0000.0000.000Sh091.0000.0000.0000.000Sh100.0000.4890.5110.000 Sh111.0000.0000.0000.000@Sh120.0000.0000.0001.000Sh130.0000.6140.3860.000c8Sh140.0000.0010.0020.997g\Sh150.0000.0000.0010.999Hŵlq CLUSTERING:p CASESANDLABELS:--&tSh01:1Sh02:1Sh03:3Sh04:1Sh05:2Sh06:1Sh07:1xSh08:1Sh09:1Sh10:3Sh11:1Sh12:4Sh13:2Sh14:40QSh15:4{yNUMBERSINCLUSTERS:8223،B ITERATION2F-˫ MINUS2LOGLIKELIHOOD=n400.5 0AIC=n446.5KSCHWARZCRITERION=n462.8ORY}CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:VSh011.0000.0000.0000.000ZhSh021.0000.0000.0000.000Sh030.0000.2050.7360.0591Sh041.0000.0000.0000.0005 Sh050.0000.5140.4860.0009Sh061.0000.0000.0000.000Sh071.0000.0000.0000.0008Sh081.0000.0000.0000.000\Sh091.0000.0000.0000.000HSh100.0000.5070.4930.000 Sh111.0000.0000.0000.000qSh120.0000.0000.0001.000Sh130.0000.7140.2860.000Sh140.0000.0010.0120.987&Sh150.0000.0000.0020.998 CLUSTERING:0Q CASESANDLABELS:--{ySh01:1Sh02:1Sh03:3Sh04:1Sh05:2Sh06:1Sh07:1Sh08:1Sh09:1Sh10:2Sh11:1Sh12:4Sh13:2Sh14:4-Sh15:4.|NUMBERSINCLUSTERS:8313Y ITERATION3!}; MINUS2LOGLIKELIHOOD=n397.8 0AIC=n443.8hSCHWARZCRITERION=n460.1> CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP::Sh011.0000.0000.0000.000'8Sh021.0000.0000.0000.000a\Sh030.0000.0490.9510.000eHSh041.0000.0000.0000.000iSh050.0000.5360.4640.000qSh061.0000.0000.0000.000jSh071.0000.0000.0000.000nSh081.0000.0000.0000.000r&Sh091.0000.0000.0000.000Sh100.0000.5120.4880.000~Sh111.0000.0000.0000.000vSh120.0000.0000.0001.000y0Sh130.0000.8970.1030.000QSh140.0000.0000.0450.955{Sh150.0000.0000.0120.988y CLUSTERING:{-D CASESANDLABELS:--HSh01:1Sh02:1Sh03:3Sh04:1Sh05:2Sh06:1Sh07:1}LYSh08:1Sh09:1Sh10:2Sh11:1Sh12:4Sh13:2Sh14:4P}Sh15:4ThMIXINGPROBABILITIES:0.530.130.140.20XMEANVECTORFORCLUSTER1:7158.754144.375 MEANVECTORFORCLUSTER2:325885.067543.7447MEANVECTORFORCLUSTER3:822308.663479.150\MEANVECTORFORCLUSTER4:H15849.293366.015qCOMMONCOVARIANCEMATRIX(MLE):&1429714.21828548.26228548.262615.564 0CLUSTERMEMBERSHIPOFEACH CASE:QCASELABELDATA{ySh01:15050.000100.000Sh02:110249.000205.000Sh03:320000.000450.000-Sh04:17420.000150.000Sh05:224685.000500.000Sh06:110206.000200.000Sh07:17325.000150.000(Sh08:14958.000100.000&YSh09:17162.000150.000}Sh10:224000.000500.000Sh11:14900.000100.000*Sh12:414501.000300.000-hSh13:228000.000600.000Sh14:417002.000400.000Sh15:416100.000400.000% CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION3.8#\CLUSTER1"H Sh01c Sh02gq Sh04 Sh06ŝ Sh07l& Sh08p Sh09 Sh11CLUSTER2s0 Sh05wQ Sh10{ Sh13yCLUSTER3 Sh03CLUSTER4- Sh12ث Sh14B Sh15F & ...............................................................................YJ}NRK=5CLUSTERShNUMBEROFPARAMETERS=B29VZ INITIAL MEANS1488\MEANVECTORFORCLUSTER1:H 5050.100.q MEANVECTORFORCLUSTER2:& 7420.150.0MEANVECTORFORCLUSTER3:Q 4958.100.{yMEANVECTORFORCLUSTER4:- 4900.100.MEANVECTORFORCLUSTER5:Y 16100.400.+} ITERATION1!h MINUS2LOGLIKELIHOOD=n756.8; 0AIC=n814.8ߨSCHWARZCRITERION=n835.4 >CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:8\Sh010.1640.0070.4560.3730.000`HSh020.0001.0000.0000.0000.000'Sh030.0000.0000.0000.0001.000aqSh040.0080.9600.0180.0140.000eSh050.0000.0000.0000.0001.000iSh060.0001.0000.0000.0000.000&Sh070.0090.9530.0220.0160.000jSh080.1630.0060.4560.3740.000nSh090.0120.9390.0280.0210.000rSh100.0000.0000.0000.0001.0000Sh110.1630.0050.4570.3750.000QSh120.0000.0000.0000.0001.000u{Sh130.0000.0000.0000.0001.000yySh140.0000.0000.0000.0001.000ڌSh150.0000.0000.0000.0001.000- CLUSTERING:{ CASESANDLABELS:--DGYSh01:3Sh02:2Sh03:5Sh04:2Sh05:5Sh06:2Sh07:2}Sh08:3Sh09:2Sh10:5Sh11:3Sh12:5Sh13:5Sh14:5LPhSh15:5NUMBERSINCLUSTERS:05307T X ITERATION28 MINUS2LOGLIKELIHOOD=n394.62\ 0AIC=n452.66HSCHWARZCRITERION=n473.2qCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:&Sh010.1550.0000.4570.3880.000Sh020.0000.9990.0000.0000.001Sh030.0000.0000.0000.0001.000Sh040.0001.0000.0000.0000.0000Sh050.0000.0000.0000.0001.000QSh060.0001.0000.0000.0000.000{Sh070.0001.0000.0000.0000.000 ySh080.1520.0000.4560.3910.000Sh090.0001.0000.0000.0000.000Sh100.0000.0000.0000.0001.000-Sh110.1530.0000.4560.3910.000Sh120.0000.0000.0000.0001.000Sh130.0000.0000.0000.0001.000Sh140.0000.0000.0000.0001.000Sh150.0000.0000.0000.0001.000Y}< CLUSTERING:&h CASESANDLABELS:--*Sh01:3Sh02:2Sh03:5Sh04:2Sh05:5Sh06:2Sh07:2- Sh08:3Sh09:2Sh10:5Sh11:3Sh12:5Sh13:5Sh14:5,8Sh15:5?\HMIXINGPROBABILITIES:0.030.330.090.080.47ֵMEANVECTORFORCLUSTER1:#q4970.436100.016"MEANVECTORFORCLUSTER2:c8472.036170.993g&MEANVECTORFORCLUSTER3:4969.548100.004MEANVECTORFORCLUSTER4:l4969.228100.001o0MEANVECTORFORCLUSTER5:Q20610.415449.949{sywCOMMONCOVARIANCEMATRIX(MLE):-5018671.90691470.22591470.2251788.047CLUSTERMEMBERSHIPOFEACH CASE:AYCASELABELDATAE}ISh01:35050.000100.000Sh02:210249.000205.000JhSh03:520000.000450.000NSh04:27420.000150.000RSh05:524685.000500.000 Sh06:210206.000200.000Sh07:27325.000150.000VSh08:34958.000100.000Y8Sh09:27162.000150.000\Sh10:524000.000500.0000HSh11:34900.000100.0004Sh12:514501.000300.0008qSh13:528000.000600.000Sh14:517002.000400.000 Sh15:516100.000400.000 & CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION2.   0CLUSTER1 QCLUSTER2 { Sh02 y Sh04  Sh06  Sh07 - Sh09 CLUSTER3  Sh01  Sh08  Sh11 YCLUSTER4 }CLUSTER5 Sh03 Sh05 +h Sh10 Sh12 Sh13 ! Sh14 ; Sh15  8& ............................................................................... \ _H qK=6CLUSTERS ` 'NUMBEROFPARAMETERS=B35 a& eINITIAL MEANS i  0 mQMEANVECTORFORCLUSTER1: q{ 5050.100. y Ȍ u š y-MEANVECTORFORCLUSTER2: ګ 20000.450.   YMEANVECTORFORCLUSTER3: } 10206.200. C G h MEANVECTORFORCLUSTER4: L 7162.150. P   S8MEANVECTORFORCLUSTER5: W\ 14501.300. H 2q 6MEANVECTORFORCLUSTER6: 16100.400. &  ITERATION1   MINUS2LOGLIKELIHOOD=n483.7 0 0AIC=n553.7 QSCHWARZCRITERION=n578.4 { y CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:  -Sh010.4830.0000.0070.5100.0000.000 Sh020.0010.0000.8490.1420.0080.000 Sh030.0000.9570.0000.0000.0000.043 Sh040.0650.0000.1750.7590.0000.000 Sh050.0001.0000.0000.0000.0000.000 YSh060.0010.0000.8290.1640.0060.000 }Sh070.0690.0000.1670.7650.0000.000 Sh080.4930.0000.0060.5010.0000.000 Sh090.0740.0000.1530.7730.0000.000 hSh100.0001.0000.0000.0000.0000.000 <Sh110.4990.0000.0060.4950.0000.000 &Sh120.0000.0000.0130.0000.9680.019 Sh130.0001.0000.0000.0000.0000.000 Sh140.0000.3320.0000.0000.0530.615 *Sh150.0000.1930.0000.0000.0840.723 ^8 \ H CLUSTERING: , ?q CASESANDLABELS:-- ֝Sh01:4Sh02:3Sh03:2Sh04:4Sh05:2Sh06:3Sh07:4 #& "Sh08:4Sh09:4Sh10:2Sh11:1Sh12:5Sh13:2Sh14:6 c gSh15:6 0 QNUMBERSINCLUSTERS:142512 k{ oy ITERATION2  MINUS2LOGLIKELIHOOD=n387.9 s- 0AIC=n457.9 wSCHWARZCRITERION=n482.7   CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: Y }Sh010.6920.0000.0000.3080.0000.000 ]Sh020.0000.0000.9290.0710.0000.000 ASh030.0001.0000.0000.0000.0000.000 EhSh040.0130.0000.1620.8250.0000.000 ISh050.0001.0000.0000.0000.0000.000 Sh060.0000.0000.9930.0070.0000.000 J Sh070.0440.0000.1480.8080.0000.000 NSh080.7330.0000.0000.2670.0000.000 RSh090.0200.0000.1460.8340.0000.000 8Sh100.0001.0000.0000.0000.0000.000 \\Sh110.6250.0000.0000.3740.0000.000 UHSh120.0000.0000.0000.0001.0000.000 YSh130.0001.0000.0000.0000.0000.000 qSh140.0000.1010.0000.0000.0150.884 0Sh150.0000.0350.0000.0000.0060.959 4 8&  CLUSTERING:   CASESANDLABELS:-- 0 QSh01:1Sh02:3Sh03:2Sh04:4Sh05:2Sh06:3Sh07:4 { ySh08:1Sh09:4Sh10:2Sh11:1Sh12:5Sh13:2Sh14:6  Sh15:6 - NUMBERSINCLUSTERS:342312   ITERATION3  Y MINUS2LOGLIKELIHOOD=n364.3 } 0AIC=n434.3 SCHWARZCRITERION=n459.1  h CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: + Sh010.8750.0000.0000.1250.0000.000 Sh020.0000.0000.9990.0010.0000.000 Sh030.0001.0000.0000.0000.0000.000 8Sh040.0000.0000.1060.8940.0000.000 )\Sh050.0001.0000.0000.0000.0000.000 /HSh060.0000.0001.0000.0000.0000.000 ݵSh070.0000.0000.0980.9020.0000.000 qSh080.9010.0000.0000.0990.0000.000 _Sh090.0000.0000.0980.9020.0000.000 Sh100.0001.0000.0000.0000.0000.000 &Sh110.8330.0000.0000.1670.0000.000 `Sh120.0000.0000.0000.0001.0000.000 'Sh130.0001.0000.0000.0000.0000.000 aSh140.0000.0010.0000.0000.0000.999 d0Sh150.0000.0000.0000.0000.0001.000 hQ {+JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUB y m q -DET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDET ȫ u yPREC.MX.OFCLUSTER6HASBEENSETTOPOOLEDPREC.MX. Y } CLUSTERING:  CASESANDLABELS:-- h CSh01:1Sh02:3Sh03:2Sh04:4Sh05:2Sh06:3Sh07:4 G Sh08:1Sh09:4Sh10:2Sh11:1Sh12:5Sh13:2Sh14:6  LSh15:6 O8 \MIXINGPROBABILITIES:0.170.270.150.210.070.13 HMEANVECTORFORCLUSTER1: S4970.332100.000 WqMEANVECTORFORCLUSTER2: 24168.202512.452 ~ MEANVECTORFORCLUSTER3: 2&9843.382195.597 6MEANVECTORFORCLUSTER4: 7006.996143.692 MEANVECTORFORCLUSTER5:014501.000300.000 QMEANVECTORFORCLUSTER6:{16550.713400.000 y COMMONCOVARIANCEMATRIX(MLE):- 630003.35211509.56111509.561230.926 YCLUSTERMEMBERSHIPOFEACH CASE:}CASELABELDATASh01:15050.000100.000hSh02:310249.000205.000 Sh03:220000.000450.000Sh04:47420.000150.000 Sh05:224685.000500.000<Sh06:310206.000200.000&Sh07:47325.000150.0008Sh08:14958.000100.000\Sh09:47162.000150.000$HSh10:224000.000500.000^Sh11:14900.000100.000qSh12:514501.000300.000Sh13:228000.000600.000,Sh14:617002.000400.000?&Sh15:616100.000400.000CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION3.#=0bQCLUSTER1f{ Sh01y Sh08 Sh11kCLUSTER2o- Sh03 Sh05 Sh10s Sh13wCLUSTER3zY Sh02[} Sh06CLUSTER4 Sh04h Sh07] Sh09ACLUSTER5E Sh12ICLUSTER6 Sh14}8 Sh15M\QH& ...............................................................................\qUYK=7CLUSTERS&0NUMBEROFPARAMETERS=B4148INITIAL MEANS0Q{yMEANVECTORFORCLUSTER1: 5050.100.-MEANVECTORFORCLUSTER2: 20000.450.Y}MEANVECTORFORCLUSTER3: 24685.500.h MEANVECTORFORCLUSTER4: 4958.100.(8\HMEANVECTORFORCLUSTER5: 24000.500.)q/ݝ&MEANVECTORFORCLUSTER6:_ 14501.300.0@QMEANVECTORFORCLUSTER7:{ 16100.400.dyh ITERATION1- MINUS2LOGLIKELIHOOD=n648.8m 0AIC=n730.8qSCHWARZCRITERION=n759.9tYCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:x}Sh010.2040.0000.0000.7960.0000.0000.000Sh020.0000.0000.0000.0000.0001.0000.000hSh030.0001.0000.0000.0000.0000.0000.000Sh040.2660.0000.0000.7340.0000.0000.000٨Sh050.0000.0000.5920.0000.4080.0000.000 Sh060.0010.0000.0000.0010.0000.9980.000CSh070.2630.0000.0000.7370.0000.0000.000GSh080.2020.0000.0000.7980.0000.0000.0008Sh090.2590.0000.0000.7410.0000.0000.000\Sh100.0000.0000.4080.0000.5920.0000.000KHSh110.2000.0000.0000.8000.0000.0000.000OSh120.0000.0000.0000.0000.0001.0000.000qSh130.0000.0000.9820.0000.0180.0000.000Sh140.0000.0000.0000.0000.0000.0001.000SSh150.0000.0000.0000.0000.0000.0001.000W& CLUSTERING:250 CASESANDLABELS:--9Q{Sh01:4Sh02:6Sh03:2Sh04:4Sh05:3Sh06:6Sh07:4y Sh08:4Sh09:4Sh10:5Sh11:4Sh12:6Sh13:3Sh14:7 -Sh15:7 NUMBERSINCLUSTERS:0126132 ITERATION2Y} MINUS2LOGLIKELIHOOD=n315.4 0AIC=n397.4SCHWARZCRITERION=n426.4hCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:  Sh010.2010.0000.0000.7990.0000.0000.000Sh020.0000.0000.0000.0000.0001.0000.0008Sh030.0001.0000.0000.0000.0000.0000.000.\Sh040.2750.0000.0000.7250.0000.0000.000|HSh050.0000.0000.3210.0000.6790.0000.000Sh060.0000.0000.0000.0000.0001.0000.000qSh070.2560.0000.0000.7440.0000.0000.000$Sh080.1950.0000.0000.8050.0000.0000.000^Sh090.2690.0000.0000.7310.0000.0000.000&Sh100.0000.0000.1310.0000.8690.0000.000Sh110.1990.0000.0000.8010.0000.0000.000,Sh120.0000.0000.0000.0000.0001.0000.000?Sh130.0000.0001.0000.0000.0000.0000.0000Sh140.0000.0000.0000.0000.0000.0001.000QSh150.0000.0000.0000.0000.0000.0001.000:{ Ŏ=y+JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUBbf-DET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDETkoPREC.MX.OFCLUSTER2HASBEENSETTOPOOLEDPREC.MX.Y~}+JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUBvz[hDET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDET ]PREC.MX.OFCLUSTER7HASBEENSETTOPOOLEDPREC.MX.AD8H\ CLUSTERING:H} CASESANDLABELS:--MqQSh01:4Sh02:6Sh03:2Sh04:4Sh05:5Sh06:6Sh07:4\&Sh08:4Sh09:4Sh10:5Sh11:4Sh12:6Sh13:3Sh14:7UYSh15:70NUMBERSINCLUSTERS:01162323Q7{ ITERATION3y MINUS2LOGLIKELIHOOD=n363.0 0AIC=n445.0-SCHWARZCRITERION=n474.0 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:YSh010.1970.0000.0000.8030.0000.0000.000}Sh020.0000.0000.0000.0000.0001.0000.000Sh030.0001.0000.0000.0000.0000.0000.000Sh040.2780.0000.0000.7220.0000.0000.000hSh050.0000.0000.0000.0001.0000.0000.000Sh060.0000.0000.0000.0000.0001.0000.000Sh070.2570.0000.0000.7430.0000.0000.000 Sh080.1890.0000.0000.8110.0000.0000.000Sh090.2820.0000.0000.7180.0000.0000.000Sh100.0000.0000.0000.0001.0000.0000.0008Sh110.1940.0000.0000.8060.0000.0000.000\Sh120.0000.0000.0000.0000.0001.0000.000HSh130.0000.0001.0000.0000.0000.0000.000(Sh140.0000.0000.0000.0000.0000.0001.000qSh150.0000.0000.0000.0000.0000.0001.000+JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUB)&/DET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDET%0Q{PREC.MX.OFCLUSTER5HASBEENSETTOPOOLEDPREC.MX.y@ CLUSTERING:d-h CASESANDLABELS:--Sh01:4Sh02:6Sh03:2Sh04:4Sh05:5Sh06:6Sh07:4mpYSh08:4Sh09:4Sh10:5Sh11:4Sh12:6Sh13:3Sh14:7}Sh15:7txhMIXINGPROBABILITIES:0.090.070.070.310.130.200.13MEANVECTORFORCLUSTER1:6332.804129.233 MEANVECTORFORCLUSTER2:20000.000450.000MEANVECTORFORCLUSTER3:827999.993600.000B\MEANVECTORFORCLUSTER4:FH6076.078123.716˵MEANVECTORFORCLUSTER5:q24342.500500.000KMEANVECTORFORCLUSTER6:O11652.002235.000&MEANVECTORFORCLUSTER7:16551.000400.000SWZ0COMMONCOVARIANCEMATRIX(MLE):Q1{308139.2226690.5935y6690.593148.6399-CLUSTERMEMBERSHIPOFEACH CASE: CASELABELDATA Sh01:45050.000100.000Sh02:610249.000205.000YSh03:220000.000450.000}Sh04:47420.000150.000Sh05:524685.000500.000Sh06:610206.000200.000hSh07:47325.000150.000Sh08:44958.000100.000Sh09:47162.000150.000 Sh10:524000.000500.000Sh11:44900.000100.000Sh12:614501.000300.0008Sh13:328000.000600.000\Sh14:717002.000400.000HSh15:716100.000400.000.qCONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION3.|&CLUSTER1$CLUSTER2^ Sh03CLUSTER30 Sh13QCLUSTER4>{ Sh01y Sh04 Sh07: Sh08=- Sh09b Sh11fCLUSTER5 Sh05 Sh10jYCLUSTER6n} Sh02r Sh06 Sh12~hCLUSTER7v Sh14z Sh15[ & ...............................................................................8\{HK=8CLUSTERSDHqNUMBEROFPARAMETERS=B47}INITIAL MEANSM&Q\MEANVECTORFORCLUSTER1:T0 5050.100.XQ{y3MEANVECTORFORCLUSTER2:7 20000.450.-MEANVECTORFORCLUSTER3: 24685.500.Y}MEANVECTORFORCLUSTER4:h 7325.150. MEANVECTORFORCLUSTER5: 7162.150.8\ żHMEANVECTORFORCLUSTER6:q 4900.100.(&MEANVECTORFORCLUSTER7: 28000.600.)-0Q{MEANVECTORFORCLUSTER8:%y 16100.400.׌ ITERATION1-@ MINUS2LOGLIKELIHOOD=n548.4 0AIC=n642.4dSCHWARZCRITERION=n675.6hY}CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:lpSh010.2050.0000.0000.0000.0000.7950.0000.000hSh020.0000.0000.0000.8310.1690.0000.0000.000Sh030.0001.0000.0000.0000.0000.0000.0000.000tSh040.0000.0000.0000.5230.4770.0000.0000.000x Sh050.0000.0001.0000.0000.0000.0000.0000.000Sh060.0000.0000.0000.8270.1730.0000.0000.000Sh070.0000.0000.0000.5110.4890.0000.0000.0008Sh080.1980.0000.0000.0000.0000.8020.0000.000\Sh090.0000.0000.0000.4890.5110.0000.0000.000HSh100.0000.0001.0000.0000.0000.0000.0000.000صSh110.1940.0000.0000.0000.0000.8060.0000.000BqSh120.0000.0000.0000.0000.0000.0000.0001.000FSh130.0000.0000.0000.0000.0000.0001.0000.000˝Sh140.0000.0000.0000.0000.0000.0000.0001.000&Sh150.0000.0000.0000.0000.0000.0000.0001.000KO CLUSTERING:0Q CASESANDLABELS:--V{ZySh01:6Sh02:4Sh03:2Sh04:4Sh05:3Sh06:4Sh07:41Sh08:6Sh09:5Sh10:3Sh11:6Sh12:8Sh13:7Sh14:85-9Sh15:8NUMBERSINCLUSTERS:0124131 Y ITERATION2 } MINUS2LOGLIKELIHOOD=u88.1 0AIC=n182.1hSCHWARZCRITERION=n215.4 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:Sh010.1300.0000.0000.0000.0000.8700.0000.0008Sh020.0000.0000.0000.9000.1000.0000.0000.000\Sh030.0001.0000.0000.0000.0000.0000.0000.000HSh040.0000.0000.0000.4970.5030.0000.0000.000Sh050.0000.0001.0000.0000.0000.0000.0000.000qSh060.0000.0000.0000.8640.1360.0000.0000.000Sh070.0000.0000.0000.4690.5310.0000.0000.000Sh080.1250.0000.0000.0000.0000.8750.0000.000.&Sh090.0000.0000.0000.4450.5550.0000.0000.000|Sh100.0000.0001.0000.0000.0000.0000.0000.000Sh110.1220.0000.0000.0000.0000.8780.0000.000Sh120.0000.0000.0000.0000.0000.0000.0001.000!0Sh130.0000.0000.0000.0000.0000.0001.0000.000;QSh140.0000.0000.0000.0000.0000.0000.0001.000{Sh150.0000.0000.0000.0000.0000.0000.0001.000y+JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUB>-:DET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDET=beYPREC.MX.OFCLUSTER1HASBEENSETTOPOOLEDPREC.MX.i}+JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUBjnhrDET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDET~ vzPREC.MX.OFCLUSTER2HASBEENSETTOPOOLEDPREC.MX.8\+JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUBHq{DET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDETDH&PREC.MX.OFCLUSTER3HASBEENSETTOPOOLEDPREC.MX.}M+JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUBP0Q{TyDET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDETX-PREC.MX.OFCLUSTER7HASBEENSETTOPOOLEDPREC.MX.37 CLUSTERING: Y CASESANDLABELS:-- } Sh01:6Sh02:4Sh03:2Sh04:5Sh05:3Sh06:4Sh07:5  hSh08:6Sh09:5Sh10:3Sh11:6Sh12:8Sh13:7Sh14:8  Sh15:8  NUMBERSINCLUSTERS:0122331  8 ITERATION3 \ H MINUS2LOGLIKELIHOOD=n161.5  0AIC=n255.5 qSCHWARZCRITERION=n288.8  &CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:  (Sh010.0000.0000.0000.0000.0001.0000.0000.000 Sh020.0000.0000.0000.9750.0250.0000.0000.000 ] 0Sh030.0001.0000.0000.0000.0000.0000.0000.000 QSh040.0000.0000.0000.4370.5630.0000.0000.000 *{Sh050.0000.0001.0000.0000.0000.0000.0000.000 -ySh060.0000.0000.0000.9380.0620.0000.0000.000 Sh070.0000.0000.0000.3990.6010.0000.0000.000 Sh080.0000.0000.0000.0000.0001.0000.0000.000 %-Sh090.0000.0000.0000.3660.6340.0000.0000.000 ׫Sh100.0000.0001.0000.0000.0000.0000.0000.000 Sh110.0000.0000.0000.0000.0001.0000.0000.000 Sh120.0000.0000.0000.0000.0000.0000.0001.000 @Sh130.0000.0000.0000.0000.0000.0001.0000.000 "YSh140.0000.0000.0000.0000.0000.0000.0001.000 c}Sh150.0000.0000.0000.0000.0000.0000.0001.000 g +JFLG=1.IFJFLG=0,COMPUTATIONOFDETWENT WELL;OTHERWISE, THEREWAS TROUB h l p DET=0.00000E+00IDET=0ACTUALDET.=DET*10**IDET  t w8PREC.MX.OFCLUSTER6HASBEENSETTOPOOLEDPREC.MX. \ H CLUSTERING: q  CASESANDLABELS:-- ؝ B&Sh01:6Sh02:4Sh03:2Sh04:5Sh05:3Sh06:4Sh07:5 F Sh08:6Sh09:5Sh10:3Sh11:6Sh12:8Sh13:7Sh14:8  J0Sh15:8 NQ R{MIXINGPROBABILITIES:0.000.070.130.210.130.200.070.20 yMEANVECTORFORCLUSTER1: 7166.031150.000 VMEANVECTORFORCLUSTER2: Z-20000.000450.000 MEANVECTORFORCLUSTER3: 124342.500500.000 5MEANVECTORFORCLUSTER4: 99101.631182.266 YMEANVECTORFORCLUSTER5:}7431.921152.370MEANVECTORFORCLUSTER6:4969.333100.000 hMEANVECTORFORCLUSTER7:28000.000600.000MEANVECTORFORCLUSTER8: 15867.667366.6678COMMONCOVARIANCEMATRIX(MLE):\H138376.8183495.8793495.879119.130qCLUSTERMEMBERSHIPOFEACH CASE:&CASELABELDATASh01:65050.000100.000.Sh02:410249.000205.000+0Sh03:220000.000450.000QSh04:57420.000150.000{Sh05:324685.000500.000!ySh06:410206.000200.000;Sh07:57325.000150.000Sh08:64958.000100.000-Sh09:57162.000150.000Sh10:324000.000500.000>Sh11:64900.000100.000Sh12:814501.000300.000Sh13:728000.000600.000`YSh14:817002.000400.000'}Sh15:816100.000400.000aeCONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION3.ihjCLUSTER1n CLUSTER2r Sh03CLUSTER38 Sh05u\ Sh10yHCLUSTER4ڵ Sh02q Sh06CLUSTER5 Sh04& Sh07{ Sh09DCLUSTER6H Sh010 Sh08Q Sh11L{CLUSTER7Py Sh13CLUSTER8 Sh12T- Sh14X Sh15& ...............................................................................36Y}K=9CLUSTERShNUMBEROFPARAMETERS=B53INITIAL MEANS 8MEANVECTORFORCLUSTER1:\ 5050.100. HqMEANVECTORFORCLUSTER2: 10249.205.&MEANVECTORFORCLUSTER3:0 7420.150.