@YMIXPDTACLUSPAC-MIXTURE-MODELCLUSTERINGOF CASES}VARYINGCOVARIANCEMATRICES AUTOMATICSETTINGOFINITIALPARAMETERESTIMATESCopyright(C)StanleyL.SclovehDevelopedandprogrammedby:0Prof.StanleyL.Sclove, Ph.D.Phone (312)996-26810.Information&DecisionSciences Dept.M/C294 0CollegeofBusinessAdministration0UniversityofIllinoisatChicago0Box 4348,Chicago,IL60680-43488ProgramVersion:2.617-Dec-89\0(VM/CMS)H ................................................................................PROBLEM TITLEISqFISHERIRISDATA (IRISDATSRTC1)12/23/1989AT0:37:55NUMBEROFVARIABLES............/4&NUMBEROFOBSERVATIONS(SAMPLESIZE),N..150MINIMUMFOREACHVARIABLE:+4.32.01.00.1MAXIMUMFOREACHVARIABLE:07.94.46.92.5Q FIRSTFOURDATAPOINTS){ -------------------/y 4.33.01.10.1CAS0݌ 4.43.21.30.2CAS0 4.43.01.30.2CAS0_- 4.42.91.40.2CAS0NUMBEROFCLUSTERSTOREPORT........1TO9STATISTICSFOR WHOLE(UNCLUSTERED)SAMPLE:`MEANVECTOR:5.843.063.761.20'COVARIANCEMATRIX:Yn0.681-0.042e1.266e0.513d}f-0.042e0.189-0.327-0.121hn1.266-0.327e3.095e1.287n0.513-0.121e1.287e0.577h MINUS2LOGLIKELIHOOD=n759.8mNUMBEROFPARAMETERS=B14q 0AIC=n787.8 SCHWARZCRITERION=n830.0 ................................................................................uK=2CLUSTERSx8NUMBEROFPARAMETERS=B29\INITIAL MEANSHMEANVECTORFORCLUSTER1:4.33.01.10.1qMEANVECTORFORCLUSTER2:5.84.01.20.2ĝ ITERATION1C& MINUS2LOGLIKELIHOOD=f3160.1G0AIC=f3218.1SCHWARZCRITERION=f3305.4CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:K0POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:OQ0.830.17{0.810.19y0.840.16S0.860.14WNUMBERSINCLUSTERS:13515- ITERATION2 MINUS2LOGLIKELIHOOD=n745.32 0AIC=n803.36SCHWARZCRITERION=n890.6CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:YPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:}0.790.21 0.770.230.800.20 h0.830.17NUMBERSINCLUSTERS:12327 ITERATION3  MINUS2LOGLIKELIHOOD=n725.1 0AIC=n783.1SCHWARZCRITERION=n870.48CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:\POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:H0.680.320.660.34q0.690.310.750.25NUMBERSINCLUSTERS:11436 & ITERATION4 MINUS2LOGLIKELIHOOD=n699.1 0AIC=n757.1<SCHWARZCRITERION=n844.4|0CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:QPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:{0.460.54$y0.460.54^0.480.520.560.44-NUMBERSINCLUSTERS:9951, ITERATION5? MINUS2LOGLIKELIHOOD=n673.6 0AIC=n731.6SCHWARZCRITERION=n818.9:YCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:=}POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:b0.180.82f0.190.81h0.220.780.290.71kNUMBERSINCLUSTERS:8961o ITERATION6 MINUS2LOGLIKELIHOOD=n639.1 0AIC=n697.1~8SCHWARZCRITERION=n784.4v\CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:zHPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:[0.010.99q0.010.990.020.980.040.96]&NUMBERSINCLUSTERS:8367A ITERATION7E MINUS2LOGLIKELIHOOD=n596.7I 0AIC=n654.70SCHWARZCRITERION=n742.0}QCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:M{POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:Qy0.001.000.001.00\0.001.00U-0.001.00YNUMBERSINCLUSTERS:8367 ITERATION80 MINUS2LOGLIKELIHOOD=n590.14 0AIC=n648.17YSCHWARZCRITERION=n735.4}CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: #POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.001.00h0.001.00 0.001.000.001.00 NUMBERSINCLUSTERS:8169 ITERATION9 MINUS2LOGLIKELIHOOD=n588.88 0AIC=n646.8\SCHWARZCRITERION=n734.2HCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:q0.001.000.001.000.001.00&0.001.00NUMBERSINCLUSTERS:8268 ITERATION10 MINUS2LOGLIKELIHOOD=n588.50 0AIC=n646.5(QSCHWARZCRITERION=n733.8{CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:yPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.001.00)0.001.00/-0.001.00ݫ0.001.00NUMBERSINCLUSTERS:8169_ ITERATION11 MINUS2LOGLIKELIHOOD=n588.4Y 0AIC=n646.4}SCHWARZCRITERION=n733.7@CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:dh0.001.00h0.001.000.001.00 0.001.00mMIXINGPROBABILITIES:0.530.47qMEANVECTORFORCLUSTER1:8e6.145e2.883e4.861e1.711\MEANVECTORFORCLUSTER2:tHe5.510e3.250e2.539e0.634xCOMMONCOVARIANCEMATRIX(MLE):qn0.285e0.011e0.436e0.167n0.011e0.077-0.051-0.008n0.436-0.051e0.847e0.322&n0.167-0.008e0.322e0.142CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION11.CLUSTER1C CAS0F0 CAS1Q CAS0{ CAS0Ky CAS0O CAS0 CAS0- CAS0S CAS0W CAS0 CAS0 CAS01Y CAS05} CAS09 CAS0 CAS0h CAS0 CAS1 CAS0 CAS0 CAS1  CAS18 CAS0\ CAS0H CAS1 CAS0q CAS1 CAS1 CAS0& CAS1 CAS0 CAS0  CAS00 CAS0Q CAS0.{ CAS0|y CAS1 CAS1 CAS0$- CAS0^ CAS0 CAS0 CAS1, CAS0>Y CAS1} CAS1 CAS1: CAS1=h CAS0b CAS1f CAS1 CAS0 CAS1k CAS1n8 CAS0r\ CAS1H CAS1~ CAS1vq CAS1z CAS0[ CAS1& CAS1 CAS1 CAS0] CAS1{0 CAS1DQ CAS1H{ CAS1y CAS1} CAS1M CAS0Q- CAS1 CAS1\ CAS1U CAS1Y CAS1Y CAS1} CAS13 CAS17 CAS1h CAS1CLUSTER2 CAS0 CAS0  CAS0 CAS08 CAS0\ CAS0H CAS0 CAS0q CAS0 CAS0 CAS0& CAS0 CAS0 CAS0 CAS00 CAS0Q CAS0{ CAS0y CAS0( CAS0 CAS0- CAS0 CAS0) CAS0/ CAS0 CAS0Y CAS0%} CAS0׼ CAS0 CAS0h CAS0@ CAS0 CAS0d CAS0h CAS0 CAS08 CAS0l\ CAS0pH CAS0 CAS0q CAS0t CAS0x CAS0& CAS0 CAS0 CAS0 CAS00 CAS0Q CAS0B{ CAS0Fy CAS0ˌ CAS1 CAS0K- CAS0O CAS0 CAS0 CAS1S CAS0VY CAS0Z} CAS0 CAS01 CAS05h CAS19 CAS1 CAS1  CAS1  CAS1  CAS1 8 CAS1 \ ................................................................................ HK=3CLUSTERS NUMBEROFPARAMETERS=B44 qINITIAL MEANS MEANVECTORFORCLUSTER1: 4.33.01.10.1 &MEANVECTORFORCLUSTER2: 5.43.41.70.2 MEANVECTORFORCLUSTER3: 6.33.36.02.5 0 ITERATION1 Q MINUS2LOGLIKELIHOOD=f1578.7 {0AIC=f1666.7 ySCHWARZCRITERION=f1799.2 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: .POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: |-0.550.450.00 0.510.490.00 0.510.490.00 $0.500.500.00 ^NUMBERSINCLUSTERS:45195 Y ITERATION2 } MINUS2LOGLIKELIHOOD=n545.4 0AIC=n633.4 >SCHWARZCRITERION=n765.9 hCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: :0.550.450.00 = 0.540.460.00 b0.560.440.00 f0.560.440.00 i8NUMBERSINCLUSTERS:94299 \ ITERATION3 jH MINUS2LOGLIKELIHOOD=n488.6 n 0AIC=n576.6 Ť rqSCHWARZCRITERION=n709.1 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: ~POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: v&0.670.330.00 z0.720.280.00 [0.760.240.00 0.760.240.00 0NUMBERSINCLUSTERS:3812100 Q ITERATION4 { MINUS2LOGLIKELIHOOD=n442.7 {y 0AIC=n530.7 DSCHWARZCRITERION=n663.2 HCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: -POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: }0.730.270.00 M0.850.150.00 Q0.900.100.00 0.910.090.00 YNUMBERSINCLUSTERS:428100 T} ITERATION5 X MINUS2LOGLIKELIHOOD=n419.0 0AIC=n507.0 hSCHWARZCRITERION=n639.5 3CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: 7POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: 0.780.220.00 0.850.150.000.920.080.0080.940.060.00\NUMBERSINCLUSTERS:3911100H ITERATION6 MINUS2LOGLIKELIHOOD=n414.0q 0AIC=n502.0SCHWARZCRITERION=n634.5CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:&POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.840.160.000.890.110.000.950.050.0000.970.030.00QNUMBERSINCLUSTERS:3812100{ ITERATION7y MINUS2LOGLIKELIHOOD=n410.5 0AIC=n498.5SCHWARZCRITERION=n631.0-CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:(POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.900.100.000.930.070.000.970.030.00*Y0.980.020.00-}NUMBERSINCLUSTERS:3713100 ITERATION8 MINUS2LOGLIKELIHOOD=n407.4%h 0AIC=n495.4SCHWARZCRITERION=n627.8CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:@0.940.060.000.950.050.00c80.980.020.00g\0.980.020.00H MIXINGPROBABILITIES:0.220.110.67ŵMEANVECTORFORCLUSTER1:lqe4.917e3.316e1.438e0.202pMEANVECTORFORCLUSTER2:e5.180e3.648e1.509e0.331&MEANVECTORFORCLUSTER3:te6.262e2.872e4.906e1.676xCOMMONCOVARIANCEMATRIX(MLE):n0.200e0.059e0.200e0.0740n0.059e0.056e0.063e0.035Qn0.200e0.063e0.301e0.127{n0.074e0.035e0.127e0.080yCONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION8.،CLUSTER1B CAS0F- CAS0˫ CAS0 CAS0K CAS0O CAS0RY CAS0} CAS0 CAS0V CAS0Zh CAS0 CAS01 CAS05 CAS09 CAS0 CAS08 CAS0\ CAS0H CAS0 CAS0q CAS0 CAS0 CAS0& CAS0 CAS0 CAS0 CAS00 CAS0Q CAS0{ CAS0y CAS0 CAS0 CAS0- CAS0 CAS0. CAS0| CAS0CLUSTER2Y CAS0!} CAS0; CAS0 CAS0h CAS0 CAS0> CAS0 CAS0 CAS0: CAS0'8 CAS0a\ CAS0eH CAS0iCLUSTER3q CAS0j CAS1n CAS0r& CAS0 CAS0~ CAS0v CAS0y0 CAS0Q CAS0{ CAS0y CAS0 CAS0 CAS0{- CAS0D CAS0H CAS0 CAS0} CAS1LY CAS0P} CAS0 CAS0 CAS1Th CAS1X CAS0 CAS0 CAS13 CAS07 CAS18 CAS1\ CAS0H CAS1 CAS0q CAS0 CAS0 CAS0& CAS0 CAS1 CAS0 CAS1 0 CAS1Q CAS0{ CAS0y CAS0 CAS0 CAS1- CAS0 CAS1 CAS0 CAS1( CAS1&Y CAS1} CAS0 CAS1* CAS1-h CAS0 CAS1 CAS1% CAS0 CAS1 CAS18 CAS1#\ CAS1"H CAS0c CAS0gq CAS1 CAS1ŝ CAS1l& CAS0p CAS1 CAS1 CAS0s0 CAS0wQ CAS1{ CAS1y CAS1 CAS0 CAS1- CAS1ث CAS0B CAS0F CAS1 CAS1Y CAS0J} CAS1N CAS0R CAS1h CAS1 CAS0V CAS1Z CAS1 CAS11 CAS148 CAS18\ CAS1H CAS1 CAS1q CAS1 CAS1 CAS1& CAS1 ................................................................................K=4CLUSTERSNUMBEROFPARAMETERS=B590INITIAL MEANS jQMEANVECTORFORCLUSTER1:{4.33.01.10.1yMEANVECTORFORCLUSTER2:5.13.31.70.5MEANVECTORFORCLUSTER3:-5.82.85.12.4MEANVECTORFORCLUSTER4:6.42.75.31.9 ITERATION1 MINUS2LOGLIKELIHOOD=f1420.3Y0AIC=f1538.3+}SCHWARZCRITERION=f1715.9CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:!h0.410.590.000.00;0.380.620.000.00ߨ0.380.620.000.00 0.370.630.000.00NUMBERSINCLUSTERS:0516930> ITERATION28 MINUS2LOGLIKELIHOOD=n490.9\ 0AIC=n608.9`HSCHWARZCRITERION=n786.5'CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:aqPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:e0.450.550.000.00i0.480.520.000.00&0.490.510.000.00j0.490.510.000.00nNUMBERSINCLUSTERS:0508119r ITERATION30 MINUS2LOGLIKELIHOOD=n412.1Q 0AIC=n530.1u{SCHWARZCRITERION=n707.7yyCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:ڌPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.460.540.000.00-0.550.450.000.000.570.430.000.000.560.440.000.00{NUMBERSINCLUSTERS:10407624D ITERATION4GY MINUS2LOGLIKELIHOOD=n395.7} 0AIC=n513.7SCHWARZCRITERION=n691.3LCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:PhPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.540.460.000.000.620.380.000.00T 0.660.340.000.00X0.640.360.000.00NUMBERSINCLUSTERS:212976248 ITERATION52\ MINUS2LOGLIKELIHOOD=n381.96H 0AIC=n499.9SCHWARZCRITERION=n677.5qCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.640.360.000.00&0.750.250.000.000.790.210.000.000.750.250.000.00NUMBERSINCLUSTERS:282273270 ITERATION6Q MINUS2LOGLIKELIHOOD=n369.5{ 0AIC=n487.5 ySCHWARZCRITERION=n665.1CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:-0.740.260.000.000.860.140.000.000.890.110.000.000.850.150.000.00NUMBERSINCLUSTERS:28227228Y ITERATION7} MINUS2LOGLIKELIHOOD=n361.7< 0AIC=n479.7&SCHWARZCRITERION=n657.4hCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:*0.820.180.000.00- 0.910.090.000.000.940.060.000.000.910.090.000.00,8NUMBERSINCLUSTERS:31197129?\ ITERATION8H MINUS2LOGLIKELIHOOD=n357.6ֵ 0AIC=n475.6#qSCHWARZCRITERION=n653.3"CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:cPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:g&0.900.100.000.000.940.060.000.000.960.040.000.00l0.940.060.000.00o0NUMBERSINCLUSTERS:32187129Q ITERATION9{ MINUS2LOGLIKELIHOOD=n354.8sy 0AIC=n472.8wSCHWARZCRITERION=n650.4CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:-POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.970.030.000.000.970.030.000.000.980.020.000.000.950.050.000.00AYNUMBERSINCLUSTERS:32187030E} ITERATION10I MINUS2LOGLIKELIHOOD=n353.2 0AIC=n471.2JhSCHWARZCRITERION=n648.8NCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:RPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: 0.990.010.000.000.990.010.000.00V0.990.010.000.00Y80.970.030.000.00\NUMBERSINCLUSTERS:331769310H ITERATION114 MINUS2LOGLIKELIHOOD=n352.48q 0AIC=n470.4SCHWARZCRITERION=n648.0 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: &POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: 0.990.010.000.00 0.990.010.000.00 0.990.010.000.00 00.970.030.000.00 d QNUMBERSINCLUSTERS:31196832 { ITERATION12 y MINUS2LOGLIKELIHOOD=n351.9  0AIC=n469.9 SCHWARZCRITERION=n647.5 -CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: 0.990.010.000.00 0.990.010.000.00 0.990.010.000.00 Y0.970.030.000.00 }NUMBERSINCLUSTERS:31196733 ITERATION13  MINUS2LOGLIKELIHOOD=n351.7 +h 0AIC=n469.7 SCHWARZCRITERION=n647.3 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: ! POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: ;0.990.010.000.00 0.990.010.000.00 80.990.010.000.00 \0.970.030.000.00 _HNUMBERSINCLUSTERS:31196436 ITERATION14 q MINUS2LOGLIKELIHOOD=n351.5 ` 0AIC=n469.5 'SCHWARZCRITERION=n647.1 a&CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: ePOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: i0.990.010.000.00 0.990.010.000.00 00.990.010.000.00 mQ0.970.030.000.00 q{MIXINGPROBABILITIES:0.180.150.410.25 yMEANVECTORFORCLUSTER1: Ȍe4.874e3.298e1.420e0.195 uMEANVECTORFORCLUSTER2: y-e5.167e3.585e1.513e0.308 ګMEANVECTORFORCLUSTER3: e6.249e2.949e4.930e1.787 MEANVECTORFORCLUSTER4: e6.284e2.746e4.867e1.495 YCOMMONCOVARIANCEMATRIX(MLE): }n0.097e0.030e0.090e0.035 Cn0.030e0.028e0.029e0.015 Gn0.090e0.029e0.140e0.063 hn0.035e0.015e0.063e0.039 CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION14. LCLUSTER1 P CAS0  CAS0  CAS0 S8 CAS0 W\ CAS0 H CAS0 CAS0 2q CAS0 6 CAS0 CAS0 & CAS0  CAS0  CAS0  CAS0 0 CAS0 Q CAS0 { CAS0 y CAS0  CAS0  CAS0 - CAS0  CAS0  CAS0  CAS0  CAS0 Y CAS0 } CAS0 CAS0 CAS0 h CAS0 < CAS0 &CLUSTER2 CAS0  CAS0 * CAS0 ^8 CAS0 \ CAS0 H CAS0 , CAS0 ?q CAS0 CAS0 ֝ CAS0 #& CAS0 " CAS0 c CAS0 g CAS0 0 CAS0 Q CAS0 k{ CAS0 oy CAS0 CAS0 CLUSTER3 s- CAS1 w CAS0  CAS0  CAS0 CAS0 Y CAS0 } CAS1 ] CAS0 A CAS0 Eh CAS1 I CAS1 CAS0 J CAS1 N CAS1 R CAS1 8 CAS0 \\ CAS1 UH CAS0 Y CAS0 q CAS0 0 CAS0 4 CAS1 8& CAS0  CAS0  CAS0  CAS1 0 CAS1 Q CAS0 { CAS1 y CAS1  CAS1  CAS1 - CAS0  CAS1  CAS1  CAS1  CAS1 Y CAS0 } CAS0  CAS1  CAS1 h CAS0 CAS1 CAS1 + CAS0  CAS0  CAS1 8 CAS1 )\ CAS0 /H CAS1 ݵ CAS1 q CAS0 _ CAS0 CAS1 & CAS1 ` CAS0 ' CAS1 a CAS0 d0 CAS1 hQ CAS1 { CAS0 y CAS1 m CAS1 q CAS1 -CLUSTER4 ȫ CAS0 u CAS0 y CAS0 CAS0 Y CAS0 } CAS0 CAS0 CAS0 h CAS0 C CAS0 G CAS0 CAS0  CAS0 L CAS0 O8 CAS0 \ CAS0 H CAS1 S CAS1 Wq CAS0 CAS0 CAS0 2& CAS1 6 CAS1  CAS0  CAS10 CAS1 Q CAS1{ CAS1 y CAS1 CAS1 CAS1- CAS1 CAS1 CAS1  CAS1 CAS1Y ................................................................................}K=5CLUSTERSNUMBEROFPARAMETERS=B74INITIAL MEANShMEANVECTORFORCLUSTER1: 4.33.01.10.1MEANVECTORFORCLUSTER2: 5.03.41.50.2<MEANVECTORFORCLUSTER3:&5.62.53.91.18MEANVECTORFORCLUSTER4:\6.12.94.71.4$HMEANVECTORFORCLUSTER5:^6.63.04.41.4q ITERATION1 MINUS2LOGLIKELIHOOD=f1371.8,0AIC=f1519.8?&SCHWARZCRITERION=f1742.6CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:#0.370.630.000.000.00=00.340.650.000.000.00bQ0.350.640.010.000.00f{0.350.640.010.000.00yNUMBERSINCLUSTERS:05034660 ITERATION2k MINUS2LOGLIKELIHOOD=n435.0o- 0AIC=n583.0 ŮSCHWARZCRITERION=n805.8CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:sPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:w0.400.600.000.000.00zY0.370.630.000.000.00[}0.380.620.000.000.000.360.640.000.000.00NUMBERSINCLUSTERS:05040600h ITERATION3] MINUS2LOGLIKELIHOOD=n415.8A 0AIC=n563.8E SCHWARZCRITERION=n786.6ICASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:}80.510.490.000.000.00M\0.420.580.000.000.00QH0.420.580.000.000.000.370.630.000.000.00\qNUMBERSINCLUSTERS:24854460U ITERATION4Y MINUS2LOGLIKELIHOOD=n404.0& 0AIC=n552.00SCHWARZCRITERION=n774.84CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:8POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:00.700.300.000.000.00Q0.530.470.000.000.00{0.520.480.000.000.00y0.410.590.000.000.00 NUMBERSINCLUSTERS:54556413 ITERATION5- MINUS2LOGLIKELIHOOD=n387.3 0AIC=n535.3SCHWARZCRITERION=n758.1CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:Y0.890.110.000.000.00}0.710.290.000.000.000.700.300.000.000.000.500.500.000.000.00hNUMBERSINCLUSTERS:104055423 ITERATION6 MINUS2LOGLIKELIHOOD=n369.5 0AIC=n517.5SCHWARZCRITERION=n740.3CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:(8POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:\0.970.030.000.000.00H0.890.110.000.000.000.870.130.000.000.00)q0.640.360.000.000.00/NUMBERSINCLUSTERS:163455405ݝ ITERATION7& MINUS2LOGLIKELIHOOD=n356.7_ 0AIC=n504.7SCHWARZCRITERION=n727.4CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:0POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:@Q0.990.010.000.000.00{0.960.040.000.000.00dy0.950.050.000.000.00h0.790.210.000.000.00NUMBERSINCLUSTERS:193153425- ITERATION8m MINUS2LOGLIKELIHOOD=n347.5q 0AIC=n495.5SCHWARZCRITERION=n718.3CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:tYPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:x}0.990.010.000.000.000.980.020.000.000.000.970.030.000.000.00h0.870.130.000.000.00NUMBERSINCLUSTERS:232755387٨ ITERATION9  MINUS2LOGLIKELIHOOD=n341.6C 0AIC=n489.6GSCHWARZCRITERION=n712.48CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:\POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:KH0.990.010.000.000.00O0.980.020.000.000.00q0.980.020.000.000.000.910.090.000.000.00SNUMBERSINCLUSTERS:262456368W& ITERATION10 MINUS2LOGLIKELIHOOD=n338.2 0AIC=n486.22SCHWARZCRITERION=n709.050CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:9QPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:{0.990.010.000.000.00y0.980.020.000.000.00 0.980.020.000.000.000.930.070.000.000.00 -NUMBERSINCLUSTERS:2624553510 ITERATION11  MINUS2LOGLIKELIHOOD=n336.2 0AIC=n484.2SCHWARZCRITERION=n707.0YCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:}POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.980.020.000.000.000.980.020.000.000.00h0.980.020.000.000.000.940.060.000.000.00NUMBERSINCLUSTERS:2723573310 ITERATION12  MINUS2LOGLIKELIHOOD=n334.7 0AIC=n482.78SCHWARZCRITERION=n705.5.\CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:|HPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.970.030.000.000.00q0.990.010.000.000.00$0.980.020.000.000.00^0.940.060.000.000.00&NUMBERSINCLUSTERS:2822563311 f ITERATION13, MINUS2LOGLIKELIHOOD=n333.5? 0AIC=n481.50SCHWARZCRITERION=n704.3QCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP::{POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:=y0.970.030.000.000.00b0.990.010.000.000.00f0.980.020.000.000.00-0.950.050.000.000.00NUMBERSINCLUSTERS:2921553213k ITERATION14o MINUS2LOGLIKELIHOOD=n332.6 0AIC=n480.6YSCHWARZCRITERION=n703.4~}CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:vPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:z0.960.040.000.000.00[h0.990.010.000.000.000.980.020.000.000.000.950.050.000.000.00 NUMBERSINCLUSTERS:2921563113] ITERATION15A MINUS2LOGLIKELIHOOD=n331.9D8 0AIC=n479.9H\SCHWARZCRITERION=n702.7HCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:}POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:Mq0.950.050.000.000.00Q0.990.010.000.000.000.980.020.000.000.00\&0.950.050.000.000.00UMIXINGPROBABILITIES:0.170.170.340.210.12YMEANVECTORFORCLUSTER1:e4.871e3.306e1.418e0.1950MEANVECTORFORCLUSTER2:3Qe5.141e3.550e1.506e0.2977{MEANVECTORFORCLUSTER3:ye6.129e2.867e4.653e1.601MEANVECTORFORCLUSTER4:e6.493e2.921e5.390e1.900-MEANVECTORFORCLUSTER5: e6.232e2.799e4.773e1.494COMMONCOVARIANCEMATRIX(MLE):n0.065e0.021e0.052e0.020n0.021e0.024e0.020e0.012Yn0.052e0.020e0.082e0.039}n0.020e0.012e0.039e0.028CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION15.CLUSTER1h CAS0 CAS0 CAS0 CAS0 CAS0 CAS08 CAS0\ CAS0H CAS0( CAS0q CAS0 CAS0 CAS0)& CAS0/ CAS0 CAS0 CAS0%0 CAS0Q CAS0{ CAS0y CAS0@ CAS0 CAS0d- CAS0h CAS0 CAS0 CAS0m CAS0pY CAS0}CLUSTER2 CAS0t CAS0xh CAS0 CAS0 CAS0 CAS0 CAS0 CAS08 CAS0B\ CAS0FH CAS0˵ CAS0q CAS0K CAS0O CAS0& CAS0 CAS0S CAS0W CAS0Z0 CAS0Q CAS01{CLUSTER35y CAS19 CAS0 CAS0- CAS0 CAS0 CAS0  CAS0 CAS0Y CAS0} CAS0 CAS1 CAS0h CAS0 CAS1 CAS1 CAS0 CAS0 CAS08 CAS1\ CAS1H CAS0 CAS0.q CAS0| CAS0 CAS0& CAS0$ CAS1^ CAS0 CAS00 CAS1Q CAS0>{ CAS1y CAS0 CAS1: CAS1=- CAS1b CAS0f CAS1 CAS0 CAS1jY CAS0n} CAS0r CAS1 CAS0~h CAS1v CAS0z CAS0[ CAS1 CAS0 CAS08 CAS0\ CAS1{H CAS0D CAS0Hq CAS0 CAS1}CLUSTER4M& CAS0Q CAS0 CAS0\ CAS1T0 CAS1XQ CAS0{ CAS1y CAS03 CAS07 CAS1- CAS1 CAS1 CAS1 CAS1 CAS1Y CAS1} CAS1 CAS1 CAS1h CAS1 CAS1 CAS1 CAS1 CAS1 CAS18 CAS1\ CAS1H CAS1 CAS1q CAS1 CAS1(CLUSTER5& CAS0 CAS0 CAS0) CAS0-0 CAS0Q CAS1{ CAS0%y CAS1׌ CAS1 CAS1- CAS1@ CAS1 CAS1d ................................................................................hK=6CLUSTERSYNUMBEROFPARAMETERS=B89}INITIAL MEANSlMEANVECTORFORCLUSTER1:p4.33.01.10.1hMEANVECTORFORCLUSTER2:5.03.51.60.6tMEANVECTORFORCLUSTER3:x 5.43.41.70.2MEANVECTORFORCLUSTER4:5.84.01.20.28MEANVECTORFORCLUSTER5:\6.33.36.02.5HMEANVECTORFORCLUSTER6:ص6.73.14.71.5Bq ITERATION1F MINUS2LOGLIKELIHOOD=f1542.6˝0AIC=f1720.6&SCHWARZCRITERION=f1988.6KCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:OPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.200.360.320.130.000.0000.180.360.330.130.000.00 "Q0.180.360.340.120.000.00V{0.180.370.350.100.000.00ZyNUMBERSINCLUSTERS:064055742 ITERATION21 MINUS2LOGLIKELIHOOD=n493.65- 0AIC=n671.69SCHWARZCRITERION=n939.5CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: 0.210.340.320.130.000.00Y0.180.300.270.250.000.00 }0.190.300.280.230.000.000.180.290.270.250.000.00NUMBERSINCLUSTERS:066385743h ITERATION3 MINUS2LOGLIKELIHOOD=n423.3 0AIC=n601.3 SCHWARZCRITERION=n869.2CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:80.290.370.290.050.000.00\0.290.250.200.260.000.00H0.300.230.180.290.000.000.240.200.160.400.000.00qNUMBERSINCLUSTERS:351415545 ITERATION4 MINUS2LOGLIKELIHOOD=n384.1.& 0AIC=n562.1|SCHWARZCRITERION=n830.1CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:!00.320.380.270.020.000.00;Q0.340.260.220.180.000.00{0.380.220.170.230.000.00y0.300.160.130.410.000.00NUMBERSINCLUSTERS:552385545> ITERATION5- MINUS2LOGLIKELIHOOD=n362.6 0AIC=n540.6:SCHWARZCRITERION=n808.6=CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:bPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:eY0.290.410.290.010.000.00i}0.430.250.210.110.000.000.530.170.130.170.000.00j0.370.120.090.410.000.00nhNUMBERSINCLUSTERS:673345446r ITERATION6 MINUS2LOGLIKELIHOOD=n342.0~ 0AIC=n520.0vSCHWARZCRITERION=n787.9zCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:8POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:\0.130.500.360.010.000.00H0.520.220.190.060.000.000.700.110.080.110.000.00q0.450.080.070.400.000.00{NUMBERSINCLUSTERS:965305248D ITERATION7H& MINUS2LOGLIKELIHOOD=n328.0 0AIC=n506.0}SCHWARZCRITERION=n774.0MCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:P0POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:Q0.020.570.410.000.000.00{0.610.180.170.030.000.00Ty0.820.070.050.060.000.00X0.540.060.050.350.000.00NUMBERSINCLUSTERS:965305347- ITERATION83 MINUS2LOGLIKELIHOOD=n319.97 0AIC=n497.9SCHWARZCRITERION=n765.9CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: YPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: }0.000.570.430.000.000.00 0.680.150.140.020.000.00 0.880.060.030.030.000.00 h0.640.050.040.270.000.00  NUMBERSINCLUSTERS:1066285446  ITERATION9   MINUS2LOGLIKELIHOOD=n314.2  0AIC=n492.2 SCHWARZCRITERION=n760.1 8CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: \POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: H0.000.580.420.000.000.00 0.710.140.130.010.000.00 q0.910.050.020.020.000.00 0.720.050.030.210.000.00 NUMBERSINCLUSTERS:1267255446 & ITERATION10  MINUS2LOGLIKELIHOOD=n309.3 ( 0AIC=n487.3 SCHWARZCRITERION=n755.3 0CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: QPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: *{0.000.630.370.000.000.00 -y0.710.160.120.010.000.00 0.920.060.020.010.000.00 0.760.050.020.170.000.00 %- NUMBERSINCLUSTERS:1268245446 ׫ ITERATION11  MINUS2LOGLIKELIHOOD=n305.7  0AIC=n483.7 @SCHWARZCRITERION=n751.7 "YCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: c}POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: g0.000.720.280.000.000.00 0.690.200.110.000.000.00 h0.900.080.010.010.000.00 l0.770.060.020.160.000.00 o p NUMBERSINCLUSTERS:1269235545 ITERATION12  MINUS2LOGLIKELIHOOD=n302.3 t 0AIC=n480.3 w8SCHWARZCRITERION=n748.3 \CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: HPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: 0.000.860.140.000.000.00 q0.650.250.090.000.000.00 0.870.120.010.000.000.00 ؝0.790.060.020.130.000.00 B&NUMBERSINCLUSTERS:12510235545 F ITERATION13  MINUS2LOGLIKELIHOOD=n298.5  0AIC=n476.5 J0SCHWARZCRITERION=n744.5 NQCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: R{POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: y0.000.950.050.000.000.00 0.600.320.070.000.000.00 V0.840.150.010.000.000.00 Z-0.860.040.010.080.000.00 NUMBERSINCLUSTERS:12511225545 1 ITERATION14 5 MINUS2LOGLIKELIHOOD=n294.4 9 0AIC=n472.4 YSCHWARZCRITERION=n740.4}CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.000.980.020.000.000.00 h0.520.430.060.000.000.000.850.150.010.000.000.000.950.010.010.030.000.00 NUMBERSINCLUSTERS:12512215545 ITERATION15 MINUS2LOGLIKELIHOOD=n289.88 0AIC=n467.8\SCHWARZCRITERION=n735.8HCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:q0.000.990.010.000.000.000.410.540.050.000.000.000.960.030.010.000.000.00&0.980.000.010.010.000.00NUMBERSINCLUSTERS:12612205545 ITERATION16. MINUS2LOGLIKELIHOOD=n287.5+0 0AIC=n465.5QSCHWARZCRITERION=n733.4{CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:!yPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:;0.000.990.010.000.000.000.410.550.040.000.000.00-0.990.000.010.000.000.000.990.000.010.000.000.00>MIXINGPROBABILITIES:0.080.040.100.120.370.30MEANVECTORFORCLUSTER1:e4.828e3.267e1.397e0.198`YMEANVECTORFORCLUSTER2:'}e4.755e3.290e1.457e0.353aMEANVECTORFORCLUSTER3:ee5.128e3.550e1.507e0.292ihMEANVECTORFORCLUSTER4:e5.112e3.484e1.472e0.205jMEANVECTORFORCLUSTER5:n e6.545e2.949e5.480e1.985rMEANVECTORFORCLUSTER6:e5.915e2.778e4.202e1.2978COMMONCOVARIANCEMATRIX(MLE):u\n0.080e0.024e0.058e0.013yHn0.024e0.027e0.020e0.012ڵn0.058e0.020e0.063e0.016qn0.013e0.012e0.016e0.015CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION16.CLUSTER1& CAS0{ CAS0D CAS0H CAS00 CAS0Q CAS0L{ CAS0Py CAS0 CAS0 CAS0T- CAS0X CAS0CLUSTER2 CAS03 CAS06Y CAS0} CAS0 CAS0 CAS0hCLUSTER3 CAS0 CAS0 CAS0 CAS0 CAS08 CAS0\ CAS0 H CAS0 CAS0q CAS0 CAS0 CAS0&CLUSTER4 CAS0 CAS0 CAS00 CAS0\ 0AIC=n672.7HSCHWARZCRITERION=f1031.0CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP::qPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:=0.310.640.050.000.000.000.000.00b0.340.640.020.000.000.000.000.00f&0.340.640.020.000.000.000.000.000.320.660.020.000.000.000.000.00NUMBERSINCLUSTERS:0503321723250k ITERATION3n0 MINUS2LOGLIKELIHOOD=n405.3rQ 0AIC=n643.3{SCHWARZCRITERION=f1001.5~yCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:vPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:z0.420.560.020.000.000.000.000.00[-0.400.590.000.000.000.000.000.000.390.610.000.000.000.000.000.000.350.650.000.000.000.000.000.00 ŖNUMBERSINCLUSTERS:0503243019222] ITERATION4{Y MINUS2LOGLIKELIHOOD=n384.1D} 0AIC=n622.1HSCHWARZCRITERION=n980.3CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:}hPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:M0.630.360.000.000.000.000.000.00Q0.550.450.000.000.000.000.000.00 0.510.490.000.000.000.000.000.00\0.410.590.000.000.000.000.000.00UNUMBERSINCLUSTERS:446526339252X8 ITERATION5\ MINUS2LOGLIKELIHOOD=n356.1H 0AIC=n594.13SCHWARZCRITERION=n952.47qCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.890.110.000.000.000.000.000.00&0.790.210.000.000.000.000.000.000.730.270.000.000.000.000.000.00 0.530.470.000.000.000.000.000.00NUMBERSINCLUSTERS:94172032142430 ITERATION6Q MINUS2LOGLIKELIHOOD=n321.0{ 0AIC=n559.0ySCHWARZCRITERION=n917.3CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:-0.990.010.000.000.000.000.000.000.960.040.000.000.000.000.000.000.920.080.000.000.000.000.000.000.740.260.000.000.000.000.000.00NUMBERSINCLUSTERS:18328203112236Y ITERATION7} MINUS2LOGLIKELIHOOD=n287.9 0AIC=n525.9SCHWARZCRITERION=n884.2(hCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.00 1.000.000.000.000.000.000.000.00)0.990.010.000.000.000.000.000.00/0.910.090.000.000.000.000.000.008NUMBERSINCLUSTERS:23278193214198\ ITERATION8%H MINUS2LOGLIKELIHOOD=n262.4׵ 0AIC=n500.4qSCHWARZCRITERION=n858.6CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:@POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:&1.000.000.000.000.000.000.000.00d1.000.000.000.000.000.000.000.00h1.000.000.000.000.000.000.000.000.960.040.000.000.000.000.000.000NUMBERSINCLUSTERS:232781832141711lQ ITERATION9p{ MINUS2LOGLIKELIHOOD=n244.2y 0AIC=n482.2SCHWARZCRITERION=n840.5tCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:x-POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.000.980.020.000.000.000.000.000.00YNUMBERSINCLUSTERS:242681731151712} ITERATION10B MINUS2LOGLIKELIHOOD=n231.4F 0AIC=n469.4hSCHWARZCRITERION=n827.7CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:KPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:O 1.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.0080.980.020.000.000.000.000.000.00V\NUMBERSINCLUSTERS:242691829191411ZH ITERATION11 MINUS2LOGLIKELIHOOD=n220.41q 0AIC=n458.45SCHWARZCRITERION=n816.79CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:&POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.00 1.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.00 00.980.020.000.000.000.000.000.00QNUMBERSINCLUSTERS:232791928191411{ ITERATION12y MINUS2LOGLIKELIHOOD=n214.5 0AIC=n452.5SCHWARZCRITERION=n810.7-CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.00Y0.980.020.000.000.000.000.000.00}NUMBERSINCLUSTERS:232781928211410 i ITERATION13 MINUS2LOGLIKELIHOOD=n210.4h 0AIC=n448.4.SCHWARZCRITERION=n806.6|CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.00$1.000.000.000.000.000.000.000.00;81.000.000.000.000.000.000.000.00\0.980.020.000.000.000.000.000.00HNUMBERSINCLUSTERS:232781828221410 ITERATION14>q MINUS2LOGLIKELIHOOD=n206.7 0AIC=n444.7SCHWARZCRITERION=n803.0:&CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:=POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:b1.000.000.000.000.000.000.000.00f1.000.000.000.000.000.000.000.00i01.000.000.000.000.000.000.000.00Q0.980.020.000.000.000.000.000.00j{NUMBERSINCLUSTERS:232781627241510ny ITERATION15r MINUS2LOGLIKELIHOOD=n203.5 0AIC=n441.5~-SCHWARZCRITERION=n799.8vCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:zPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:[1.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.00Y1.000.000.000.000.000.000.000.00}0.980.020.000.000.000.000.000.00NUMBERSINCLUSTERS:232781627231511{ ITERATION16Dh MINUS2LOGLIKELIHOOD=n201.2H 0AIC=n439.2SCHWARZCRITERION=n797.5} CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:MPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:Q1.000.000.000.000.000.000.000.0081.000.000.000.000.000.000.000.00\1.000.000.000.000.000.000.000.00TH0.980.020.000.000.000.000.000.00XNUMBERSINCLUSTERS:232781525251413q ITERATION17 MINUS2LOGLIKELIHOOD=n199.43 0AIC=n437.47&SCHWARZCRITERION=n795.7CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.0001.000.000.000.000.000.000.000.00Q1.000.000.000.000.000.000.000.00{0.980.020.000.000.000.000.000.00yNUMBERSINCLUSTERS:232781425261314 ITERATION18 MINUS2LOGLIKELIHOOD=n197.7- 0AIC=n435.7SCHWARZCRITERION=n794.0CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.00Y1.000.000.000.000.000.000.000.00}1.000.000.000.000.000.000.000.000.980.020.000.000.000.000.000.00MIXINGPROBABILITIES:0.140.190.050.110.170.160.090.08hMEANVECTORFORCLUSTER1:e4.873e3.302e1.428e0.200MEANVECTORFORCLUSTER2:( e5.106e3.523e1.487e0.280MEANVECTORFORCLUSTER3:e5.584e2.400e4.067e1.3038MEANVECTORFORCLUSTER4:*\e6.123e2.668e4.881e1.752-HMEANVECTORFORCLUSTER5:e6.028e2.839e4.202e1.310qMEANVECTORFORCLUSTER6:%e6.063e3.004e4.934e1.689םMEANVECTORFORCLUSTER7:&e7.032e2.914e5.854e2.020MEANVECTORFORCLUSTER8:@e6.889e3.193e5.828e2.164COMMONCOVARIANCEMATRIX(MLE):c0n0.026e0.011e0.016e0.005gQn0.011e0.014e0.007e0.005{n0.016e0.007e0.022e0.009yn0.005e0.005e0.009e0.008lCONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION18.pCLUSTER1- CAS0 CAS0t CAS0x CAS0 CAS0Y CAS0} CAS0 CAS0 CAS0h CAS0B CAS0F CAS0 CAS0 CAS0K CAS0N8 CAS0R\ CAS0H CAS0 CAS0Vq CAS0Z CAS0 CAS01& CAS05CLUSTER29 CAS0 CAS00 CAS0Q CAS0{ CAS0 y CAS0 CAS0 CAS0- CAS0 CAS0 CAS0 CAS0 CAS0Y CAS0} CAS0 CAS0 CAS0h CAS0 CAS0 CAS0 CAS0. CAS0| CAS08 CAS0\ CAS0!H CAS0; CAS0qCLUSTER3 CAS0 CAS0>& CAS0 CAS0 CAS0: CAS0'0 CAS1aQ CAS1 Ŗe{CLUSTER4iy CAS1 CAS1j CAS1n- CAS1r CAS1 CAS0~ CAS0v CAS1yY CAS1} CAS0 CAS1 CAS0h CAS0 CAS0{CLUSTER5D CAS0H CAS0 CAS08 CAS0L\ CAS0PH CAS0 CAS0q CAS0T CAS1X CAS0& CAS0 CAS03 CAS07 CAS00 CAS0Q CAS0{ CAS0y CAS0 CAS0 CAS0- CAS0 CAS0 CAS0 CAS0 CAS0 YCLUSTER6} CAS0 CAS0 CAS0h CAS0 CAS0 CAS0 CAS0 CAS1 CAS0<8 CAS0&\ CAS0H CAS1 CAS0*q CAS0- CAS0 CAS1& CAS1% CAS1 CAS1 CAS10 CAS1#Q CAS1"{ CAS1cy CAS1g CAS1 CAS1-CLUSTER7l CAS1p CAS1 CAS1 CAS1sY CAS1w} CAS1 CAS1 CAS1h CAS1 CAS1 CAS1 CAS1B CAS1FCLUSTER8I8 CAS1\ CAS1JH CAS1N CAS1Rq CAS1 CAS1 CAS1V& CAS1Z CAS1 CAS11 CAS140 CAS18Q CAS1{ CAS1 y ................................................................................ K=9CLUSTERS NUMBEROFPARAMETERS=134 -INITIAL MEANS MEANVECTORFORCLUSTER1: 4.33.01.10.1 MEANVECTORFORCLUSTER2: 4.93.01.40.2 YMEANVECTORFORCLUSTER3: }5.13.81.60.2 MEANVECTORFORCLUSTER4: 5.43.91.30.4 hMEANVECTORFORCLUSTER5: 5.62.84.92.0 MEANVECTORFORCLUSTER6:  5.93.05.11.8 MEANVECTORFORCLUSTER7: 6.22.84.81.8 8MEANVECTORFORCLUSTER8: \6.42.94.31.3 +HMEANVECTORFORCLUSTER9: 6.73.14.41.4 q ITERATION1 ! MINUS2LOGLIKELIHOOD=f1371.9 ;0AIC=f1639.9 &SCHWARZCRITERION=f2043.3 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: >0.130.270.310.290.000.000.000.000.00 00.110.250.330.300.000.000.000.000.00 Q0.120.290.310.280.000.000.000.000.00 `{0.120.310.310.250.000.000.000.000.00 'yNUMBERSINCLUSTERS:02163215523030 a ITERATION2 e MINUS2LOGLIKELIHOOD=n439.2 i- 0AIC=n707.2 SCHWARZCRITERION=f1110.6 jCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: nPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: r0.150.320.320.220.000.000.000.000.00 Y0.110.190.340.350.000.000.000.000.00 }0.120.210.330.340.000.000.000.000.00 u0.110.210.330.350.000.000.000.000.00 yNUMBERSINCLUSTERS:02543264321100 h ITERATION3  MINUS2LOGLIKELIHOOD=n416.2 0AIC=n684.2 SCHWARZCRITERION=f1087.7 CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: {POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: C80.210.340.300.150.000.000.000.000.00 G\0.140.220.350.290.000.000.000.000.00 H0.140.230.330.310.000.000.000.000.00 0.110.200.330.370.000.000.000.000.00 LqNUMBERSINCLUSTERS:04838362815201 P ITERATION4  MINUS2LOGLIKELIHOOD=n397.7 & 0AIC=n665.7 TSCHWARZCRITERION=f1069.1 XCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES: 00.300.360.270.070.000.000.000.000.00 2Q0.170.230.370.230.000.000.000.000.00 6{0.170.240.330.260.000.000.000.000.00 y0.120.180.320.380.000.000.000.000.00 NUMBERSINCLUSTERS:071132411216292 ITERATION5- MINUS2LOGLIKELIHOOD=n367.2 0AIC=n635.2SCHWARZCRITERION=f1038.6CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:Y0.390.340.250.020.000.000.000.000.00}0.230.220.400.160.000.000.000.000.000.240.220.330.210.000.000.000.000.00 0.130.160.310.400.000.000.000.000.00hNUMBERSINCLUSTERS:341330361015372 ITERATION6 MINUS2LOGLIKELIHOOD=n331.0 i 0AIC=n599.0SCHWARZCRITERION=f1002.4CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP: 8POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:\0.390.310.290.010.000.000.000.000.00H0.270.190.440.100.000.000.000.000.00<0.330.180.330.160.000.000.000.000.00&q0.150.110.310.420.000.000.000.000.00NUMBERSINCLUSTERS:451229351312364 ITERATION7*& MINUS2LOGLIKELIHOOD=n298.9- 0AIC=n566.9SCHWARZCRITERION=n970.4CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:,0POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:?Q0.220.290.490.000.000.000.000.000.00{0.220.180.540.060.000.000.000.000.00y0.360.170.350.120.000.000.000.000.00#0.150.090.310.450.000.000.000.000.00"NUMBERSINCLUSTERS:661127351511354c- ITERATION8g MINUS2LOGLIKELIHOOD=n274.0 0AIC=n542.0SCHWARZCRITERION=n945.4lCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:oYPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:}0.020.240.730.000.000.000.000.000.000.140.210.640.020.000.000.000.000.00s0.320.200.420.060.000.000.000.000.00wh0.140.060.340.460.000.000.000.000.00NUMBERSINCLUSTERS:561326361412335 ITERATION9  MINUS2LOGLIKELIHOOD=n254.2 0AIC=n522.2SCHWARZCRITERION=n925.6]8CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:A\POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:EH0.000.170.830.000.000.000.000.000.00I0.070.200.730.000.000.000.000.000.00q0.260.230.500.010.000.000.000.000.00J0.110.050.420.420.000.000.000.000.00NNUMBERSINCLUSTERS:561326341512327R& ITERATION10 MINUS2LOGLIKELIHOOD=n239.3 0AIC=n507.3VSCHWARZCRITERION=n910.8Y0CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:QPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0{0.000.090.910.000.000.000.000.000.004y0.020.180.800.000.000.000.000.000.0080.170.240.590.000.000.000.000.000.000.060.050.580.320.000.000.000.000.00-NUMBERSINCLUSTERS:751226371312308 ITERATION11 MINUS2LOGLIKELIHOOD=n225.6  0AIC=n493.6SCHWARZCRITERION=n897.0YCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:}POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.000.020.980.000.000.000.000.000.000.000.170.830.000.000.000.000.000.00h0.050.240.720.000.000.000.000.000.000.000.060.740.200.000.000.000.000.00NUMBERSINCLUSTERS:861125361313308 ITERATION12 MINUS2LOGLIKELIHOOD=n210.2 0AIC=n478.28SCHWARZCRITERION=n881.6\CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:HPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.000.001.000.000.000.000.000.000.00q0.000.200.800.000.000.000.000.000.00+0.000.160.840.000.000.000.000.000.000.000.100.800.100.000.000.000.000.00&NUMBERSINCLUSTERS:961322371213308! ITERATION13; MINUS2LOGLIKELIHOOD=n198.3 0AIC=n466.30SCHWARZCRITERION=n869.7QCASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:_{POSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:y0.000.001.000.000.000.000.000.000.000.000.230.770.000.000.000.000.000.00`0.000.080.920.000.000.000.000.000.00'-0.000.160.790.050.000.000.000.000.00aNUMBERSINCLUSTERS:961421371213317e ITERATION14i MINUS2LOGLIKELIHOOD=n192.1 0AIC=n460.1YSCHWARZCRITERION=n863.5m}CASEPOSTERIOR PROBSOFCLUSTERMEMBERSHIP:qPOSTERIORPROBOF GROUPMEMBERSHIPFOR1ST4CASES:0.000.001.000.000.000.000.000.000.00h0.000.250.750.000.000.000.000.000.00u0.000.040.960.000.000.000.000.000.00 ey0.000.220.730.040.000.000.000.000.00 MIXINGPROBABILITIES:0.060.040.100.140.230.100.100.190.05MEANVECTORFORCLUSTER1:e4.952e3.292e1.428e0.2008MEANVECTORFORCLUSTER2:\e4.942e3.465e1.530e0.357HMEANVECTORFORCLUSTER3:Ce4.871e3.351e1.488e0.253GqMEANVECTORFORCLUSTER4:e5.143e3.526e1.436e0.224MEANVECTORFORCLUSTER5:L&e6.137e2.952e5.083e1.901PMEANVECTORFORCLUSTER6:e6.607e2.976e5.447e1.987MEANVECTORFORCLUSTER7:S0e6.564e2.613e5.285e1.599WQMEANVECTORFORCLUSTER8:{e6.003e2.788e4.185e1.291yMEANVECTORFORCLUSTER9:2e6.567e3.157e4.994e1.6286COMMONCOVARIANCEMATRIX(MLE):-n0.039e0.015e0.030e0.013n0.015e0.014e0.012e0.006n0.030e0.012e0.038e0.017n0.013e0.006e0.017e0.012CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION14. YCLUSTER1} CAS0 CAS0 CAS0h CAS0 CAS0 CAS0 CAS0 CAS0 CAS08CLUSTER2\ CAS0H CAS0 CAS0q CAS0 CAS0< CAS0&&CLUSTER3 CAS0 CAS0* CAS0^0 CAS0Q CAS0{ CAS0,y CAS0? CAS0 CAS0- CAS0# CAS0" CAS0c CAS0g CAS0YCLUSTER4} CAS0k CAS0o CAS0h CAS0 CAS0s CAS0w CAS0 CAS0 CAS08 CAS0\ CAS0H CAS0] CAS0Aq CAS0E CAS0I CAS0& CAS0J CAS0N CAS0R CAS00 CAS0\QCLUSTER5U{ CAS1Yy CAS0 CAS00 CAS04- CAS18 CAS0 CAS1 CAS0 CAS1Y CAS1 } CAS1 CAS0 CAS1h CAS0 CAS1 CAS0 CAS0 CAS1 CAS18 CAS1\ CAS1H CAS1 CAS1q CAS1 CAS1 CAS1& CAS1+ CAS1 CAS1 CAS10 CAS1)Q CAS1/{ CAS1y CAS0 CAS1_ CAS1- CAS1CLUSTER6` CAS0' CAS1a CAS1dY CAS1h} CAS1 CAS1 CAS1mh CAS1q CAS1Ψ CAS1 CAS1u CAS1yCLUSTER78 CAS0\ CAS1H CAS0 CAS0q CAS0 CAS1C CAS0G& CAS1 CAS1 CAS1L CAS1O0 CAS1Q CAS1{CLUSTER8Sy CAS0W CAS0 CAS0- CAS02 CAS06 CAS0 CAS0 CAS0Y CAS0 } CAS0 CAS0 CAS0h CAS1 CAS0 CAS0 CAS0 CAS0  CAS08 CAS0\ CAS0H CAS0 CAS0q CAS0 CAS0 CAS0& CAS0 CAS0< CAS0& CAS00 CAS0Q CAS0${CLUSTER9^y CAS0܌ CAS0 CAS0,- CAS1? CAS1 CAS1 CAS1# ................................................................................=YFISHERIRISDATA (IRISDATSRTC1)b} MODELSELECTIONCRITERIAf00MODEL-SELECTIONCRITERIANUMBERMINUS2NUMBER(PPH=POST.PROB.OFMODEL):hOFeTIMESOFAKAIKEpSCHWARZkCLUSTERS,LOGOFPARAM-------------------------oKLIKELIHOOD ETERSVALUEPPHVALUEPPH ------------------- -------------------------1n759.814787.80.00830.00.00s2n588.429646.40.00733.70.00v83n407.444495.41.00627.80.82z\4n351.559469.50.00647.10.18[H5n331.974479.90.00702.70.006n287.589465.50.00733.40.00q7n258.2104466.20.00779.40.008n197.7119435.70.00794.00.00]9n192.1134460.10.00863.50.00A& ................................................................................EFISHERIRISDATA (IRISDATSRTC1)ICONDITIONCODEFORTHISRUN:PROGRAM ENDEDNORMALLY.}0 ................................................................................MQMIXPCMACLUSPAC-MIXTURE-MODELCLUSTERINGOF CASESQ{ TIMEBEGAN:y12/23/1989AT0:37:55\TIMEFINISHED:U12/23/1989AT0:39:13