Y} MIXPCMACLUSPAC-MIXTURE-MODELCLUSTERINGOF CASEShCOMMONCOVARIANCEMATRIXAUTOMATICSETTINGOFINITIALPARAMETERVALUES Copyright(C)StanleyL.Sclove.8Developedandprogrammedby:\H0Prof.StanleyL.Sclove, Ph.D.Phone (312)996-26810.Information&DecisionSciences Dept.M/C294q0CollegeofBusinessAdministration0UniversityofIllinoisatChicago0Box 4348,Chicago,IL60680-4348&ProgramVersion:4.416-Dec-89+0(VM/CMS)0 ................................................................................Q){/y݌PROBLEM TITLEISFISHERIRISDATA (IRISDATSRTC1)_-12/21/1989AT11:30:41`'NUMBEROFVARIABLES............/4Yd}NUMBEROFOBSERVATIONS(SAMPLESIZE),N..150hhMINIMUMFOREACHVARIABLE:mq4.32.01.00.1 MAXIMUMFOREACHVARIABLE:ux87.94.46.92.5\H FIRSTFOURDATAPOINTS ----------------------q 4.33.01.10.1CAS0 4.43.21.30.2CAS0ĝ 4.43.01.30.2CAS0C& 4.42.91.40.2CAS0GNUMBEROFCLUSTERSTOREPORT........1TO9K0OQ ................................................................................{ySW-STATISTICSFOR WHOLE(UNCLUSTERED)SAMPLE:------------- ------------------------26MEANVECTOR:5.843.063.761.20Y}COVARIANCEMATRIX: 0.68112-0.042161.265820.51283 h-0.042160.18871-0.32746-0.120831.26582-0.327463.095501.28697 0.51283-0.120831.286970.57713  MINUS2LOGLIKELIHOOD=e759.8 0AIC=n787.88SCHWARZCRITERION=n830.0\H ................................................................................q &K=2CLUSTERSNUMBEROFPARAMETERS=19<|0QINITIAL MEANS{$y4.33.01.10.1^7.93.86.42.0- ITERATION1,? MINUS2LOGLIKELIHOOD=1721.70AIC=f1759.7:YSCHWARZCRITERION=f1817.0=}bPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:f1.000.00h1.000.001.000.00k1.000.00o NUMBERSINCLUSTERS:5793~8 ITERATION2v\zH[ MINUS2LOGLIKELIHOOD=e834.4q 0AIC=n872.4SCHWARZCRITERION=n929.6]&POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:A1.000.00E1.000.00I1.000.0001.000.00}QM{NUMBERSINCLUSTERS:50100Qy ITERATION3\U-Y MINUS2LOGLIKELIHOOD=e802.7 0AIC=n840.70SCHWARZCRITERION=n897.947YPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:}1.000.001.000.001.000.00h1.000.00 NUMBERSINCLUSTERS:50100 MIXINGPROBABILITIES:0.330.67MEANVECTORFORCLUSTER1:g5.006073.427851.462390.246188MEANVECTORFORCLUSTER2:g6.262092.872024.906131.67605\HCOMMONCOVARIANCEMATRIX(MLE):q0.413590.064530.201200.07466&0.064530.128750.064050.036200.201200.064050.606330.127710.074660.036200.127710.161200CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION3.RESULTSAREPRINTEDBELOW.(Q{yNUMBERSINCLUSTERS:50100)NUMBEROFPARAMETERS=19/-SCHWARZCRITERION=n897.9ݫ 0AIC=n840.7_LISTOFCASES,BYCLUSTERY}@CLUSTER1 CAS0dh CAS0h CAS0 CAS0 CAS0m CAS0q CAS08 CAS0\ CAS0tH CAS0x CAS0q CAS0 CAS0 CAS0& CAS0 CAS0 CAS0C CAS0F0 CAS0Q CAS0{ CAS0Ky CAS0O CAS0 CAS0- CAS0S CAS0W CAS0 CAS0 CAS01Y CAS05} CAS09 CAS0 CAS0h CAS0 CAS0 CAS0 CAS0 CAS0  CAS08 CAS0\ CAS0H CAS0 CAS0q CAS0 CAS0 CAS0& CAS0 CAS0 CAS0  CAS00CLUSTER2Q CAS0.{ CAS1|y CAS0 CAS0 CAS0$- CAS0^ CAS0 CAS0 CAS0 8, CAS0>Y CAS0} CAS0 CAS0: CAS0=h CAS0b CAS0f CAS0 CAS1 CAS0k CAS0n8 CAS0r\ CAS1H CAS1~ CAS0vq CAS0z CAS1[ CAS0& CAS1 CAS1 CAS0] CAS1{0 CAS0DQ CAS0H{ CAS0y CAS0} CAS0M CAS1Q- CAS0 CAS1\ CAS1U CAS0Y CAS0Y CAS0} CAS03 CAS17 CAS0h CAS1 CAS0 CAS1 CAS1  CAS1 CAS08 CAS1\ CAS1H CAS0 CAS1q CAS1 CAS0 CAS1& CAS1 CAS1 CAS1 CAS00 CAS0Q CAS1{ CAS1y CAS1( CAS0 CAS1- CAS1 CAS0) CAS0/ CAS1 CAS1Y CAS1%} CAS0׼ CAS1 CAS1h CAS0@ CAS0 CAS1d CAS1h CAS0 CAS18 CAS0l\ CAS1pH CAS1 CAS0q CAS1t CAS1x CAS1& CAS1 CAS1 CAS1 CAS10 CAS1Q CAS1B{ CAS1Fy CAS1ˌ CAS1K- ................................................................................OSK=3CLUSTERSVYZ}NUMBEROFPARAMETERS=2415hINITIAL MEANS94.33.01.10.1  5.82.85.12.4 7.93.86.42.0  8 ITERATION1 \ H  MINUS2LOGLIKELIHOOD=1489.6 q0AIC=f1537.6 SCHWARZCRITERION=f1609.8  &POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: 1.000.000.00 1.000.000.00 1.000.000.00 01.000.000.00 Q {NUMBERSINCLUSTERS:508713 y ITERATION2 . |-  MINUS2LOGLIKELIHOOD=e688.6  0AIC=n736.6 $SCHWARZCRITERION=n808.8 ^ YPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: }1.000.000.00 1.000.000.00 >1.000.000.00 h1.000.000.00 :NUMBERSINCLUSTERS:508119 = b ITERATION3 f i8 \ MINUS2LOGLIKELIHOOD=e657.6 jH 0AIC=n705.6 nSCHWARZCRITERION=n777.9 rq POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: ~1.000.000.00 v&1.000.000.00 z1.000.000.00 [1.000.000.00  0NUMBERSINCLUSTERS:507624 Q { ITERATION4 {y D H MINUS2LOGLIKELIHOOD=e638.1 - 0AIC=n686.1 }SCHWARZCRITERION=n758.4 M QPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: 1.000.000.00 Y1.000.000.00 T}1.000.000.00 X1.000.000.00 hNUMBERSINCLUSTERS:507030 3 7 ITERATION5  MINUS2LOGLIKELIHOOD=e622.28 0AIC=n670.2\SCHWARZCRITERION=n742.5HPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:q1.000.000.001.000.000.001.000.000.00&1.000.000.00NUMBERSINCLUSTERS:5064360 ITERATION6Q{y MINUS2LOGLIKELIHOOD=e617.0 0AIC=n665.0SCHWARZCRITERION=n737.3-(POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.001.000.000.001.000.000.00*Y1.000.000.00-}NUMBERSINCLUSTERS:506436%h MIXINGPROBABILITIES:0.330.420.25MEANVECTORFORCLUSTER1:g5.006003.428001.462000.24600MEANVECTORFORCLUSTER2:g5.934772.757474.413241.41666 MEANVECTORFORCLUSTER3:g6.818933.066925.744642.11738@c8COMMONCOVARIANCEMATRIX(MLE):g\Hŵ0.144320.025320.041540.00754lq0.025320.072780.012900.00795p0.041540.012900.132730.019690.007540.007950.019690.03354&tCONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION6.RESULTSAREPRINTEDBELOW.x0QNUMBERSINCLUSTERS:506436{NUMBEROFPARAMETERS=24ySCHWARZCRITERION=n737.3،B 0AIC=n665.0F-˫LISTOFCASES,BYCLUSTERKOCLUSTER1RY CAS0} CAS0 CAS0V CAS0Zh CAS0 CAS01 CAS05 CAS09 CAS0 CAS08 CAS0\ CAS0H CAS0 CAS0q CAS0 CAS0 CAS0& CAS0 CAS0 CAS0 CAS00 CAS0Q CAS0{ CAS0y CAS0 CAS0 CAS0- CAS0 CAS0. CAS0| CAS0 CAS0Y CAS0!} CAS0; CAS0 CAS0h CAS0 CAS0 4> CAS0 CAS0 CAS0: CAS0'8 CAS0a\ CAS0eH CAS0i CAS0q CAS0j CAS0n CAS0r& CAS0CLUSTER2~ CAS0v CAS1y0 CAS0Q CAS0{ CAS0y CAS0 CAS0 CAS0{- CAS0D CAS0H CAS0 CAS0} CAS0LY CAS0P} CAS0 CAS0 CAS0Th CAS1X CAS0 CAS0 CAS03 CAS17 CAS18 CAS0\ CAS0H CAS0 CAS1q CAS1 CAS0 CAS1& CAS0 CAS0 CAS0 CAS0 0 CAS0Q CAS1{ CAS0y CAS1 CAS1 CAS0- CAS0 CAS0 CAS0 CAS1( CAS0&Y CAS1} CAS0 CAS1* CAS0-h CAS0 CAS1 CAS1% CAS0 CAS0 CAS08 CAS0#\ CAS0"H CAS0c CAS0gq CAS0 CAS0ŝ CAS0l& CAS0p CAS0CLUSTER3 CAS1s0 CAS1wQ CAS1{ CAS1y CAS1 CAS1 CAS1- CAS1ث CAS1B CAS1F CAS1 CAS1Y CAS1J} CAS1N CAS1R CAS1h CAS1 CAS1V CAS1Z CAS1 CAS11 CAS148 CAS18\ CAS1H CAS1 CAS1q CAS1 CAS1 CAS1& CAS1 CAS1 CAS1 CAS10 CAS1Q CAS1{ CAS1y ................................................................................-K=4CLUSTERSNUMBEROFPARAMETERS=29Y+}INITIAL MEANS!h4.33.01.10.1;5.43.71.50.2ߨ6.32.74.91.8 7.93.86.42.0> ITERATION18\`H MINUS2LOGLIKELIHOOD=1395.7'0AIC=f1453.7aqSCHWARZCRITERION=f1541.0eiPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:&0.510.490.000.00j0.470.530.000.00n0.490.510.000.00r0.510.490.000.000QNUMBERSINCLUSTERS:/347937u{yy ITERATION2ڌ- MINUS2LOGLIKELIHOOD=e710.0 0AIC=n768.0SCHWARZCRITERION=n855.3{DPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:GY0.530.470.000.00}0.440.560.000.000.540.460.000.00L0.590.410.000.00PhNUMBERSINCLUSTERS:/4468812T ITERATION3X8 MINUS2LOGLIKELIHOOD=e673.62\ 0AIC=n731.66HSCHWARZCRITERION=n818.9qPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:0.680.320.000.000.530.470.000.00&0.690.310.000.000.770.230.000.00NUMBERSINCLUSTERS:153585150Q ITERATION4{ y MINUS2LOGLIKELIHOOD=e658.2 0AIC=n716.2-SCHWARZCRITERION=n803.5POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:0.830.170.000.000.660.340.000.00Y0.840.160.000.00}0.910.090.000.00<&NUMBERSINCLUSTERS:16347822h ITERATION5*-  MINUS2LOGLIKELIHOOD=e646.8 0AIC=n704.8,8SCHWARZCRITERION=n792.1?\HPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:ֵ0.920.080.000.00#q0.770.230.000.00"0.930.070.000.00c0.960.040.000.00g&NUMBERSINCLUSTERS:17337426l ITERATION6o0Q{ MINUS2LOGLIKELIHOOD=e633.4sy 0AIC=n691.4wSCHWARZCRITERION=n778.7-POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:0.960.040.000.000.850.150.000.000.970.030.000.000.990.010.000.00AYE}NUMBERSINCLUSTERS:18327129I ITERATION7JhNR MINUS2LOGLIKELIHOOD=e623.7 0AIC=n681.7SCHWARZCRITERION=n769.0VY8POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:\0.980.020.000.000H0.910.090.000.0040.980.020.000.008q0.990.010.000.00 NUMBERSINCLUSTERS:21296436 &  ITERATION8   0 MINUS2LOGLIKELIHOOD=e623.7 Q 0AIC=n681.7 {SCHWARZCRITERION=n769.0 y POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: 0.990.010.000.00 -0.940.060.000.00 0.990.010.000.00 1.000.000.000.00  NUMBERSINCLUSTERS:22286436 Y } ITERATION9 +h MINUS2LOGLIKELIHOOD=e626.6 0AIC=n684.6 SCHWARZCRITERION=n771.9 ! ;POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: 0.990.010.000.00 80.960.040.000.00 \0.990.010.000.00 _H1.000.000.000.00 qNUMBERSINCLUSTERS:22286337 ` ' ITERATION10 a& e i MINUS2LOGLIKELIHOOD=e625.5  0AIC=n683.5 0SCHWARZCRITERION=n770.8 mQ q{POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: y0.990.010.000.00 Ȍ0.960.040.000.00 u1.000.000.000.00 y-1.000.000.000.00 ګ NUMBERSINCLUSTERS:23276040  ITERATION11 Y } C MINUS2LOGLIKELIHOOD=e621.6 G 0AIC=n679.6 hSCHWARZCRITERION=n766.9 LPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: P 1.000.000.000.00 0.970.030.000.00 1.000.000.000.00 S81.000.000.000.00 W\ HNUMBERSINCLUSTERS:24265941 2q ITERATION12 6 & MINUS2LOGLIKELIHOOD=e618.0  0AIC=n676.0 SCHWARZCRITERION=n763.3  0POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: Q1.000.000.000.00 {0.970.030.000.00 y1.000.000.000.00 1.000.000.000.00  -NUMBERSINCLUSTERS:25255743   ITERATION13   Y MINUS2LOGLIKELIHOOD=e617.6 } 0AIC=n675.6 SCHWARZCRITERION=n762.9 hPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: <1.000.000.000.00 &0.970.030.000.00 1.000.000.000.00 1.000.000.000.00 * ^8NUMBERSINCLUSTERS:26245545 \ H ITERATION14 , ?q  MINUS2LOGLIKELIHOOD=e618.2 ֝ 0AIC=n676.2 #&SCHWARZCRITERION=n763.5 " cPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: g1.000.000.000.00 00.980.020.000.00 Q1.000.000.000.00 k{1.000.000.000.00 oy NUMBERSINCLUSTERS:28225248 s- ITERATION15 w   MINUS2LOGLIKELIHOOD=e618.9 0AIC=n676.9 YSCHWARZCRITERION=n764.2 } ]POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: A1.000.000.000.00 Eh0.980.020.000.00 I1.000.000.000.00 1.000.000.000.00 J NNUMBERSINCLUSTERS:29215248 R 8 ITERATION16 \\ UH Y MINUS2LOGLIKELIHOOD=e619.4 q 0AIC=n677.4 0SCHWARZCRITERION=n764.7 4 8&POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: 1.000.000.000.00 0.980.020.000.00 1.000.000.000.00 01.000.000.000.00 Q {NUMBERSINCLUSTERS:29215248 y MIXINGPROBABILITIES:0.190.150.350.31 MEANVECTORFORCLUSTER1:g4.821773.191781.453380.23225 -MEANVECTORFORCLUSTER2:g5.243943.733091.473140.26376 MEANVECTORFORCLUSTER3:g5.920932.744814.308121.33478 MEANVECTORFORCLUSTER4:g6.648153.016015.582912.06233   YCOMMONCOVARIANCEMATRIX(MLE): }  0.142850.018450.048770.00807 h0.018450.048570.012940.00702 0.048770.012940.123250.01281 0.008070.007020.012810.02181 + CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION16.RESULTSAREPRINTEDBELOW.  8 )\ /HNUMBERSINCLUSTERS:29215248 ݵNUMBEROFPARAMETERS=29 qSCHWARZCRITERION=n764.7 _ 0AIC=n677.4 & `LISTOFCASES,BYCLUSTER ' a d0CLUSTER1 hQ CAS0 { CAS0 y CAS0 m CAS0 q CAS0 - CAS0 ȫ CAS0 u CAS0 y CAS0 CAS0 Y CAS0 } CAS0 CAS0 CAS0 h CAS0 C CAS0 G CAS0 CAS0  CAS0 L CAS0 O8 CAS0 \ CAS0 H CAS0 S CAS0 Wq CAS0 CAS0 CAS0 2& CAS0 6 CAS0 CLUSTER2  CAS00 CAS0 Q CAS0{ CAS0 y CAS0 CAS0 CAS0- CAS0 CAS0 CAS0  CAS0 CAS0Y CAS0} CAS0 CAS0 CAS0h CAS0 CAS0 CAS0 CAS0< CAS0&CLUSTER38 CAS0\ CAS1$H CAS0^ CAS0q CAS0 CAS0, CAS0?& CAS0 CAS0 CAS0# CAS0=0 CAS0bQ CAS0f{ CAS0y CAS0 CAS0k CAS0o- CAS0 CAS0 CAS0s CAS1w CAS0zY CAS0 U[} CAS0 CAS0 CAS0h CAS0] CAS0A CAS0E CAS1I CAS0 CAS1}8 CAS0M\ CAS0QH CAS0 CAS0\q CAS0U CAS0Y CAS0& CAS00 CAS14 CAS08 CAS00 CAS0Q CAS0{ CAS0y CAS0 CAS0 CAS0- CAS0 CAS0 CAS0CLUSTER4 CAS1Y CAS1} CAS1 CAS1 CAS1h CAS1 CAS0 CAS1 CAS1 CAS1 CAS1(8 CAS1\ CAS1H CAS1 CAS1)q CAS1/ CAS1ݝ CAS1& CAS1_ CAS1 CAS1 CAS10 CAS1@Q CAS1{ CAS1dy CAS1h CAS1 CAS1- CAS1m CAS1q CAS0 CAS1 CAS1tY CAS1x} CAS1 CAS1 CAS1h CAS1 CAS1٨ CAS1 CAS1C CAS1G CAS18 CAS1\ CAS1KH CAS1O CAS1q CAS1S ................................................................................W&2K=5CLUSTERS509QNUMBEROFPARAMETERS=34{y INITIAL MEANS -4.33.01.10.15.12.53.01.1 5.82.85.12.46.42.75.31.97.93.86.42.0Y} ITERATION1h MINUS2LOGLIKELIHOOD=1481.00AIC=f1549.0SCHWARZCRITERION=f1651.4  POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:0.900.100.000.000.0080.880.120.000.000.00.\0.840.160.000.000.00|H0.780.220.000.000.00qNUMBERSINCLUSTERS:502120563$^ ITERATION2&, MINUS2LOGLIKELIHOOD=e719.4? 0AIC=n787.40SCHWARZCRITERION=n889.8Q:{POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:=y1.000.000.000.000.00b1.000.000.000.000.00f1.000.000.000.000.00-1.000.000.000.000.00kNUMBERSINCLUSTERS:5019264312o ITERATION3Y~}v MINUS2LOGLIKELIHOOD=e672.5z 0AIC=n740.5[hSCHWARZCRITERION=n842.8POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: 1.000.000.000.000.00]1.000.000.000.000.00A1.000.000.000.000.00D81.000.000.000.000.00H\HNUMBERSINCLUSTERS:5023263615}Mq ITERATION4Q\& MINUS2LOGLIKELIHOOD=e717.9U 0AIC=n785.9YSCHWARZCRITERION=n888.30POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:3Q1.000.000.000.000.007{1.000.000.000.000.00y1.000.000.000.000.001.000.000.000.000.00-NUMBERSINCLUSTERS:5023293414  ITERATION5Y MINUS2LOGLIKELIHOOD=e713.6} 0AIC=n781.6SCHWARZCRITERION=n883.9hPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.001.000.000.000.000.00 1.000.000.000.000.001.000.000.000.000.008NUMBERSINCLUSTERS:5024333112\H ITERATION6(q MINUS2LOGLIKELIHOOD=e699.4 0AIC=n767.4)&SCHWARZCRITERION=n869.7/POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.00%01.000.000.000.000.00Q1.000.000.000.000.00{1.000.000.000.000.00y@NUMBERSINCLUSTERS:5023382712d- ITERATION7h MINUS2LOGLIKELIHOOD=e708.4m 0AIC=n776.4pYSCHWARZCRITERION=n878.7}POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:t1.000.000.000.000.00xh1.000.000.000.000.001.000.000.000.000.001.000.000.000.000.00 NUMBERSINCLUSTERS:50233728128 ITERATION8B\FH˵ MINUS2LOGLIKELIHOOD=e706.4q 0AIC=n774.4KSCHWARZCRITERION=n876.7O&POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.00S1.000.000.000.000.00W1.000.000.000.000.00Z01.000.000.000.000.00Q1{NUMBERSINCLUSTERS:50233629125y9 ITERATION9-  MINUS2LOGLIKELIHOOD=e707.8 0AIC=n775.8 SCHWARZCRITERION=n878.1YPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:}1.000.000.000.000.00 51.000.000.000.000.001.000.000.000.000.00h1.000.000.000.000.00NUMBERSINCLUSTERS:5023362813  ITERATION108\ MINUS2LOGLIKELIHOOD=e706.1H 0AIC=n774.1SCHWARZCRITERION=n876.4.q|POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.00&1.000.000.000.000.00$1.000.000.000.000.00^1.000.000.000.000.000NUMBERSINCLUSTERS:5023362912Q>{ ITERATION11y: MINUS2LOGLIKELIHOOD=e701.8=- 0AIC=n769.8bSCHWARZCRITERION=n872.1fPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.00jY1.000.000.000.000.00n}1.000.000.000.000.00r1.000.000.000.000.00~hNUMBERSINCLUSTERS:5023362912vzMIXINGPROBABILITIES:0.330.150.240.200.08[ MEANVECTORFORCLUSTER1:g5.006003.428001.462000.24600MEANVECTORFORCLUSTER2:g5.543492.589143.857691.17098MEANVECTORFORCLUSTER3:g6.200512.875684.692491.511708MEANVECTORFORCLUSTER4:g6.422083.021045.430552.14294\MEANVECTORFORCLUSTER5:g7.436263.041446.277641.99684{HDHqCOMMONCOVARIANCEMATRIX(MLE):}M&0.064300.015910.007490.00195Q0.015910.050370.003580.003370.007490.003580.030000.00373\0.001950.003370.003730.01075T0XQCONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION11.RESULTSAREPRINTEDBELOW.{y37NUMBERSINCLUSTERS:5023362912-NUMBEROFPARAMETERS=34SCHWARZCRITERION=n872.1 0AIC=n769.8 YLISTOFCASES,BYCLUSTER}CLUSTER1h CAS0 CAS0 CAS0 CAS0 CAS0 CAS08 CAS0\ CAS0H CAS0 CAS0q CAS0 CAS0( CAS0& CAS0 CAS0 CAS0) CAS0-0 CAS0Q CAS0{ CAS0%y CAS0׌ CAS0 CAS0- CAS0@ CAS0 CAS0d CAS0h CAS0Y CAS0} CAS0l CAS0p CAS0h CAS0 CAS0t CAS0x CAS0 CAS0 CAS08 CAS0\ CAS0H CAS0ص CAS0Bq CAS0F CAS0˝ CAS0& CAS0K CAS0O CAS0 CAS00 CAS0QCLUSTER2V{ CAS0Zy CAS0 CAS01 CAS05- CAS09 CAS0 CAS0 CAS0 CAS0Y CAS0 } CAS0 CAS0 CAS0h CAS0 CAS0 CAS0 CAS1 CAS0 CAS08 CAS0\ CAS0H CAS0 CAS0qCLUSTER3 CAS1 CAS0.& CAS0| CAS0 CAS1 CAS0!0 CAS0;Q CAS0{ CAS0y CAS1 CAS0> CAS1- CAS1 CAS0: CAS0= CAS0b CAS1eY CAS0i} CAS1 CAS0j CAS1nh CAS0r CAS0 CAS1~ CAS0v CAS0z CAS08 CAS0\ CAS0H CAS0 CAS0q CAS0{ CAS0D CAS0H& CAS0 CAS0}CLUSTER4M CAS1P0 CAS1Q CAS1{ CAS1Ty CAS1X CAS1 CAS1- CAS13 CAS17 CAS1 CAS1 CAS1 Y CAS1 } CAS1  CAS1  CAS1 h CAS1  CAS1  CAS1  CAS1  CAS1  CAS1 8 CAS1 \ CAS1 H CAS1  CAS1 q CAS1  CAS1 CAS1 &CLUSTER5  CAS1 ( CAS1  CAS1 0 CAS1 Q CAS1 *{ CAS1 -y CAS1 CAS1 CAS1 %- CAS1 ׫ CAS1  CAS1  @ ................................................................................ "Y c} g K=6CLUSTERS h lNUMBEROFPARAMETERS=39 p INITIAL MEANS t w84.33.01.10.1 \5.03.01.60.2 H5.62.74.21.3 6.12.65.61.4 q6.53.25.12.0 7.93.86.42.0 ؝ B& ITERATION1 F   MINUS2LOGLIKELIHOOD=1382.6 J00AIC=f1460.6 NQSCHWARZCRITERION=f1578.1 R{ yPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: 0.370.630.000.000.000.00 V0.360.640.000.000.000.00 Z-0.340.660.000.000.000.00 0.320.680.010.000.000.00 1 5 NUMBERSINCLUSTERS:/0505028202 9 Y ITERATION2} MINUS2LOGLIKELIHOOD=e692.5 h 0AIC=n770.5SCHWARZCRITERION=n887.9  POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:0.360.640.000.000.000.000.340.660.000.000.000.0080.340.660.000.000.000.00\0.340.660.000.000.000.00HNUMBERSINCLUSTERS:/05044232112q ITERATION3& MINUS2LOGLIKELIHOOD=e707.4 0AIC=n785.4.SCHWARZCRITERION=n902.8+0QPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:{0.510.490.000.000.000.00!y0.430.570.000.000.000.00;0.490.510.000.000.000.000.520.480.000.000.000.00-NUMBERSINCLUSTERS:/34741242312> ITERATION4`Y'} MINUS2LOGLIKELIHOOD=e722.8a 0AIC=n800.8eSCHWARZCRITERION=n918.2ihPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:j0.910.090.000.000.000.00n 0.770.230.000.000.000.00r0.900.100.000.000.000.000.940.060.000.000.000.008u\NUMBERSINCLUSTERS:163437242811yHڵ ITERATION5q MINUS2LOGLIKELIHOOD=e765.6& 0AIC=n843.6{SCHWARZCRITERION=n961.1DHPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:01.000.000.000.000.000.00Q0.980.020.000.000.000.00L{1.000.000.000.000.000.00Py1.000.000.000.000.000.00NUMBERSINCLUSTERS:193133223312T-X ITERATION63 MINUS2LOGLIKELIHOOD=e811.96Y 0AIC=n889.9}SCHWARZCRITERION=f1007.3POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:h1.000.000.000.000.000.001.000.000.000.000.000.001.000.000.000.000.000.00 1.000.000.000.000.000.00NUMBERSINCLUSTERS:2129322036128\ ITERATION7 Hq MINUS2LOGLIKELIHOOD=e820.2 0AIC=n898.2SCHWARZCRITERION=f1015.6&POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.001.000.000.000.000.000.0001.000.000.000.000.000.00\H ................................................................................:q=bK=8CLUSTERSf&NUMBEROFPARAMETERS=49kn0INITIAL MEANSrQ{4.33.01.10.1~y4.93.11.50.1v5.24.11.50.1z5.63.04.11.3[-6.02.24.01.06.32.55.01.96.73.05.22.37.93.86.42.0]{Y ITERATION1D}H MINUS2LOGLIKELIHOOD=1386.2}h0AIC=f1484.2MSCHWARZCRITERION=f1631.7Q POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:\0.220.440.340.000.000.000.000.00U0.190.420.370.010.000.000.000.00X80.210.470.320.010.000.000.000.00\0.210.490.280.010.000.000.000.00H3NUMBERSINCLUSTERS:/02030331647137q ITERATION2& MINUS2LOGLIKELIHOOD=e764.4  0AIC=n862.4SCHWARZCRITERION=f1010.00QPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:{0.360.590.050.000.000.000.000.00y0.290.580.130.000.000.000.000.000.350.600.050.000.000.000.000.000.370.600.030.000.000.000.000.00- UNUMBERSINCLUSTERS:/024263316241512 ITERATION3Y} MINUS2LOGLIKELIHOOD=e840.3 0AIC=n938.3SCHWARZCRITERION=f1085.8(hPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:0.610.390.000.000.000.000.000.00 0.410.590.000.000.000.000.000.00)0.590.410.000.000.000.000.000.00/0.670.330.000.000.000.000.000.008\NUMBERSINCLUSTERS:/422242822201911%H׵ ITERATION4q@ MINUS2LOGLIKELIHOOD=1020.8&0AIC=f1118.8dSCHWARZCRITERION=f1266.3hPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:00.960.040.000.000.000.000.000.00lQ0.640.360.000.000.000.000.000.00p{0.920.080.000.000.000.000.000.00y0.970.030.000.000.000.000.000.00tNUMBERSINCLUSTERS:/819232821221811x- ITERATION5 MINUS2LOGLIKELIHOOD=1129.2Y0AIC=f1227.2}SCHWARZCRITERION=f1374.8BFPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:h1.000.000.000.000.000.000.000.000.860.140.000.000.000.000.000.00K0.990.010.000.000.000.000.000.00O 1.000.000.000.000.000.000.000.00NUMBERSINCLUSTERS:/8202227232118118V\ ITERATION6ZH1q MINUS2LOGLIKELIHOOD=1148.250AIC=f1246.29SCHWARZCRITERION=f1393.8&POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: 1.000.000.000.000.000.000.000.000.920.080.000.000.000.000.000.00 01.000.000.000.000.000.000.000.00Q1.000.000.000.000.000.000.000.00{yNUMBERSINCLUSTERS:/724192723211811 ITERATION7- MINUS2LOGLIKELIHOOD=1153.20AIC=f1251.2SCHWARZCRITERION=f1398.7Y}POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.000.940.060.000.000.000.000.000.00h1.000.000.000.000.000.000.000.00.1.000.000.000.000.000.000.000.00| NUMBERSINCLUSTERS:/726172722221811$ ITERATION8;8\H MINUS2LOGLIKELIHOOD=1151.90AIC=f1249.9>qSCHWARZCRITERION=f1397.4POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES::&1.000.000.000.000.000.000.000.00=0.950.050.000.000.000.000.000.00b1.000.000.000.000.000.000.000.00f1.000.000.000.000.000.000.000.00i0QNUMBERSINCLUSTERS:/728152722221811j{ny ITERATION9r~- MINUS2LOGLIKELIHOOD=1147.7v0AIC=f1245.7zSCHWARZCRITERION=f1393.2[POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:Y1.000.000.000.000.000.000.000.00}0.970.030.000.000.000.000.000.001.000.000.000.000.000.000.000.00{1.000.000.000.000.000.000.000.00DhHNUMBERSINCLUSTERS:/828142722221811} ITERATION10MQ8 MINUS2LOGLIKELIHOOD=1144.4\0AIC=f1242.4THSCHWARZCRITERION=f1389.9XqPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.0030.980.020.000.000.000.000.000.007&1.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.00NUMBERSINCLUSTERS:/9271427222218110Q ITERATION11{y MINUS2LOGLIKELIHOOD=1146.00AIC=f1244.0-SCHWARZCRITERION=f1391.6POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:1.000.000.000.000.000.000.000.000.980.020.000.000.000.000.000.00Y1.000.000.000.000.000.000.000.00}1.000.000.000.000.000.000.000.00NUMBERSINCLUSTERS:/927142722221811hMIXINGPROBABILITIES:0.060.180.090.170.150.150.120.07MEANVECTORFORCLUSTER1:g4.551522.972071.354140.19874( MEANVECTORFORCLUSTER2:g4.971283.357771.477620.24818MEANVECTORFORCLUSTER3:g5.388583.884121.504050.27396 MEANVECTORFORCLUSTER4:g5.508412.612813.940531.211828MEANVECTORFORCLUSTER5:g6.365502.916834.578311.43323*\MEANVECTORFORCLUSTER6:g6.159442.802855.140881.80547-HMEANVECTORFORCLUSTER7:g6.588853.144405.569332.29217MEANVECTORFORCLUSTER8:g7.500653.081936.318882.00892q%םCOMMONCOVARIANCEMATRIX(MLE):&@0.022050.002600.003960.000110.002600.016690.001710.00159c00.003960.001710.020970.00196gQ0.000110.001590.001960.00547{yCONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION11.RESULTSAREPRINTEDBELOW.lp-NUMBERSINCLUSTERS:/927142722221811tNUMBEROFPARAMETERS=49xSCHWARZCRITERION=f1391.6Y0AIC=f1244.0}LISTOFCASES,BYCLUSTERhBCLUSTER1F CAS0 CAS0 CAS0K CAS0N8 CAS0R\ CAS0H CAS0 CAS0Vq CAS0ZCLUSTER2 CAS01& CAS05 CAS09 CAS0 CAS00 CAS0Q CAS0{ CAS0 y CAS0 CAS0 CAS0- CAS0 CAS0 CAS0 CAS0 CAS0Y CAS0} CAS0 CAS0 CAS0h CAS0 CAS0 CAS0 CAS0. CAS0| CAS08 CAS0\CLUSTER3!H CAS0; CAS0q CAS0 CAS0 CAS0>& CAS0 CAS0 CAS0: CAS0'0 CAS0aQ CAS0e{ CAS0iy CAS0 CAS0jCLUSTER4n- CAS0r CAS1 CAS0~ CAS0v CAS0yY CAS0} CAS0 CAS0 CAS0h CAS0 CAS0{ CAS0D CAS0H CAS0 CAS08 CAS0L\ CAS0PH CAS0 CAS0q CAS0T CAS1X CAS0& CAS0 CAS03 CAS07 CAS00 CAS0QCLUSTER5{ CAS0y CAS0 CAS0 CAS0- CAS0 CAS0 CAS0 CAS0 CAS0 Y CAS0} CAS1 CAS0 CAS0h CAS0 CAS0 CAS0 CAS0 CAS0 CAS0<8 CAS0&\ CAS0H CAS0CLUSTER6*q CAS1- CAS1 CAS1& CAS1% CAS1 CAS0 CAS00 CAS1#Q CAS1"{ CAS1cy CAS1g CAS1 CAS1- CAS1l CAS1p CAS1 CAS1 CAS1sY CAS1w} CAS1 CAS1 CAS0hCLUSTER7 CAS1 CAS1 CAS1B CAS1F CAS1I8 CAS1\ CAS1JH CAS1N CAS1Rq CAS1 CAS1 CAS1V& CAS1Z CAS1 CAS11 CAS140 CAS18Q CAS1{CLUSTER8 y CAS1  CAS1  CAS1 - CAS1  CAS1  CAS1  CAS1  CAS1 Y CAS1 } CAS1  CAS1  h ................................................................................    K=9CLUSTERS  8NUMBEROFPARAMETERS=54 \ +H INITIAL MEANS q !4.33.01.10.1 ;4.93.61.40.1 &5.12.53.01.1 5.52.43.71.0 5.82.85.12.4 >6.12.84.01.3 06.42.75.31.9 Q6.83.25.92.3 `{7.93.86.42.0 'y a ITERATION1 e i-  MINUS2LOGLIKELIHOOD=1438.3 j0AIC=f1546.3 nSCHWARZCRITERION=f1708.9 r YPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: }0.310.610.060.010.000.000.000.000.00 u0.280.630.070.010.000.010.000.000.00 y0.290.580.100.020.000.010.000.000.00 h0.280.530.150.030.000.010.000.000.00 NUMBERSINCLUSTERS:/04921815273351  { ITERATION2 C8 G\ H MINUS2LOGLIKELIHOOD=e778.8 0AIC=n886.8 LqSCHWARZCRITERION=f1049.4 P POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES: &0.690.310.000.000.000.000.000.000.00 T0.540.460.000.000.000.000.000.000.00 X0.690.310.000.000.000.000.000.000.00 0.760.240.000.000.000.000.000.000.00 0 2QNUMBERSINCLUSTERS:11394231621131310 6{ y ITERATION3- MINUS2LOGLIKELIHOOD=e840.6 0AIC=n948.6SCHWARZCRITERION=f1111.2YPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:}1.000.000.000.000.000.000.000.000.000.990.010.000.000.000.000.000.000.00 1.000.000.000.000.000.000.000.000.00h1.000.000.000.000.000.000.000.000.00 MNUMBERSINCLUSTERS:18326221221111810  ITERATION4 8\H MINUS2LOGLIKELIHOOD=1239.8<0AIC=f1347.8&qSCHWARZCRITERION=f1510.3POSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:*&1.000.000.000.000.000.000.000.000.00-1.000.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.000.00,0?QNUMBERSINCLUSTERS:2228622142011189{y# ITERATION5"c-g MINUS2LOGLIKELIHOOD=1331.30AIC=f1439.3SCHWARZCRITERION=f1601.8loYPOSTERIOR PROBSOF GROUPMEMBERSHIPFOR1ST4CASES:}1.000.000.000.000.000.000.000.000.001.000.000.000.000.000.000.000.000.00s1.000.000.000.000.000.000.000.000.00wh1.000.000.000.000.000.000.000.000.00NUMBERSINCLUSTERS:2228622142011189 MIXINGPROBABILITIES:0.150.190.040.150.090.130.070.120.06]8A\EHMEANVECTORFORCLUSTER1:g4.707103.126771.413350.19956IMEANVECTORFORCLUSTER2:g5.244103.667961.500750.28299qMEANVECTORFORCLUSTER3:g5.207832.367613.394161.01887JMEANVECTORFORCLUSTER4:g5.623832.711404.120591.28772NMEANVECTORFORCLUSTER5:g6.028972.849684.986141.92128R&MEANVECTORFORCLUSTER6:g6.410042.914934.585401.42517MEANVECTORFORCLUSTER7:g6.418312.772905.391431.67243MEANVECTORFORCLUSTER8:g6.660563.155705.616242.27793VMEANVECTORFORCLUSTER9:g7.576653.099766.420972.04453Y0Q0{COMMONCOVARIANCEMATRIX(MLE):4y80.017010.002620.00086-0.00049-0.002620.017240.000650.000700.000860.000650.010590.00116-0.000490.000700.001160.00411 CONVERGENCE:NOCASECHANGEDCLUSTERS AFTERITERATION5.RESULTSAREPRINTEDBELOW.Y}NUMBERSINCLUSTERS:2228622142011189hNUMBEROFPARAMETERS=54SCHWARZCRITERION=f1601.8 0AIC=f1439.38LISTOFCASES,BYCLUSTER\HCLUSTER1q CAS0+ CAS0 CAS0& CAS0! CAS0; CAS0 CAS00 CAS0Q CAS0_{ CAS0y CAS0 CAS0` CAS0'- CAS0a CAS0e CAS0i CAS0 CAS0Y CAS0m} CAS0q CAS0 CAS0hCLUSTER2u CAS0y CAS0 CAS0 CAS0 CAS08 CAS0\ CAS0H CAS0C CAS0Gq CAS0 CAS0 CAS0L& CAS0P CAS0 CAS0 CAS0S0 CAS0WQ CAS0{ CAS0y CAS02 CAS06 CAS0- CAS0 CAS0 CAS0 CAS0 CAS0 Y CAS0}CLUSTER3 CAS0 CAS0h CAS0 CAS0 CAS0 CAS0CLUSTER4 CAS18 CAS0\ CAS0H CAS0 CAS0q CAS0 CAS0< CAS0&& CAS0 CAS0 CAS0* CAS0^0 CAS0Q CAS0{ CAS1,y CAS0? CAS0 CAS0- CAS0# CAS0" CAS0c CAS0gCLUSTER5Y CAS1} CAS1k CAS1o CAS1h CAS1 CAS1s CAS0w CAS1 CAS1 CAS18 CAS1\ CAS1H CAS1] CAS1AqCLUSTER6E CAS0I CAS0& CAS0J CAS0N CAS0R CAS00 CAS0\Q CAS0U{ CAS0Yy CAS0 CAS00 CAS04- CAS08 CAS0 CAS0 CAS0 CAS0Y CAS0 } CAS0 CAS0CLUSTER7h CAS0 CAS1 CAS1 CAS1 CAS1 CAS18 CAS1\ CAS1H CAS1 CAS0q CAS1CLUSTER8 CAS1& CAS1+ CAS1 CAS1 CAS10 CAS1)Q CAS1/{ CAS1y CAS1 CAS1_ CAS1- CAS1 CAS1` CAS1' CAS1a CAS1dY CAS1h} CAS1CLUSTER9 CAS1mh CAS1q CAS1Ψ CAS1 CAS1u CAS1y CAS18 CAS1\ CAS1H ................................................................................qCG&FISHERIRISDATA (IRISDATSRTC1) MODELSELECTIONCRITERIALO000MODEL-SELECTIONCRITERIAQNUMBERMINUS2NUMBER(PPH=POST.PROB.OFMODEL):{OFeTIMESOFAKAIKEpSCHWARZ c?SyCLUSTERS,LOGOFPARAM-------------------------WKLIKELIHOOD ETERSVALUEPPHVALUEPPH------------------- --------------------------261n759.814787.80.00830.00.002n802.719840.70.00897.90.003n617.024665.01.00737.31.00Y4n619.429677.40.00764.70.00 }5n701.834769.80.00872.10.006n820.239898.20.001015.60.00 7n693.144781.10.00913.50.00h8f1146.0491244.00.001391.60.00 9f1331.3541439.30.001601.80.00 ................................................................................ 8\FISHERIRISDATA (IRISDATSRTC1)HqMIXPCMACLUSPAC-MIXTURE-MODELCLUSTERINGOF CASES & TIMEBEGAN:12/21/1989AT11:30:41<&0TIMEFINISHED:Q12/21/1989AT11:31:34${^y܌PROGRAM ENDEDNORMALLY.