# lexical demand report # For "C:\CANADA-@25\CA601" by on Thu Aug 25 09:57:26 2005 # ID code is &&111 Lexicon "english" contains 32159 words. right boxes ABSOLUTE area = 111.79 #Word listing for cumulative proportion distribution from 1 to 32159: # NOTE: Percentages are relative to the number of legitimate tokens. #RANK CORPUS% CUM.% WIDTH CORP.AREA N SAMPLE% DIFF% CUM.% RATIO AREA NET WORD 1 6.15914 6.1591 0.301030 1.8541 52 5.88901 -0.27012 5.89 0.96 1.7728 0.081315 %the 2 2.72130 8.8804 0.176091 1.5638 39 4.41676 1.69546 10.31 1.62 1.8148 -0.250990 %to 3 2.59284 11.4733 0.124939 1.4335 1 0.11325 -2.47959 10.42 0.04 1.3017 0.131717 %of 4 2.55127 14.0246 0.096910 1.3591 24 2.71801 0.16674 13.14 1.07 1.2731 0.086009 %a 5 2.38627 16.4108 0.079181 1.2994 17 1.92525 -0.46101 15.06 0.81 1.1927 0.106778 %and 6 2.10793 18.5188 0.066947 1.2398 11 1.24575 -0.86218 16.31 0.59 1.0918 0.148000 %in 7 1.15113 19.6699 0.057992 1.1407 4 0.45300 -0.69813 16.76 0.39 0.9720 0.168689 %that 8 1.00620 20.6761 0.051153 1.0576 14 1.58550 0.57930 18.35 1.58 0.9385 0.119162 %for 9 0.91579 21.5919 0.045757 0.9880 25 2.83126 1.91547 21.18 3.09 0.9690 0.018947 %is 10 0.85364 22.4455 0.041393 0.9291 20 2.26501 1.41136 23.44 2.65 0.9704 -0.041281 %said 11 0.75144 23.1970 0.037789 0.8766 4 0.45300 -0.29844 23.90 0.60 0.9030 -0.026409 %on 12 0.71655 23.9135 0.034762 0.8313 8 0.90600 0.18945 24.80 1.26 0.8622 -0.030879 %he 13 0.69811 24.6116 0.032185 0.7921 18 2.03851 1.34039 26.84 2.92 0.8638 -0.071730 %it 14 0.68409 25.2957 0.029963 0.7579 7 0.79275 0.10866 27.63 1.16 0.8280 -0.070035 %with 15 0.66133 25.9570 0.028029 0.7275 5 0.56625 -0.09507 28.20 0.86 0.7904 -0.062848 %was 17: 0.59474 27.1693 0.024824 0.6744 7 0.79275 0.19801 28.99 1.33 0.7197 -0.045247 %at 19: 0.48297 28.1459 0.022276 0.6270 4 0.45300 -0.02997 29.45 0.94 0.6559 -0.028941 %his 20 0.47241 28.6183 0.021189 0.6064 2 0.22650 -0.24591 29.67 0.48 0.6287 -0.022318 %be 21 0.46512 29.0834 0.020203 0.5876 1 0.11325 -0.35187 29.78 0.24 0.6018 -0.014170 %but 23: 0.44987 29.9965 0.018483 0.5544 6 0.67950 0.22964 30.46 1.51 0.5631 -0.008647 %have 24 0.43223 30.4287 0.017729 0.5395 9 1.01925 0.58703 31.48 2.36 0.5582 -0.018701 %are 25 0.40302 0.4030 0.017033 0.0069 32 3.62401 3.22099 3.62 8.99 0.0617 -0.054864 %i 27: 0.38407 1.1887 0.015794 0.0188 1 0.11325 -0.27082 3.74 0.29 0.0590 -0.040253 an 28 0.37692 1.5656 0.015240 0.0239 3 0.33975 -0.03717 4.08 0.90 0.0621 -0.038274 not 29 0.36787 1.9335 0.014723 0.0285 10 1.13250 0.76464 5.21 3.08 0.0767 -0.048234 they 30 0.35036 2.2838 0.014240 0.0325 1 0.11325 -0.23711 5.32 0.32 0.0758 -0.043276 who 31 0.34812 2.6319 0.013788 0.0363 12 1.35900 1.01088 6.68 3.90 0.0921 -0.055840 this 32 0.31459 2.9465 0.013364 0.0394 10 1.13250 0.81791 7.81 3.60 0.1044 -0.065052 will 34: 0.28631 3.5239 0.012589 0.0444 1 0.11325 -0.17306 7.93 0.40 0.0998 -0.055438 had 35 0.26799 3.7919 0.012234 0.0464 0 0.00000 -0.26799 7.93 0.00 0.0970 -0.050597 their 36 0.26575 4.0576 0.011899 0.0483 1 0.11325 -0.15250 8.04 0.43 0.0957 -0.047396 about 38: 0.25360 4.5764 0.011281 0.0516 6 0.67950 0.42590 8.72 2.68 0.0984 -0.046747 one 41: 0.24566 5.3225 0.010465 0.0557 8 0.90600 0.66035 9.63 3.69 0.1007 -0.045041 we 42 0.24359 5.5661 0.010219 0.0569 1 0.11325 -0.13034 9.74 0.46 0.0995 -0.042649 its 43 0.23767 5.8038 0.009984 0.0579 20 2.26501 2.02733 12.00 9.53 0.1199 -0.061910 you 44 0.23300 6.0368 0.009760 0.0589 1 0.11325 -0.11975 12.12 0.49 0.1183 -0.059349 were 45 0.23122 6.2680 0.009545 0.0598 1 0.11325 -0.11797 12.23 0.49 0.1167 -0.056919 when 49: 0.20388 7.1283 0.008774 0.0625 8 0.90600 0.70212 13.14 4.44 0.1153 -0.052720 up 50 0.20109 7.3294 0.008600 0.0630 0 0.00000 -0.20109 13.14 0.00 0.1130 -0.049947 if 52: 0.19193 7.7178 0.008273 0.0638 8 0.90600 0.71407 14.04 4.72 0.1162 -0.052326 all 53 0.19160 7.9094 0.008118 0.0642 3 0.33975 0.14815 14.38 1.77 0.1168 -0.052551 out 54 0.18435 8.0937 0.007969 0.0645 4 0.45300 0.26865 14.84 2.46 0.1182 -0.053727 there 56: 0.17919 8.4526 0.007687 0.0650 3 0.33975 0.16056 15.18 1.90 0.1167 -0.051678 she 59: 0.16662 8.9701 0.007299 0.0655 3 0.33975 0.17313 15.52 2.04 0.1132 -0.047775 some 60 0.16582 9.1359 0.007179 0.0656 0 0.00000 -0.16582 15.52 0.00 0.1114 -0.045795 no 62: 0.16295 9.4620 0.006949 0.0658 7 0.79275 0.62980 16.31 4.87 0.1133 -0.047572 two 63 0.16179 9.6238 0.006839 0.0658 15 1.69875 1.53697 18.01 10.50 0.1232 -0.057335 can 64 0.16155 9.7854 0.006733 0.0659 3 0.33975 0.17820 18.35 2.10 0.1235 -0.057646 what 65 0.16018 9.9455 0.006631 0.0659 1 0.11325 -0.04693 18.46 0.71 0.1224 -0.056454 other 66 0.15713 10.1027 0.006531 0.0660 2 0.22650 0.06937 18.69 1.44 0.1220 -0.056058 like 68: 0.15637 10.4157 0.006340 0.0660 2 0.22650 0.07014 18.91 1.45 0.1199 -0.053873 so 72: 0.14774 11.0162 0.005990 0.0660 4 0.45300 0.30526 19.37 3.07 0.1160 -0.050017 time 73 0.14478 11.1609 0.005909 0.0659 1 0.11325 -0.03153 19.48 0.78 0.1151 -0.049151 into 75: 0.14257 11.4478 0.005752 0.0659 0 0.00000 -0.14257 19.48 0.00 0.1120 -0.046199 million 78: 0.12942 11.8403 0.005532 0.0655 5 0.56625 0.43683 20.05 4.38 0.1109 -0.045394 them 80: 0.12567 12.0951 0.005395 0.0653 1 0.11325 -0.01242 20.16 0.90 0.1088 -0.043503 now 82: 0.12526 12.3458 0.005264 0.0650 1 0.11325 -0.01201 20.27 0.90 0.1067 -0.041724 him 87: 0.10511 12.9284 0.004963 0.0642 4 0.45300 0.34789 20.72 4.31 0.1029 -0.038697 get 92: 0.09389 13.4221 0.004695 0.0630 2 0.22650 0.13261 20.95 2.41 0.0984 -0.035350 my 93 0.09378 13.5159 0.004645 0.0628 5 0.56625 0.47248 21.52 6.04 0.0999 -0.037167 may 96: 0.08894 13.7851 0.004501 0.0620 1 0.11325 0.02431 21.63 1.27 0.0973 -0.035310 three 98: 0.08773 13.9607 0.004409 0.0616 2 0.22650 0.13877 21.86 2.58 0.0964 -0.034817 then 100: 0.08695 14.1347 0.004321 0.0611 0 0.00000 -0.08695 21.86 0.00 0.0945 -0.033372 where 102: 0.08598 14.3074 0.004237 0.0606 1 0.11325 0.02727 21.97 1.32 0.0931 -0.032469 back 110: 0.08273 14.9789 0.003930 0.0589 1 0.11325 0.03052 22.08 1.37 0.0868 -0.027924 down 114: 0.08030 15.3028 0.003793 0.0580 4 0.45300 0.37270 22.54 5.64 0.0855 -0.027439 say 115 0.07768 15.3805 0.003760 0.0578 6 0.67950 0.60182 23.22 8.75 0.0873 -0.029464 did 116 0.07754 15.4580 0.003728 0.0576 6 0.67950 0.60196 23.90 8.76 0.0891 -0.031455 good 123: 0.07331 15.9838 0.003517 0.0562 1 0.11325 0.03994 24.01 1.54 0.0844 -0.028221 think 127: 0.07114 16.2720 0.003406 0.0554 7 0.79275 0.72161 24.80 11.14 0.0845 -0.029055 day 129: 0.06953 16.4117 0.003354 0.0550 7 0.79275 0.72322 25.59 11.40 0.0858 -0.030796 me 130 0.06940 16.4811 0.003328 0.0548 1 0.11325 0.04385 25.71 1.63 0.0856 -0.030706 world 131 0.06728 16.5484 0.003303 0.0547 1 0.11325 0.04597 25.82 1.68 0.0853 -0.030624 these 137: 0.06581 16.9471 0.003159 0.0535 4 0.45300 0.38719 26.27 6.88 0.0830 -0.029459 here 139: 0.06547 17.0783 0.003113 0.0532 2 0.22650 0.16103 26.50 3.46 0.0825 -0.029334 well 140 0.06543 17.1438 0.003091 0.0530 2 0.22650 0.16107 26.73 3.46 0.0826 -0.029623 house 141 0.06538 17.2091 0.003069 0.0528 8 0.90600 0.84062 27.63 13.86 0.0848 -0.031993 go 145: 0.06424 17.4676 0.002985 0.0521 3 0.33975 0.27551 27.97 5.29 0.0835 -0.031356 home 146 0.06358 17.5312 0.002964 0.0520 2 0.22650 0.16292 28.20 3.56 0.0836 -0.031625 take 150: 0.06133 17.7787 0.002886 0.0513 22 2.49151 2.43018 30.69 40.63 0.0886 -0.037260 see 151 0.06056 17.8392 0.002867 0.0511 5 0.56625 0.50569 31.26 9.35 0.0896 -0.038464 too 154: 0.05997 18.0201 0.002811 0.0507 13 1.47225 1.41228 32.73 24.55 0.0920 -0.041347 want 161: 0.05733 18.4283 0.002689 0.0496 3 0.33975 0.28242 33.07 5.93 0.0889 -0.039371 your 164: 0.05657 18.5987 0.002640 0.0491 5 0.56625 0.50968 33.64 10.01 0.0888 -0.039698 little 169: 0.05406 18.8743 0.002562 0.0484 1 0.11325 0.05919 33.75 2.09 0.0865 -0.038111 four 178: 0.05211 19.3497 0.002433 0.0471 4 0.45300 0.40090 34.20 8.69 0.0832 -0.036135 big 181: 0.05091 19.5029 0.002393 0.0467 7 0.79275 0.74184 34.99 15.57 0.0837 -0.037068 play 183: 0.05076 19.6045 0.002367 0.0464 9 1.01925 0.96849 36.01 20.08 0.0852 -0.038836 come 194: 0.04886 20.1512 0.002233 0.0450 8 0.90600 0.85715 36.92 18.54 0.0824 -0.037442 us 196: 0.04793 20.2478 0.002210 0.0448 4 0.45300 0.40507 37.37 9.45 0.0826 -0.037848 school 200: 0.04687 20.4370 0.002166 0.0443 0 0.00000 -0.04687 37.37 0.00 0.0810 -0.036684 fell 214: 0.04416 21.0760 0.002025 0.0427 1 0.11325 0.06909 37.49 2.56 0.0759 -0.033225 five 215 0.04393 21.1200 0.002015 0.0426 3 0.33975 0.29582 37.83 7.73 0.0762 -0.033667 called 221: 0.04303 21.3805 0.001961 0.0419 4 0.45300 0.40997 38.28 10.53 0.0751 -0.033132 came 222 0.04271 21.4232 0.001952 0.0418 2 0.22650 0.18379 38.51 5.30 0.0752 -0.033342 white 227: 0.04129 21.6327 0.001909 0.0413 1 0.11325 0.07196 38.62 2.74 0.0737 -0.032425 show 231: 0.04084 21.7967 0.001876 0.0409 2 0.22650 0.18567 38.84 5.55 0.0729 -0.031982 help 232 0.04078 21.8375 0.001868 0.0408 1 0.11325 0.07247 38.96 2.78 0.0728 -0.031980 today 236: 0.03995 21.9989 0.001836 0.0404 2 0.22650 0.18655 39.18 5.67 0.0720 -0.031559 games 237 0.03989 22.0388 0.001829 0.0403 5 0.56625 0.52636 39.75 14.20 0.0727 -0.032388 something 243: 0.03927 22.2763 0.001784 0.0397 1 0.11325 0.07398 39.86 2.88 0.0711 -0.031369 family 244 0.03908 22.3154 0.001776 0.0396 4 0.45300 0.41392 40.32 11.59 0.0716 -0.031976 things 247: 0.03867 22.4316 0.001755 0.0394 1 0.11325 0.07458 40.43 2.93 0.0709 -0.031583 far 250: 0.03854 22.5475 0.001734 0.0391 0 0.00000 -0.03854 40.43 0.00 0.0701 -0.031004 past 261: 0.03726 22.9629 0.001661 0.0381 2 0.22650 0.18924 40.66 6.08 0.0675 -0.029386 took 267: 0.03681 23.1852 0.001624 0.0376 7 0.79275 0.75595 41.45 21.54 0.0673 -0.029653 children 270: 0.03617 23.2943 0.001606 0.0374 4 0.45300 0.41683 41.90 12.52 0.0673 -0.029876 look 272: 0.03604 23.3664 0.001594 0.0372 2 0.22650 0.19046 42.13 6.28 0.0671 -0.029903 away 291: 0.03391 24.0267 0.001490 0.0358 7 0.79275 0.75884 42.92 23.38 0.0639 -0.028151 went 294: 0.03363 24.1278 0.001475 0.0356 1 0.11325 0.07962 43.04 3.37 0.0635 -0.027882 six 296: 0.03336 24.1945 0.001465 0.0354 1 0.11325 0.07989 43.15 3.39 0.0632 -0.027762 plan 299: 0.03302 24.2941 0.001450 0.0352 1 0.11325 0.08023 43.26 3.43 0.0627 -0.027504 keep 300 0.03295 24.3270 0.001445 0.0352 0 0.00000 -0.03295 43.26 0.00 0.0625 -0.027365 give 301 0.03295 24.3600 0.001440 0.0351 3 0.33975 0.30680 43.60 10.31 0.0628 -0.027716 asked 314: 0.03226 24.7844 0.001381 0.0342 1 0.11325 0.08099 43.71 3.51 0.0604 -0.026141 old 325: 0.03151 25.1355 0.001334 0.0335 3 0.33975 0.30824 44.05 10.78 0.0588 -0.025242 find 351: 0.02990 25.9344 0.001236 0.0320 1 0.11325 0.08335 44.17 3.79 0.0546 -0.022528 party 384: 0.02711 26.8769 0.001130 0.0304 7 0.79275 0.76565 44.96 29.25 0.0508 -0.020425 black 392: 0.02678 27.0921 0.001106 0.0300 3 0.33975 0.31297 45.30 12.69 0.0501 -0.020147 played 400: 0.02636 27.3043 0.001084 0.0296 0 0.00000 -0.02636 45.30 0.00 0.0491 -0.019514 kind 409: 0.02567 27.5373 0.001061 0.0292 4 0.45300 0.42733 45.75 17.64 0.0485 -0.019319 television 412: 0.02564 27.6142 0.001053 0.0291 4 0.45300 0.42736 46.21 17.67 0.0486 -0.019574 wanted 479: 0.02268 29.2203 0.000906 0.0265 1 0.11325 0.09057 46.32 4.99 0.0420 -0.015487 playing 500: 0.02165 29.6848 0.000868 0.0258 3 0.33975 0.31810 46.66 15.69 0.0405 -0.014729 coming 520: 0.02095 30.1107 0.000834 0.0251 1 0.11325 0.09230 46.77 5.41 0.0390 -0.013902 try 534: 0.02041 30.3998 0.000813 0.0247 2 0.22650 0.20610 47.00 11.10 0.0382 -0.013487 car 555: 0.01981 30.8204 0.000782 0.0241 1 0.11325 0.09344 47.11 5.72 0.0368 -0.012737 food 561: 0.01964 30.9388 0.000773 0.0239 4 0.45300 0.43336 47.57 23.07 0.0368 -0.012860 let 582: 0.01896 31.3439 0.000746 0.0234 1 0.11325 0.09429 47.68 5.97 0.0355 -0.012179 everything 593: 0.01853 31.5495 0.000732 0.0231 1 0.11325 0.09472 47.79 6.11 0.0350 -0.011885 live 600: 0.01840 31.6787 0.000723 0.0229 0 0.00000 -0.01840 47.79 0.00 0.0346 -0.011653 republicans 601 0.01838 31.6971 0.000722 0.0229 2 0.22650 0.20812 48.02 12.32 0.0347 -0.011784 soon 602 0.01836 31.7155 0.000721 0.0229 1 0.11325 0.09489 48.13 6.17 0.0347 -0.011833 wants 615: 0.01813 31.9524 0.000706 0.0225 2 0.22650 0.20837 48.36 12.49 0.0341 -0.011576 tell 623: 0.01792 32.0965 0.000697 0.0224 2 0.22650 0.20858 48.58 12.64 0.0338 -0.011485 red 639: 0.01745 32.3788 0.000679 0.0220 1 0.11325 0.09580 48.70 6.49 0.0331 -0.011082 father 662: 0.01696 32.7743 0.000656 0.0215 1 0.11325 0.09629 48.81 6.68 0.0320 -0.010513 morning 666: 0.01689 32.8419 0.000652 0.0214 2 0.22650 0.20961 49.04 13.41 0.0320 -0.010553 someone 667 0.01689 32.8588 0.000651 0.0214 1 0.11325 0.09637 49.15 6.71 0.0320 -0.010600 mother 669: 0.01687 32.8925 0.000649 0.0213 3 0.33975 0.32289 49.49 20.15 0.0321 -0.010767 saw 699: 0.01618 33.3877 0.000621 0.0207 2 0.22650 0.21032 49.72 14.00 0.0309 -0.010138 brown 700 0.01613 33.4038 0.000620 0.0207 0 0.00000 -0.01613 49.72 0.00 0.0308 -0.010114 social 709: 0.01593 33.5481 0.000612 0.0205 1 0.11325 0.09732 49.83 7.11 0.0305 -0.009966 calls 750: 0.01518 34.1865 0.000579 0.0198 3 0.33975 0.32457 50.17 22.38 0.0290 -0.009249 stop 800: 0.01437 34.9267 0.000543 0.0189 1 0.11325 0.09888 50.28 7.88 0.0273 -0.008331 showed 802: 0.01436 34.9554 0.000541 0.0189 1 0.11325 0.09889 50.40 7.89 0.0273 -0.008356 club 849: 0.01364 35.6146 0.000511 0.0182 1 0.11325 0.09961 50.51 8.30 0.0258 -0.007615 goes 853: 0.01353 35.6690 0.000509 0.0181 3 0.33975 0.32622 50.85 25.11 0.0259 -0.007724 green 900: 0.01288 36.2885 0.000482 0.0175 0 0.00000 -0.01288 50.85 0.00 0.0245 -0.007022 situation 924: 0.01257 36.5940 0.000470 0.0172 1 0.11325 0.10068 50.96 9.01 0.0239 -0.006750 read 949: 0.01227 36.9052 0.000457 0.0169 1 0.11325 0.10098 51.08 9.23 0.0234 -0.006482 stores 977: 0.01191 37.2435 0.000444 0.0165 3 0.33975 0.32784 51.42 28.52 0.0228 -0.006297 cannot 1000: 0.01169 37.5145 0.000434 0.0163 1 0.11325 0.10156 51.53 9.69 0.0224 -0.006083 looked 1200: 0.00955 39.6205 0.000362 0.0143 0 0.00000 -0.00955 51.53 0.00 0.0186 -0.004308 version 1202: 0.00954 39.6396 0.000361 0.0143 1 0.11325 0.10371 51.64 11.87 0.0187 -0.004335 ran 1400: 0.00824 41.3869 0.000310 0.0128 0 0.00000 -0.00824 51.64 0.00 0.0160 -0.003180 learn 1406: 0.00821 41.4363 0.000309 0.0128 2 0.22650 0.21830 51.87 27.61 0.0160 -0.003221 fun 1430: 0.00806 41.6313 0.000304 0.0126 1 0.11325 0.10519 51.98 14.05 0.0158 -0.003142 boy 1503: 0.00775 42.2090 0.000289 0.0122 3 0.33975 0.33200 52.32 43.85 0.0151 -0.002921 yes 1592: 0.00728 42.8778 0.000273 0.0117 5 0.56625 0.55897 52.89 77.76 0.0144 -0.002730 miss 1600: 0.00723 42.9359 0.000271 0.0117 0 0.00000 -0.00723 52.89 0.00 0.0144 -0.002700 block 1698: 0.00672 43.6174 0.000256 0.0112 2 0.22650 0.21978 53.11 33.69 0.0136 -0.002428 garden 1753: 0.00652 43.9814 0.000248 0.0109 1 0.11325 0.10673 53.23 17.37 0.0132 -0.002290 girl 1800: 0.00632 44.2835 0.000241 0.0107 0 0.00000 -0.00632 53.23 0.00 0.0128 -0.002157 loan 1820: 0.00620 44.4087 0.000239 0.0106 1 0.11325 0.10705 53.34 18.26 0.0127 -0.002131 surprise 1826: 0.00617 44.4457 0.000238 0.0106 1 0.11325 0.10708 53.45 18.35 0.0127 -0.002142 boys 1831: 0.00616 44.4766 0.000237 0.0105 3 0.33975 0.33359 53.79 55.15 0.0128 -0.002209 cowboys 1870: 0.00605 44.7148 0.000232 0.0104 1 0.11325 0.10720 53.91 18.71 0.0125 -0.002134 leaves 1900: 0.00592 44.8942 0.000229 0.0103 1 0.11325 0.10733 54.02 19.12 0.0123 -0.002085 girls 1923: 0.00584 45.0294 0.000226 0.0102 4 0.45300 0.44716 54.47 77.56 0.0123 -0.002132 count 1974: 0.00569 45.3229 0.000220 0.0100 4 0.45300 0.44731 54.93 79.64 0.0121 -0.002112 catch 2000: 0.00561 45.4698 0.000217 0.0099 0 0.00000 -0.00561 54.93 0.00 0.0119 -0.002053 uses 2050: 0.00547 45.7465 0.000212 0.0097 1 0.11325 0.10778 55.04 20.69 0.0117 -0.001968 train 2076: 0.00542 45.8883 0.000209 0.0096 3 0.33975 0.33433 55.38 62.64 0.0116 -0.001985 song 2146: 0.00528 46.2630 0.000202 0.0094 1 0.11325 0.10797 55.49 21.47 0.0112 -0.001867 songs 2171: 0.00519 46.3939 0.000200 0.0093 1 0.11325 0.10806 55.61 21.80 0.0111 -0.001842 wild 2176: 0.00517 46.4198 0.000200 0.0093 2 0.22650 0.22133 55.83 43.78 0.0111 -0.001878 ride 2178: 0.00517 46.4301 0.000199 0.0093 1 0.11325 0.10808 55.95 21.91 0.0112 -0.001897 jumped 2247: 0.00500 46.7813 0.000193 0.0090 2 0.22650 0.22150 56.17 45.26 0.0109 -0.001815 dog 2252: 0.00500 46.8063 0.000193 0.0090 1 0.11325 0.10825 56.29 22.66 0.0109 -0.001828 guess 2277: 0.00493 46.9304 0.000191 0.0089 4 0.45300 0.44807 56.74 91.83 0.0108 -0.001870 eat 2414: 0.00459 47.5826 0.000180 0.0086 2 0.22650 0.22191 56.96 49.38 0.0102 -0.001688 oh 2415 0.00459 47.5872 0.000180 0.0086 1 0.11325 0.10866 57.08 24.69 0.0103 -0.001706 row 2436: 0.00453 47.6829 0.000178 0.0085 3 0.33975 0.33522 57.42 75.03 0.0102 -0.001735 apple 2460: 0.00447 47.7911 0.000177 0.0084 3 0.33975 0.33528 57.76 75.92 0.0102 -0.001759 orange 2500: 0.00441 47.9688 0.000174 0.0083 0 0.00000 -0.00441 57.76 0.00 0.0100 -0.001700 =olympics 2502: 0.00440 47.9776 0.000174 0.0083 2 0.22650 0.22210 57.98 51.45 0.0101 -0.001737 animals 2694: 0.00401 48.7851 0.000161 0.0079 1 0.11325 0.10924 58.10 28.21 0.0094 -0.001501 please 2738: 0.00393 48.9599 0.000159 0.0078 1 0.11325 0.10932 58.21 28.79 0.0092 -0.001467 tree 2745: 0.00392 48.9873 0.000158 0.0077 5 0.56625 0.56233 58.78 144.49 0.0093 -0.001549 funny 2891: 0.00370 49.5425 0.000150 0.0074 1 0.11325 0.10955 58.89 30.58 0.0088 -0.001404 sweet 2929: 0.00365 49.6817 0.000148 0.0074 1 0.11325 0.10961 59.00 31.07 0.0087 -0.001382 listen 2981: 0.00357 49.8693 0.000146 0.0073 2 0.22650 0.22293 59.23 63.39 0.0086 -0.001363 animal 2999: 0.00353 49.9333 0.000145 0.0072 1 0.11325 0.10972 59.34 32.05 0.0086 -0.001362 sleep 3000 0.00353 49.9368 0.000145 0.0072 0 0.00000 -0.00353 59.34 0.00 0.0086 -0.001361 =sam 3075: 0.00341 50.1968 0.000141 0.0071 2 0.22650 0.22309 59.57 66.34 0.0084 -0.001324 yellow 3266: 0.00317 50.8230 0.000133 0.0068 1 0.11325 0.11008 59.68 35.75 0.0079 -0.001178 smile 3500: 0.00290 51.5329 0.000124 0.0064 0 0.00000 -0.00290 59.68 0.00 0.0074 -0.001011 reasonable 4000: 0.00246 52.8696 0.000109 0.0057 0 0.00000 -0.00246 59.68 0.00 0.0065 -0.000740 rushing 4106: 0.00237 53.1259 0.000106 0.0056 5 0.56625 0.56388 60.25 238.62 0.0064 -0.000753 thank 4132: 0.00235 53.1873 0.000105 0.0056 1 0.11325 0.11090 60.36 48.17 0.0063 -0.000754 birds 4333: 0.00221 53.6456 0.000100 0.0054 2 0.22650 0.22429 60.59 102.49 0.0061 -0.000696 toy 4500: 0.00211 54.0055 0.000096 0.0052 0 0.00000 -0.00211 60.59 0.00 0.0058 -0.000635 resignation 4607: 0.00204 54.2270 0.000094 0.0051 1 0.11325 0.11121 60.70 55.62 0.0057 -0.000610 cry 4743: 0.00196 54.4992 0.000092 0.0050 6 0.67950 0.67754 61.38 346.15 0.0056 -0.000630 sing 5000: 0.00182 54.9860 0.000087 0.0048 0 0.00000 -0.00182 61.38 0.00 0.0053 -0.000555 defendants 5077: 0.00179 55.1249 0.000086 0.0047 1 0.11325 0.11147 61.49 63.45 0.0053 -0.000545 beans 5332: 0.00168 55.5664 0.000081 0.0045 2 0.22650 0.22482 61.72 134.82 0.0050 -0.000501 pet 5500: 0.00160 55.8425 0.000079 0.0044 0 0.00000 -0.00160 61.72 0.00 0.0049 -0.000464 potatoes 5850: 0.00146 56.3787 0.000074 0.0042 5 0.56625 0.56479 62.29 388.38 0.0046 -0.000439 twins 5852: 0.00146 56.3816 0.000074 0.0042 1 0.11325 0.11179 62.40 77.68 0.0046 -0.000447 reads 6000: 0.00141 56.5941 0.000072 0.0041 0 0.00000 -0.00141 62.40 0.00 0.0045 -0.000420 midst 6500: 0.00125 57.2620 0.000067 0.0038 0 0.00000 -0.00125 62.40 0.00 0.0042 -0.000343 stepping 6507: 0.00125 57.2707 0.000067 0.0038 2 0.22650 0.22525 62.63 180.91 0.0042 -0.000357 leaf 6735: 0.00119 57.5488 0.000064 0.0037 5 0.56625 0.56506 63.19 475.04 0.0041 -0.000364 cookies 6784: 0.00118 57.6069 0.000064 0.0037 1 0.11325 0.11207 63.31 96.14 0.0041 -0.000365 cowboy 6814: 0.00117 57.6421 0.000064 0.0037 5 0.56625 0.56508 63.87 484.39 0.0041 -0.000397 circus 7000: 0.00112 57.8553 0.000062 0.0036 0 0.00000 -0.00112 63.87 0.00 0.0040 -0.000373 evolved 7471: 0.00103 58.3608 0.000058 0.0034 1 0.11325 0.11223 63.99 110.49 0.0037 -0.000327 laughs 7500: 0.00102 58.3904 0.000058 0.0034 0 0.00000 -0.00102 63.99 0.00 0.0037 -0.000324 =hispanics 7573: 0.00100 58.4641 0.000057 0.0034 3 0.33975 0.33875 64.33 338.40 0.0037 -0.000336 tail 7966: 0.00093 58.8445 0.000055 0.0032 1 0.11325 0.11232 64.44 121.51 0.0035 -0.000305 pond 7993: 0.00093 58.8696 0.000054 0.0032 2 0.22650 0.22557 64.67 244.07 0.0035 -0.000315 cried 8000: 0.00093 58.8761 0.000054 0.0032 0 0.00000 -0.00093 64.67 0.00 0.0035 -0.000314 newer 8198: 0.00089 59.0560 0.000053 0.0031 2 0.22650 0.22561 64.89 254.21 0.0034 -0.000309 aunt 8500: 0.00085 59.3187 0.000051 0.0030 0 0.00000 -0.00085 64.89 0.00 0.0033 -0.000285 =donaldson 9000: 0.00078 59.7256 0.000048 0.0029 0 0.00000 -0.00078 64.89 0.00 0.0031 -0.000249 download 9286: 0.00074 59.9433 0.000047 0.0028 1 0.11325 0.11251 65.01 152.22 0.0030 -0.000237 rows 9500: 0.00072 60.0998 0.000046 0.0027 0 0.00000 -0.00072 65.01 0.00 0.0030 -0.000224 =rupert 10000: 0.00067 60.4471 0.000043 0.0026 0 0.00000 -0.00067 65.01 0.00 0.0028 -0.000198 pounding 13339: 0.00043 62.2254 0.000033 0.0020 4 0.45300 0.45258 65.46 1063.38 0.0021 -0.000105 peas 15095: 0.00035 62.9054 0.000029 0.0018 5 0.56625 0.56590 66.02 1608.67 0.0019 -0.000090 clown 17070: 0.00029 63.5388 0.000025 0.0016 1 0.11325 0.11296 66.14 386.52 0.0017 -0.000066 beaver 20000: 0.00022 64.2900 0.000022 0.0014 0 0.00000 -0.00022 66.14 0.00 0.0014 -0.000040 insolvent 20777: 0.00021 64.4597 0.000021 0.0013 1 0.11325 0.11304 66.25 534.20 0.0014 -0.000037 hopped 21574: 0.00020 64.6232 0.000020 0.0013 1 0.11325 0.11305 66.36 569.10 0.0013 -0.000035 clowns 23472: 0.00017 64.9744 0.000019 0.0012 2 0.22650 0.22633 66.59 1316.86 0.0012 -0.000030 faraway 23655: 0.00017 65.0057 0.000018 0.0012 1 0.11325 0.11308 66.70 666.18 0.0012 -0.000031 farmer's 30000: 0.00011 65.8841 0.000014 0.0010 0 0.00000 -0.00011 66.70 0.00 0.0010 -0.000012 =ft -------- # Ratio of actual usage to standard usage for common words: 0.04 of 0.24 but 0.29 an 0.32 who 0.39 that 0.40 had 0.43 about 0.46 its 0.48 be 0.49 were 0.49 when 0.59 in 0.60 on 0.71 other 0.78 into 0.81 and 0.86 was 0.90 now 0.90 not 0.90 him 0.94 his 0.96 the 1.07 a 1.16 with 1.26 he 1.27 three 1.32 back 1.33 at 1.37 down 1.44 like 1.45 so 1.51 have 1.54 think 1.58 for 1.62 to 1.63 world 1.68 these 1.77 out 1.90 she 2.04 some 2.09 four 2.10 what 2.36 are 2.41 my 2.46 there 2.56 five 2.58 then 2.65 said 2.68 one 2.74 show 2.78 today 2.88 family 2.92 it 2.93 far 3.07 time 3.08 they 3.09 is 3.37 six 3.39 plan 3.43 keep 3.46 well 3.46 house 3.51 old 3.56 take 3.60 will 3.69 we 3.79 party 3.90 this 4.31 get 4.38 them 4.44 up 4.72 all 4.87 two 4.99 playing 5.29 home 5.30 white 5.41 try 5.55 help 5.64 say 5.67 games 5.72 food 5.93 your 5.97 everything 6.04 may 6.08 took 6.11 live 6.17 wants 6.28 away 6.49 father 6.68 morning 6.71 mother 6.88 here 7.11 calls 7.73 called 7.88 showed 7.89 club 8.30 goes 8.69 big 8.75 did 8.76 good 8.99 i 9.01 read 9.23 stores 9.35 too 9.45 school 9.53 you 9.69 looked 10.01 little 10.31 asked 10.50 can 10.53 came 10.78 find 11.10 car 11.14 day 11.40 me 11.59 things 11.87 ran 12.32 soon 12.49 tell 12.52 look 12.64 red 12.69 played 13.41 someone 13.86 go 14.00 brown 14.05 boy 14.20 something 15.57 play 15.69 coming 17.37 girl 17.64 television 17.67 wanted 18.26 surprise 18.35 boys 18.54 us 18.71 leaves 19.12 girls 20.08 come 20.15 saw 20.69 train 21.47 songs 21.54 children 21.80 wild 21.91 jumped 22.38 stop 22.66 guess 23.07 let 23.38 went 24.55 want 24.69 row 25.11 green 27.61 fun 28.21 please 28.52 cannot 28.79 tree 29.25 black 30.58 sweet 31.07 listen 32.05 sleep 33.69 garden 35.75 smile 40.63 see 43.78 ride 43.85 yes 45.26 dog 48.17 birds 49.38 oh 51.45 animals 55.15 cowboys 55.62 cry 62.64 song 63.39 animal 63.45 beans 66.34 yellow 75.03 apple 75.92 orange 77.56 count 77.68 reads 77.76 miss 79.64 catch 91.83 eat 96.14 cowboy 102.49 toy 110.49 laughs 121.51 pond 134.82 pet 144.49 funny 152.22 rows 180.91 leaf 238.62 thank 244.07 cried 254.21 aunt 338.40 tail 346.15 sing 386.52 beaver 388.38 twins 475.04 cookies 484.39 circus 534.20 hopped 569.10 clowns 666.18 farmer's 1063.38 peas 1316.86 faraway 1608.67 clown -------- # 16 rare legitimate tokens, 6 rare legitimate token types: 2 beavers 2 caterpillar 4 caterpillars 1 hem 5 kitten 2 playtime -------- # 0 rare tokens (0 token types) were ignored: -------- # 75 illegitimate tokens, 28 illegitimate token types: 1 ='Shsh 1 =1 1 =Buttercup 5 =Christmas 3 =Cookie 7 =Father 1 =God 2 =Grandfather 2 =Grandmother 5 =Green 1 =GreenPlayHouse 2 =HippityHop 1 =HippityHopShow' 1 =Joy 1 =Joy's 2 =LittleGirl 3 =March 5 =Mother 2 =Paul 2 =Peter 10 =Sandy 1 =Sandy's 2 =Splash 9 =Susan 1 =WillingWorkersClub 1 =day' 2 =hippityhop 1 =hophophop -------- General summary of sample text: 958 tokens of all kinds (excluding punctuation); trailing tokens were: 883 legitimate tokens (including woodpecker exceptions) 162 sentences 139 sentences ending in periods (85.8 percent) 12 sentences ending in question marks (7.4 percent) 11 sentences ending in exclamation marks (6.8 percent) 0 sentences ending in "@" (0.0 percent) 5.9 tokens/sentence average 5.0 tokens in median-length sentence 29 tokens in longest sentence Most overused words are: clown(1608), faraway(1316), peas(1063), farmer's(666), clowns(569), hopped(534), circus(484), cookies(475) For grammatical words: token count = 310 token types = 22 aggregate percentage of legit tokens = 35.11% aggregate percentage of total tokens = 32.36% mean U-value = 21581.6774 right boxes ABSOLUTE area = 22.33 right boxes NET area = 0.03 total contribution = 21.7310 For common_content words: token count = 557 token types = 182 aggregate percentage of legit tokens = 63.08% aggregate percentage of total tokens = 58.14% mean U-value = 865.6769 25% rank = 63.0 25% rank uvalue = 1615.4700 50% (median) rank = 164.0 50% (median) rank uvalue = 562.2900 75% rank = 750.0 75% rank uvalue = 151.8100 right boxes ABSOLUTE area = 139.88 right boxes NET area = -28.09 total contribution = 18.9692 For common words: token count = 867 token types = 204 aggregate percentage of legit tokens = 98.19% aggregate percentage of total tokens = 90.50% mean U-value = 8272.7821 right boxes ABSOLUTE area = 162.21 right boxes NET area = -28.05 total contribution = 40.7002 For legitimate words: token count = 883 token types = 210 aggregate percentage of legit tokens = 100.00% aggregate percentage of total tokens = 92.17% mean U-value = 8122.8843 right boxes ABSOLUTE area = 162.21 right boxes NET area = -28.05 total contribution = 40.7002 For all_content words: token count = 573 token types = 188 aggregate percentage of legit tokens = 64.89% aggregate percentage of total tokens = 59.81% mean U-value = 841.5128 right boxes ABSOLUTE area = 139.88 right boxes NET area = -28.09 total contribution = 18.9692 For rare legitimate words: 0 rare tokens ignored due to "Woody Woodpecker" exception (0.0000% of total tokens) token count = 16 token types = 6 aggregate percentage of legit tokens = 1.81% aggregate percentage of total tokens = 1.67% For illegitimate words: token count = 75 token types = 28 aggregate percentage of total tokens = 7.83% Weighted sum of frequency differences: 0.094953