The CMAT Scoring Software and Reporting System is designed to allow efficient, accurate, and convenient scoring of the Comprehensive Mathematical Abilities Test using either age-based or grade-based norms. First, the system uses the raw scores to compute the standard scores for subtests, composite scores, percentiles, age and grade equivalents (for age norms only), and descriptive ratings for each score. Second, the scores are profiled graphically. Third, each pair of scores is examined for possible significant differences between scores. Fourth, the confidence intervals for the 68th, 95th, and 99th levels are generated. Fifth, up to five scores from other tests can be added for comparison to the CMAT scores.
The CMAT Scoring Software and Reporting System is designed around a custom word-processing system that, in addition to providing the features commonly associated with word processors (i.e., cut, paste, change fonts, etc.), has menu choices and dialog boxes to accept client data and raw scores for the CMAT and automatically generates analytical reports.
Because assessment consists of much more than test scores, the examiner can augment the generated report with diagnostic narrative. The report can be saved, reopened later for further editing, and printed — all without leaving the CMAT Scoring Software and Reporting System. The editing conventions of the built-in word processor are designed to be consistent with those of Windows word-processing systems. For examiners who prefer to use another word-processing system, the generated report can be saved to disk and opened by a third-party word processor. The CMAT Scoring Software and Reporting System word processor saves data in the rich text format (.rtf), which is readily opened by leading word-processing programs including Open Office, Word, WordPerfect, and WordPro.
Each time you start the CMAT Scoring Software and Reporting System, the program displays this instruction document. You may read the documentation within the program, or you may print from the File menu. When you generate a client report, the report replaces this document in the CMAT Scoring Software and Reporting System word processor.
Menu choices on the Client menu provide for the input of client information, CMAT raw-score data, and initiate the generation of a CMAT Scoring Software and Reporting System client report.
New Client. This menu option clears the background, comparative test score, and rawscore data from the previous client and presents the dialog boxes for entering the data for a new client. Information on each dialog box is presented in the "Edit" sections below.
Open Client Data File. This menu option activates a Windows File Open dialog box to allow you to load the Client Info, CMAT Raw Scores, and Comparative Test Scores from a saved client dataset. (The option to load a previously generated report is located on the File menu.)
Save Client Data File. This menu option activates a Windows File Save dialog box to allow you to save the Client Info, CMAT Raw Scores, and Comparative Test Scores for later analysis. Selecting this option DOES NOT SAVE THE REPORT. To save the generated report, select Save from the File menu.
Edit Background Information. This option activates the Client Info dialog box.
To use age-based norms, it is required to enter both the date of birth and the date tested. If the standard scores and composites are to be computed using grade-based norms, it is also required to specify the client's grade. When the information is correct, select Finished, or select Next to enter raw scores. To discard the changes and revert to the previously entered data, select Cancel.
Edit CMAT Raw Scores. This option activates the CMAT Raw Scores dialog box.
Enter the raw scores for subtests that were administered. Leave blank (do not enter zero) for subtests that were not administered. (Subtests that are not appropriate for students of a particular age or grade are automatically disabled.)
When the information is correct, select Finished, or select Next to enter comparative scores. To discard the changes and revert to the previously entered data, select Cancel.
Edit Comparative Test Scores. This option activates the Comparative Test Scores dialog box.
Comparisons are made based on tests with a mean of 100 and a standard deviation of 15. When working with comparative test scores with a standard devation other than 15 (the Stanford-Binet, for example, has a standard deviation of 16), be certain to specify the standard deviation (SD) for the test score. When you select Finished, the test score and the standard error of measurement (SEM) will be scaled to an equivalent score based on a standard deviation of 15.
When the information is correct, select Finished. To discard the changes and revert to the previously entered data, select Cancel.
If any client data have changed, the Finished button will prompt to save the client data. If you decline to save data, you may do so later by selecting Save Client Data File in the Client menu.
Generate Anaysis. This option activates the CMAT Report Components dialog box. This dialog is described below in the section entitled Generating Standard Scores.
The selections on the File menu are associated with the CMAT Scoring Software and Reporting System report.
Open Report. This selection opens a previously saved report into the CMAT Scoring Software and Reporting System report processor.
Save Report. This selection saves the document currently visible in the CMAT Scoring Software and Reporting System report processor. (To save the raw client data, including Client Info, CMAT Raw Scores, and Comparative Test Scores, select Save Client Data File from the Client menu.)
Printer Setup. This selection activates the Windows Printer Setup dialog box. It allows the selection of any Windows-compatible printer for printing the CMAT Scoring Software and Reporting System report. Printing to both local printers and networked printers is supported in this fashion.
Print Report. This selection prints the current report to the currently selected printer. First, specify the appropriate printer by selecting the Printer Setup menu item.
Exit. This selection quits the CMAT Scoring Software and Reporting System program.
Standard scores are produced for subtests and quotients. The procedures used by the CMAT Scoring Software and Reporting System are as follows.
Subtest Standard Scores. The CMAT Examiner's Manual includes a complete description of the standardization and normative procedures. Standard scores have a mean of 10, a standard deviation of 3, and are assigned performance descriptors based on the criteria specified in the CMAT Examiner's Manual.
Percentiles are generated for the individual subtests and are useful for interpreting test information to lay persons. For example, a person with a subtest standard score of 10 has a corresponding percentile rank of 50, indicating that the individual scored better than or equal to 50% of the standardization population. For interpreting percentiles, refer to the warnings in the CMAT Examiner's Manual.
Composite Scores. Composite scores are generated by adding appropriate raw scores and converting the sums into a quotient having a mean of 100 and a standard deviation of 15. Detailed explanations of the CMAT composite scores are given in the CMAT Examiner's Manual. A performance label, using the criteria specified in the CMAT Examiner's Manual, is generated for all of the CMAT composite scores.
A composite score profile is generated using the CMAT composite scores. The composite scores, along with quotients or composite scores from other measures, are profiled on a 5-point graph (i.e., 95, 100, 105, etc.). The numbers on the graph represent the midpoint of an interval extending ±2.5 points. Thus, the value 105 represents the midpoint of the interval from 102.5 to 107.5. The profiles should not be used as the bases for diagnosis; they are presented to aid in interpretation, not to supplant the analysis of the actual scores.
Composite Score Comparisons. After the CMAT composite scores and additional test scores have been profiled, a comparison of all possible pairs of comparable scores is generated and statistically evaluated to ascertain whether discrepancies between composite quotients are significant. Thus, it is possible to determine if a discrepancy exists between an individual's listening ability and another area of fuctioning. The CMAT Scoring Software and Reporting System results indicate which comparisons are significant at the 0.05 level.
Confidence Intervals. The confidence intervals provided represent the 68%, 95%, and 99% confidence levels. These intervals are based on the standard error of measurement for an individual's subtest, quotient, or composite score and reflect the range within which the "true score" may lie. For a discussion of the usefulness of confidence intervals, refer to the CMAT Examiner's Manual.
Age and Grade Equivalents. Professional associations within the assessment community have identified numerous problems with the use of age and grade equivalent scores. However, the use of these scores is mandated by regulation or custom in many situations. As a result, the CMAT Scoring Software and Reporting System software provides these scores as a selectable option. The subtest age and grade equivalents are based on the tables in the CMAT Examiner's Manual. Because all of these scores are derived from age-based norms, selecting the use of grade-based norms disables the availability of age and grade equivalents for that analysis.
The toolbar is located directly below the menu bar at the top of the program window. (Selections from the toolbar control the report processor's functions.)
Font Selector. Leftmost on the toolbar is the Font Selector. First, select the text you want to change, then select the desired font from the drop-down selector.
Font Size Selector. Immediately to the right of the Font Selector is the Font Size Selector. First, select the text you want to change, then select the desired font size from the drop-down selector.
Character and Paragraph Color. The Character Color selector allows you to specify the color of the text. First, select the text you want to change, then select the desired color from the drop-down selector. The Paragraph Color selector allows you to specify the color of text paragraphs.
Bold, Italic, and Underline. To apply an effect, select the desired text, then click the desired button.
Paragraph Justification. To change the justification of existing text, first select the desired text, then click the button corresponding to the desired justification style (left-justified, centered, full-justified, or right-justified). To specify the justification of new text, select the desired justification button, then type the new text.
Open and Save. These buttons correspond to the Open Report and Save Report selections on the File menu; they have no effect on the Client Info, CMAT Raw Scores, or Comparative Test Scores. To open or save this other information, use the selections from the drop-down selector on the Client menu.
Print and Printer Setup. These buttons correspond to the Print Report and Printer Setup items on the File menu. Select the Print button to print the currently displayed report, and select the Printer Setup button to specify the desired printer.
Cut and Copy. To cut text from the report, select the desired text, then click the Cut button. To copy text, select the desired text then click the Copy button. The selected text is saved to the Windows clipboard.
Paste. To paste text from the Windows clipboard to the CMAT Scoring Software and Reporting System report, place the cursor in the desired location and click the Paste button.
Search. The Search button activates the Search and Replace dialog box.
Swap. The Swap button swaps the contents of the Windows clipboard with the selected text in the CMAT Scoring Software and Reporting System report processor.
PRO-ED, Inc. licenses the use of this program. By your use of the program, you automatically agree to the terms and conditions of the license as described below. You assume responsibility for the selection of the program to achieve your intended results and for the installation, use, and results obtained from the program.
This license allows you to
You may not copy, modify, or transfer the program or any copy, except as expressly provided for in this license. In no case may more than one person or machine use the program at the same time.
The license is effective until terminated. You may terminate it at any time by destroying all copies of the program or transferring the program and license as specified in #4.
The program is provided as is, without warranty of any kind, either expressed or implied, including but not limited to the implied warranties of merchantability and fitness for a particular purpose. The entire risk as to the quality and performance of the program is with you. Should the program prove defective, you assume the entire cost of all necessary servicing, repair, or correction.
The CD-ROM media on which the program is furnished is warranted to be free from defects in materials and workmanship under normal use for a period of 90 days from the date of delivery. No disks will be replaced without a copy of the dated invoice. CD-ROM media will be replaced after the expiration of the warranty for a shipping and handling charge.
The copyright owners and their authorized distributors' entire liability and your exclusive remedy shall be the replacement of any disk proved to be defective.
In no event will any copyright holders or their authorized distributors be liable to you for any damages, incidental or consequential, arising out of the use or inability to use such program, even if the copyright holders or an authorized distributor has been advised of the possibility of such damages, or for any claim by any other party.
This license is governed by the laws of the State of Texas.