Student Item Analysis

On this page:

Use Student Item Analysis to analyze a test by a student at the item level, and compare class performance to school and district performance. Before working with this report, you may want to read over the descriptions of the Summary Charts and Scores Tables to understand the displayed data.

Primary PurposeGuiding Questions
Displays a comprehensive view of a test with an item-by-item, student-by-student breakdown.
  • Which questions or standards did the students do well on?
  • What are the areas of strength for my students? Weakness?
  • Which questions did most students get incorrect?
  • Was there a common incorrect response for troublesome questions?
  • How did my students perform according to the performance bands?
  • What were the overall results of the test?
  • How did my class perform compared to the school? Compared to the district?
  • How can I use data from assessments to develop my SLO/SGO goals?
Primary UsersPrimary Uses
  • Teachers
  • School Administrators
  • Record test scores in a grade book
  • Determine how students did on each question
  • Review the correct and incorrect answers with students
  • Identify areas of weakness and remediation needs

Access Student Item Analysis

  1. From the main navigation menu, choose Reports, then Student Item Analysis.
  2. Choose a Test Title.

    Note:

    Results only display for students to whom you have access and any tests in the menu that meet the following criteria:

    • Honor any filters set for the school, teacher, course, or class
    • Have been released
    • Have generated and loaded student data

Filter Options

Click Additional Filters, then choose from the following options:

  • Add Student Filter - Choose from the Student Filters to limit the student population. Setting filters for school, teacher, course, or class limits the test selection choices.
  • Active Filters - Indicates the filters that are currently applied. 
  • Test Window - This filter is only available if the test had more than one test window. You can choose multiple test windows; however, if you choose only one, then the displayed results are from the most recent test window.

Correct a Response or Score

You can update student responses to correct scoring discrepancies. This is especially useful for interaction types like text entry, which may not have enough correct answer variations to capture all responses the teacher wants to count as correct.

Note:

To correct responses or scores, student response editing must be enabled for the test. 

You must have Update permissions to the test to change this setting. This option is enabled by default for teachers who build a private test.

  1. In the Item Scores or Interaction Scores table, click the cell containing the score that needs to be updated. 
  2. Click Edit Response.
  3. Update the student response. If appropriate, this also updates the student's score.

    Note: Only machine-scored interaction types can be updated using this process. While responses to rubric-scored items may be editable, the score is not updated. Updates to rubric scores should be done using the scoring assignment for the test.

  4. Click Save

    Caution: You must refresh your browser to review an updated score in the scores table.

Create a New Shared Report

  1. Click Save to create the shared report.
  2. Enter the Description
  3. Click Save.
  4. If the information is correct, click Permissions.
  5. Click Add user or group.
  6. Add the individual users by name or add users by role. Click and hold the Control key on a PC, or the Command key on a Mac, to add multiple users or groups at once.
  7. Click OK.
  8. Select permissions for each displayed group.

    Tip: Assign Read access to the district to share this report with the entire district.

  9. Click Save.
  10. Click OK.

Export Results to Your Gradebook

You can export assessment results to your Gradebook account. 

Note:

Before exporting assessment results, you must filter to a single class. You can only submit student scores for one class section at a time.

Gradebook is only available for teachers with access to PowerTeacher Pro or eSchoolPlus.

  1. Click Gradebook.

  2. Enter the required information.

    Note:

    If the test has previously been sent to Gradebook, then all required attributes are auto-filled and disabled.

  3. Click Submit.

Summary Charts and Scores Tables

Reports include two primary sections: Summary Charts and Scores Tables.
charts and scores table image

You can choose from the following actions when reviewing Summary Charts and Scores Tables:

  • Sorting - Click on a column header that includes a double-arrow to sort by that column. 
  • Export - Export the current display of the tables, honoring any filters selected.
    • Click Excel to export a Microsoft Excel file with tabs for Item Scores and Interaction Scores, including full tables and color-coding.
    • Click CSV to export a basic Interactions Scores table.

Note: Opening the CSV file with Excel or another spreadsheet application may result in improper formatting of cell data. Format the cells as text for a proper view of the data.

  • Click Share to create a custom link that can be copied and shared with other users. The link includes any selected student filters.

Note:

Viewing the content of a high-stakes test or any of its items requires a user to have high-stakes administrator permission. Only an administrator can assign high-stakes administrator permission to a user or group.

Hover over an item to review its statistics.

Summary Charts

Summary Charts are organized into three tabs: Item Attributes, Performance Bands, and Item Detail.

 Item Attributes

The Item Attributes tab includes the standards assessed on the test and the percentage of students in each performance band assigned to that assessment.

Choose an attribute type to display a breakdown of the student percentage:

  • Hover over a standard to view the full standard description.
  • Click on a count to filter the results in the score table to only items with that attribute. Click again to clear the filter.
  • The bars for % of Students are color-coded to match the test's performance bands. Hover over a section of the bar to see the count and percent details. Click on a section of the bar to filter the report by the students represented by that count for that attribute. Click again to remove the filter.
  • Click a swatching box to include or exclude that performance band in the percentage value displayed in the column.
    • A solid-filled box means the data for that color band is included. A partially filled box indicates data for that color band is excluded.
    • The value is the student percentage for all selected performance bands for each attribute.

  • Hover over an average to display the PE/PP (points earned / points possible).

item attributes tab image

Note:

Some districts may have Professional Development Platforms enabled.

Tests that use standards that are aligned to content from the platform have an icon next to the standard. 

standards-aligned image

Click the icon to view the available Khan Academy content associated with the specific standard. The window can show up to three Khan Academy videos per page.

The stacked bar graph displays the overall performance band percentages using the test's performance band colors. Hover over a section to see details.

For teachers, this graph includes comparisons across student, school, and district performance. School and district-level users can see these comparisons by setting the school of enrollment and teacher filters.

Note: If you use the school of instruction filter, you will not see all three bar graphs for comparison. You must use the school of enrollment filter.


Performance Bands

  1. Select the Performance Bands tab to view the student population percentage for each achievement level. 
  2. The stacked bar graph displays the overall performance band percentages using the test's performance band colors. Hover over a section to see details.
  3. Select a section of the graph to filter the report by students in that performance band. Click the row again to clear the filter.

Item Detail

  1. Select the Item Detail tab to view score or response distributions for individual test items, interactions, and rubrics.

  2. Click the item number in the header. 
  3. To view interaction choices distributions, click the bar chart icon.

    Note: The icon is only available for multiple-choice interactions

a screenshot of a portion of the item detail emphasizes the number headings and the bar chart icon

The bar chart provides an overview of all possible response scores for the selected item, interaction, or rubric. The graph also provides comparisons across student, school, and district performance. For multiple-choice interactions, the interaction choice displays the answer choice distribution).

  • Hover over a bar to see the count and percentage details.
  • Click on a bar to filter the report by students represented by that score.
  • Choose from the view selector to switch between item-level, interaction-level, or the rubric-level view.

Another chart displays the overall percentage of points earned over points possible for the selected item.

  • Hover over the sections of the outer ring to view the total number of students who answered correctly or incorrectly. 
  • Hover over the inner ring to view item details.

Data PointDescription
StudentsTotal number of students scored for this item in the currently-selected population (based on any filters applied)
P-ValueValue of 0 to 1; indicates the degree of challenge for items based on the percentage of students who chose the correct answer
Item DiscriminationValue of -1 to 1; indicates the effectiveness of distractors and pinpoints possible misfits
Point BiserialValue of -1 to 1; indicates how well the question tells the difference between high and low performers
PopulationTotal number of students scored for this item
PETotal points earned for this item by the students in the currently-selected population (color-coded based on the test's performance band)
PPTotal points possible for this item by the students in the currently-selected population

Note: This report includes several item statistics.

Score Tables

The Score Table includes up to three tabs: Interaction Scores, Item Scores, and Rubric Scores.

Note: Rubric Scores only appear if the test includes items that require manual scoring using a rubric.

Select the Interaction Scores, Item Scores, or Rubric Scores tab. If the test contains human-scored interactions, select the Rubric Scores tab to see the breakdown of scores by rubric or scorer for the currently selected student population.

ColumnDetails
Student Name
  • Click a student name to navigate to the Student Detail Report.
  • If the student took the test using a scan sheet, click the icon that appears after the student's name to view a copy of the scan sheet.
Test Score %

The header displays the overall test score for the student population.

  • Hover over the header score to see student population count, overall points earned, overall points possible, and Cronbach's alpha score.
  • Click the play icon next to a student's score to view the student's test and responses. Click Download in the preview to download a copy.
PE/PP

Test points earned over the number of points available.

  • Cells are color-coded based on the test's performance band.
  • PP is calculated by adding all Points Possible of all scored items. Rubric scored items must be human-scored before they are included in the score.
  • Colors are applied to the PE/PP column according to the sections completed and scored. For an online assessment, the column remains blank if any extended text, draw, or upload items are not yet scored.

    Note: Colors are applied for Answer Key Only tests whether or not rubric scored items have been scored. Once a rubric scored items are scored, the color changes.

Section %

If a test contains sections, each section has a column.

  • Hover over any student score to see their points earned / points possible.
  • Cells are color-coded based on the test's performance band.
Interaction Number Columns
  • Hover over an item number to view additional details.
  • Click on the play icon in the header to preview the item.
  • To view item score distributions, click the item number in the interaction's header.
  • To view interaction choices distributions for multiple-choice interactions, click the bar chart icon  in the header.
  • Click the plot graph icon next to an overall item score to access its Test Statistics report.
  • Student responses to choice interactions appear in circles. Scores for text response appear in squares. All other interactions only display the score.
  • Hover over any score within a square to see the student response.
  • Click on an interaction response or score to view the item and response for that student.
Item Number Columns
  • Hover over an item number to view additional details.
  • To view the Item Details, click the bar chart icon image.
  • Click the play icon next to an item number to preview the item.
  • Click the plot graph icon image next to an overall item score to access its Test Statistics report.
  • Click on an interaction score to view the item and response for that student.
Rubric Columns
  • Hover over an item number to view additional details.
  • Click on the play icon in the header to preview the item.
  • To view item score distributions, click the item number in the interaction's header.
  • To view rubric scores distributions, click the bar chart icon  in the header.
  • Click on the plot graph icon next to an overall item score to access its Test Statistics report.
  • The cells display the rubrics associated with each item, denoted by a "g" for the group number and an "r" for the rubric number.
  • Multiple columns for an item indicate the item is associated with multiple rubrics.
  • Multiple scores within a column indicate that more than one person scored the rubric.
    • Hover over a rubric number to see the rubric name and description.
    • Hover over a rubric score to see the score description.
    • Click on a rubric score to view the item, full rubric, and response for that student.

Understand the Scores

Interaction Scores Items ScoresRubric Scores

interaction scores image

KeyInteraction TypeResponse/ Score
AMultiple ChoiceIncorrect response- no credit
BMultiple ChoiceCorrect response- full credit
CMultiple ChoiceNo response- no credit
DRubric Scored ItemNot scored- not factored into the score
ERubric Scored ItemScored- partial credit
FRubric Scored ItemScored- no credit
GRubric Scored ItemScored- full credit
HInteraction other than Multiple ChoiceIncorrect response- no credit
IInteraction other than Multiple ChoiceCorrect response- full credit

a screenshot of an item score

KeyResponseScore
ACorrectFull Credit
BIncorrectNo Credit
CNot ScoredNot factored into the score
DPartially CorrectPartial Credit

rubric scores image

KeyResponseScore
ACorrectFull points awarded
BPartially CorrectPartial points awarded
CIncorrectNo points awarded


Note: If a column is blank and has the label n/a%, this is an item that has no student response because a teacher has not yet released this test section to the student, or the student has not completed the assessment, and the teacher has opened the test for online scoring.

Multi-Part Items

Some items may have more than one interaction. The Student Item Analysis report allows you to view the overall score as well as the score per interaction.

Items ScoresInteraction Scores
Click the Item Scores tab to view the overall score for items. This is the total points earned for all interactions in the item. Click the cell to view all interactions and the student's responses.Click the Interaction Scores tab to view the score associated with each interaction. Click on any of the points earned cells to view all the interactions and the student's responses.

KeyResponseScore
AIncorrectNo Credit
BPartially CorrectPartial Credit
CCorrectFull Credit
Interaction Scores image
KeyResponseScore
AIncorrectNo credit for either part
BPartially CorrectCredit for the correct part
CCorrectCredit for both parts


Copyright © 2021 PowerSchool Group LLC