Assessment administrator tasks
Before you create assessments, assign the assessment_admin role to the appropriate users in your organization and determine your objectives for the assessment.
Decide which sets of records in the system to assess, which themes you are interested in, and which traits to measure. Consider your organization's options for obtaining the data to compare. If you intend to use assessment questionnaires, consider which people can answer the questions.
Assessment terminology
Assessment admins use several terms when working with assessments.
| Term | Description |
|---|---|
| Metric type | A metric type defines a set of records to evaluate, such as vendors, projects, or employees. |
| Assessable record | An assessable record links a record to evaluate, such as the company record for Amazon or the user record for a sales representative, to a metric type, such as vendors or employees. You define sets of assessable records when you create metric types. |
| Metric category | A metric category represents a theme for evaluating assessable records. Categories contain one or more individual metrics, which define specific traits or values that comprise the theme. Examples of categories include overall vendor performance or quality of delivery services. You can also set filter conditions that control which assessable records to evaluate for the metrics in a category. |
| Metric | A metric is a trait or value used to evaluate assessable records. A metric can measure subjective values in an assessment questionnaire, or gather objective values in a database query run by a script. Examples of metrics include perceived courtesy of sales representatives or number of incidents per vendor. |
| Category user | A category user is a person who knows about a specific category. One person can be a category user for multiple categories. Examples of category users include a vendor manager who oversees all purchasing operations or a supervisor of a sales team. |
| Stakeholder | A stakeholder is a category user who knows about a specific assessable record. Examples of stakeholders include a vendor manager who coordinates purchases from Amazon or a supervisor of a sales team who manages a specific employee. |
| Assessment instance | An assessment instance represents one assessment questionnaire assigned to one user. The system generates a new assessment instance for each assigned user when:- The assessment generation scheduled job runs. - An assessment administrator creates an on-demand assessment. |
| Scorecard | A scorecard provides a visual illustration of an assessable record's performance, based on assessment results. Use scorecards to view a variety of data summaries for one assessable record and to compare the ratings with other assessable records. |
| Decision matrix | A decision matrix is a graph with two axes that plots the assessment results for multiple assessable records. Use decision matrixes to determine the relative standing of assessable records in selected categories. |
| Bubble chart | A bubble chart is a graph with three axes that plots the assessment results for multiple assessable records. Use bubble charts to determine the relative standing of assessable records in selected categories, with an emphasis on one category. |
Assessment roles
The Assessments application requires certain roles to perform assessment tasks. No role is required to take assessment questionnaires that are assigned to you.
| Role Title | Role Name | Description |
|---|---|---|
| Assessment administrator | assessment\_admin | Assessment administrators set up assessments. They know which records to evaluate, the criteria on which to evaluate the records, and who to assign assessments to.Note: By default, users with the assessment_admin role have limited system rights and might not have access to all source records to assess. When planning assessments, grant additional roles to assessment administrators as needed. For example, to create and manage vendor assessments, the assessment administrator must also have the vendor_manager role, which grants access to the Company table and other relevant tables. |
| ITIL user | Base system roles | ITIL users perform basic technician operations in the system. In the Assessments application, they have read access to the Assessable Record table. |
| Administrator | Base system roles | Administrators have access to all aspects of the assessment process. Only administrators can set up assessment schedules. |
Assessment methods
The available methods are Assessment, for non-scripted metrics, and Script, for scripted metrics. Each method serves a different function and can be used with certain data types.
Use the Method field to specify how to use the metric.
Assessment method
Metrics with the Method set to Assessment are called non-scripted metrics. Use each non-scripted metric to define a question for assessment questionnaires. Non-scripted metrics are useful if you want to obtain subjective data like personal opinions.
You can use the Assessment method with these Data type values:
- Attachment
- Checkbox
- Choice
- Date
- Date/Time
- Likert Scale
- Number
- Percentage
- String
- Template
- Yes/No
Script method
Metrics with the Method set to Script are called scripted metrics. Use each scripted metric to define a custom script for database queries. Scripted metrics are useful if your system contains reliable data for the traits you want to evaluate.
You can use the Script method with these Data type values:
- Duration
- Number
- Percentage
Use the Script field to write JavaScript code. By default, the field contains information about available variables and an example, which you can use as the basis of your script or replace entirely:
metric form script field
You must use the following variables in your script:
- primary: Input variable used to access the sys_id of the record being assessed.
- string_result: Output variable that contains the display string value for this metric
- actual_result: Output variable that contains the actual value for this metric. The system uses this variable to populate the Actual value field on the Metric Result form. For each actual_result, you must specify a corresponding scaled_result value.
- scaled_result: Output variable that contains a numerical scaled value to represent an actual value. The system uses this variable to populate the Scaled value field on the Metric Result form. Ensure the scaled values you specify are between or equal to the Min and Max values for the metric. The Scale definition field determines how the system uses the scaled value. A scale definition of Low means smaller numbers are better, such as for a metric that measures the number of incidents for a vendor. High means larger numbers are better, such as for a metric that measures user satisfaction on a scale of one to five.
Script example
The metric Number of active devices uses the script pictured below. The primary variable is used to find CIs that are associated to the vendor record being assessed. The script retrieves the actual_result, the number of CIs associated to the vendor, then calculates the correct scaled_result. The script uses a series of scaled values, from the Min to the Max value, to represent actual values. Because the Scale definition is set to High, the greatest scaled values are best, meaning a vendor associated to the most CIs scores highest. The system stores the actual and scaled values in a metric result record for the vendor.
Scripted metric example
- Configure an assessment
You can create a new assessment on a selected assessable records to evaluate, score, and rank records from any table in the system. Then create a metric category and assessment metrics for the assessment, publish the assessment, and assign it to the selected users. - Assessment generation
In the Assessments application, administrators or assessment administrators can trigger the system to generate scheduled assessments or on-demand assessments when all the prerequisite steps are completed. - Assessment groups
An assessment group is a container for assessment instances and assessment results generated in a single occurrence. - View an assessment metric category
View assessment metric categories that are used with assessment metric types and assessment metrics in generating the bubble charts on the Demand Workbench. The bubble charts help the demand managers to assess the demands visually. - Assessment metrics
In the Assessments application, a metric is a trait or value used to evaluate assessable records. - Add a metric category and metric in the question bank for assessments
Reuse the question categories (metric categories) and questions (metrics) added in the question bank for assessments. You can add metric categories or metrics from the question bank to an assessment, or from the assessment to a question bank. - Copy an assessment
Create a copy of an assessment with at least one category to reduce the effort of creating another assessment with similar data. - Create a metric template
Create a metric template to define reusable rating scales for evaluating non-scripted metrics. - Category users and stakeholders
Users who take assessments are individuals in your organization who have specific knowledge of the assessment categories and the records being assessed. - On-demand assessments
On-demand assessments can be generated for metric types with the Schedule type field set to On demand. - Scheduled assessments
The system generates a unique scheduled job for each metric type with the Schedule type field set to Scheduled. - Configure trigger conditions for an assessment
Trigger conditions specify when to send a particular assessment and who to send the assessment to. - Enable manager notifications
Users with the assessment_admin role can enable the Notify manager assessment is overdue email notification. - View a metric result
Metric results contain values that represent an evaluated record's performance for a specific metric, based on a single evaluation from one user or from the execution of a script. Metric results contain actual values as well as calculated values. The system uses values from metric results to calculate category results. - View an assessment scorecard
The Assessments application prepares printable scorecards. A scorecard displays easy-to-interpret assessment results, in which the current calculated ratings for an assessable record are compared to previous ratings or to the ratings of other records. - Create a decision matrix
The name and labels on a decision matrix are closely linked to the categories you choose for the axes. For that reason, first select the metric type and define the X and Y axes before you fill in other fields on the Decision Matrix form.
Parent Topic:Using assessments
Related topics
Create an assessment metric for a category
Create an assessment metric definition
Update a metric minimum and maximum value to match a template