In an ordering task, the task creator inputs the options, and the solver must arrange them in the correct order. Each option has an ID and a name. Entering options works similarly to the multiple-choice question type. It is also possible to use rich text and add images as options.
The task creator selects, using a radio button, whether the options are displayed side by side or one below the other. The solver can arrange the options by dragging them with the mouse.
By default, the options appear in the order they were entered. If the "Shuffle choices" checkbox is selected, the options are randomized each time the task is displayed.
When creating a task, the basic fields required for task entry are displayed by default. Additional options appear when clicking the 'More data' link. The additional options selected by the task creator will remain visible in the task entry view after saving.
Example: https://www.examodo.com/publicitems/63
Common data for content blocks
Field / Button | Explanations | Conditions |
Example | When marking, an example is displayed to the task solver: a content block with the answer is shown, the answer cannot be modified, and no points are awarded for this answer. | Checkbox. By default, it is hidden and will appear when clicking the 'More data' link. |
Initially invisible | When enabled, it allows the content block to be hidden when opening the task and revealed based on the user's next action. | Checkbox. By default, it is hidden and will appear when clicking the 'More data' link. |
Points shall be rounded within the block | When marking, the points awarded to the solver are rounded to the nearest whole number. | Checkbox. By default, it is hidden and will appear when clicking the 'More data' link. |
Do not color incorrect/correct responses | By default, in solved and graded tasks, answers that received the maximum points are displayed with a green border, while other answers are displayed with a red border. If this checkbox is selected, no colored border is displayed around the answers. This is used for questions where determining the correctness of an answer's color is too complex. | Checkbox. By default, it is hidden and will appear when clicking the 'More data' link. |
Display options |
|
Radiobutton |
Options | A block for entering choices. | |
Shuffle choices | If marked, then choices will be displayed in a different order each time the solver opens the task. | Checkbox. |
Generate explanations | When pressed, the text entered as an explanation for the answer or selection will be copied into the explanation column of the answers or options input table. If an explanation was previously entered, it will be overwritten. | Button |
Answer Evaluation and Assessment Matrix (Some options are hidden under the arrow icon “Show More”).
When creating the grading matrix for an ordering task, the order of answers in the matrix is crucial, and the number of dots shown next to the matrix rows has a different meaning than usual. The answers must be placed in the grading matrix in the exact order they should appear in the correct solution.
Field / Button | Explanations | Conditions |
Item ID | The question ID must be unique within the task. When creating a new question, the system automatically suggests a default ID value, but the task creator can change it. If there are many questions in the task, it is recommended to rename the question IDs in a way that reflects the content or location of the question in the task. This reduces the risk of confusion between questions and their assessment matrices for the creator. | Text field. Mandatory. |
Explanation | The task creator can add an explanation for the question. | Text field |
Algorithm |
To calculate the score, there are four different algorithms, from which the task creator must select the appropriate one. Options:
|
Drop-down menu. |
Minimum points of item | The minimum points value indicates the lowest possible number of points that can be awarded for a given question. In some cases, a question may have multiple answers. First, the corresponding number of points is determined for each answer, then the points are summed. If the total points are less than the minimum points value, the solver is awarded the minimum points. | Numeric field. |
Maximum points of item | The number indicates the maximum possible points that can be awarded for a given question. If the assessment matrix has already been saved, the calculated maximum points value, based on the system's calculations, will be shown in parentheses after the maximum points input field. The system calculates the maximum points based on the answers and their respective points in the assessment matrix. The calculated maximum points may be greater than or equal to the maximum points set for the question. | Numeric field. |
Default points given for response, which does not match matrix | The default points value is the number of points awarded to all answers that do not have a row in the assessment matrix. For example, if all correct answers are included in the assessment matrix, default points are given to incorrect answers. By default, the default points are 0. | Numeric field. |
A question used to determine the correctness of an answer | From the list, you can select the question ID with which the response to this content block's specific question will be evaluated. When making a selection, it is important to consider that this question must be computer-evaluable (it can receive 0 points), and points for this response will be assigned based on the evaluation of another question's response within the same task content block (either by the computer or a human). | Drop-down menu. |
Number of evaluation matrixes |
Multiple evaluation matrices can also be selected for scoring. The task creator specifies the number of evaluation matrices and saves it. After saving, the interface allows the creator to input the desired number of matrices. The solver’s response is compared against all the matrices, and the score is determined based on the matrix that yields the highest number of points. |
Numeric field. |
Do not count response for results | When selected, the points awarded for this question are not included in the solver's total test score. This is used, for example, when the task points are determined by a calculated value in the content block. In tests where the total points are not counted and instead the result is displayed by individual indicators, the question will not be shown in the result view. | Checkbox. |
Computer-markable | Indicates whether the question is computer-assessable or not. When creating a new question, it is by default set as computer-assessable unless it is an open text input content block. | This content block is only computer-assessable. |
Add |
Adds a row to the grading matrix. The grading matrix is a table where each row corresponds to a possible answer and indicates how many points are awarded for that answer. Each draggable text has its own grading matrix. The answers must be placed in the grading matrix in the exact order they should appear in the correct solution. A row in the grading matrix consists of the answer and its evaluation, which includes the following fields: |
Button |
Order | Serial number, automatically filled by Examodo. | |
Response | In the dropdown menu, all entered options are displayed, and the appropriate one must be selected. | Drop-down menu. Mandatory. |
Condition | If a condition is described, the score for the answer listed in the assessment matrix will only be counted if the condition is met, i.e., the condition's truth value is true. The condition is described as a Python formula, which may depend on the answers to other questions. | Text field. |
Points | The assessment points awarded for a given answer. Points are given as real numbers, can include decimal places, and can be positive, negative, or zero. A row with 0 points in the assessment matrix may be necessary if a hit counter is used and you want the answer to be recorded in the counter. Negative points can be given for incorrect answers. For rows marked as "Correct," the points field may be left blank (in which case 1 point is counted). | Numeric field. Mandatory. |
Correct | A checkbox. Checking this box means that if no value is entered in the points field, the solver will receive 1 point for the given answer. If the solver is allowed to view the correct answer, marking this checkbox indicates that the row is the correct answer. | Checkbox. |
Match counter | The hit counter field where the counter name can be entered (the name can include letters, numbers, and underscores, and the first symbol cannot be a number). The counter allows grouping of answers, even across different content blocks (the counter applies within the task). If a counter name is entered, the system will count all answers that match the specific row and can be used in the formula of a calculated value content block. | Text field. |