In the case of an open response question, it is possible to ask the solver for a free-form response of any length. The solver will be presented with a multi-line text input field or multiple fields.
The task creator can specify whether the solver can use rich text options and whether the solver can see the number of words entered in the response. The content block is human-rated, but the task creator can set a minimum word count requirement; if this requirement is not met, the content block will not be sent for human evaluation and will receive a score of 0 from the system. The task creator can also impose a character limit on the entered text, beyond which the solver cannot input characters. Additionally, the task creator can disable copying and pasting of the response in the answer field.
When creating a task, the basic fields required for task entry are displayed by default. Additional options appear when clicking the 'More data' link. The additional options selected by the task creator will remain visible in the task entry view after saving.
Example: https://www.examodo.com/publicitems/28
Common data for content blocks
Field / Button | Explanations | Conditions |
Display the number of words in a response |
When marked, the number of words entered in the gap is displayed next to the gap for the solver. This is not suitable for use when gaps are displayed within the text. |
Checkbox. Chosen by default. |
Rich text | If marked the rich text toolbar is shown for the solver. | Checkbox |
More data | Hidden by default. | |
Example | When marking, an example is displayed to the task solver: a content block with the answer is shown, the answer cannot be modified, and no points are awarded for this answer. | Checkbox. |
Initially invisible | When enabled, it allows the content block to be hidden when opening the task and revealed based on the user's next action. | Checkbox. |
Points shall be rounded within the block | When marking, the points awarded to the solver are rounded to the nearest whole number. | Checkbox. |
Do not color incorrect/correct responses | By default, in solved and graded tasks, answers that received the maximum points are displayed with a green border, while other answers are displayed with a red border. If this checkbox is selected, no colored border is displayed around the answers. This is used for questions where determining the correctness of an answer's color is too complex. | Checkbox. |
Prevent pasting of copied text into a field | When filling in the gap, the solver cannot paste text copied from elsewhere; they must enter the answer using the keyboard. | Checkbox. |
Content block minimum points | If the total score of the questions is less than the number entered in this field, the total score for the task will take into account the number entered in the minimum points field for the content block. | Numeric field. |
Content block maximum points | If the total score of the questions exceeds the number entered in this field, the total score for the task will take into account the number entered in the maximum points field for the content block. | Numeric field. |
Max lenght of answer | The number entered in the field determines the maximum number of characters the solver can enter as the answer in the blank. | Numeric field. |
Row width | Defines the width of the answer box. | Numeric field. |
Number of rows | Defines the number of rows in the answer box (i.e., also the height of the answer box). | Numeric field. |
Line height | The height of text lines inside the box. | Numeric field. |
Mask | In this field, you can use regular expressions to define the expected answer pattern. If the answer provided by the solver does not match this pattern, a message saying "Invalid value" will be displayed in red next to the input field. For example, if you want the solver's answer to contain the @ symbol somewhere, you can write the pattern: ".@." (you must enter the code within the quotation marks). For instance, if you want the answer to start with a number, use: "\d.", if the answer should end with a number, use: ".\d", or if the answer should start with a capital C, use: "C.*", and so on. | Text field. |
Hint | The text written in this field is displayed to the solver inside the same field before they click on it and begin typing their answer. This can serve as a hint or instruction (e.g., "write a numerical answer"). | Text field. |
Number of responses | Defines how many answer boxes are displayed to the solver. For example, if two answers are required, entering 2 here will display two answer boxes for input. | Numeric field |
Minimum number of responses | If it is set that the solver must answer at least a mandatory number of questions, this field determines how many questions must be answered (the button to move to the next task will not appear until this number is reached). This functionality is typically applied in tests, so in most cases, this field does not need to be filled. If the task specifies "Partial answers are not allowed to be confirmed (solving without a test)," this field will also apply in the case of a single task. | Numeric field |
Evaluator can mark errors in the text | When marking, the evaluator of a human-evaluated task can indicate errors within the text. | Checkbox |
Full-screen view of response |
When marked, an icon is displayed for the answer assessment and viewing, allowing the answer box to be displayed in full-screen mode. This is not suitable for use when gaps are displayed within the text or when only one word must be entered in the gap. |
Checkbox |
Use hint as initial response | When marked, the solver can use and modify the word entered in the Hint field within the gap, if necessary. For example, they can add the correct word endings. | Checkbox |
Icons for setting the alignment of the answer in the gap | If necessary, it is possible to specify how the solver's entered answer is aligned within the gap. | Icons |
Evaluation of the response and assessment matrix
Field / Button | Explanations | Conditions |
Response marking | ||
Item ID | Question ID must be unique within the task. When creating a new question, the system automatically suggests a default ID value, but the task creator can modify it. If the task contains many questions, it is advisable to rename the Item IDs in a way that reflects the content or location of the question within the task. This reduces the risk of confusion between questions and their assessment matrices for the task creator. | Text field. Mandatory. |
Explanation | A field to provide additional details about the Item ID. | Text field. |
Value type
|
Options: Text, Integer, Real number Here, you need to specify the expected response type—whether it should be textual (text + numbers) or purely numerical (integer or real number).
|
Dropdown menu. |
Minimum points of item | The minimum number of points indicates the lowest possible score that can be awarded for a given question. In some cases, a question may have multiple answers. First, the score for each answer is determined, then the points are summed. If the total score is lower than the minimum points set, the solver is awarded the minimum points. | Numeric field. |
Maximum points of item | The number indicates the maximum possible points that can be awarded for a given question. If the assessment matrix has already been saved, the calculated maximum points value, based on the system's calculations, will be shown in parentheses after the maximum points input field. The system calculates the maximum points based on the answers and their respective points in the assessment matrix. The calculated maximum points may be greater than or equal to the maximum points set for the question. | Numeric field. |
Min word count | Here you can set the minimum number of words that the solver must enter in the gap for their answer to be submitted for evaluation. If the number of words is less than this value, Examodo will automatically score the answer 0 points. | Numeric field. |
Interval of points | The task creator can define the step size for scoring in manually graded tasks, allowing the evaluator to assign points to the solver's response accordingly. | Numeric field. |
Default points given for response, which does not match matrix | The default points value is the number of points awarded to all answers that do not have a row in the assessment matrix. For example, if all correct answers are included in the assessment matrix, default points are given to incorrect answers. By default, the default points are 0. | Numeric field. |
Case sensitive | When marking, the evaluation considers case sensitivity, comparing the entered response with the answer in the assessment matrix. | Checkbox. Appears when the Value Type = Text. |
Spaces are taken into account | When marking, spaces are also considered when comparing the entered response with the answer in the assessment matrix. | Checkbox. Appears when the Value Type = Text. |
Latin and Russian letters of the same appearance are equal | Marked by default. If the user enters letters from a different keyboard language, visually identical letters are considered the same. | Checkbox. Appears when the Value Type = Text. |
Blank response allowed | If marked, it is possible to add a row with an empty response in the assessment matrix and award points for not entering an answer. | Checkbox. |
Regular expression on entire text | In the case of a textual response, it is possible to use regular expressions, which allows the solver's given answer to be compared with a specific pattern, providing more flexibility in answer verification. If this option is checked, the entire response provided by the solver is compared one-to-one with the answer in the assessment matrix. | Checkbox. Appears when the Value Type = Text. |
Regular expression on substring | If this option is checked, it will be verified whether any part of the solver's given answer matches the answer specified in the assessment matrix. In other words, the solver's response may be a longer text, but if it contains a specific portion that matches the answer in the assessment matrix, the answer will be considered correct, and points will be awarded. | Checkbox. Appears when the Value Type = Text. |
Formula | If checked, a formula is entered in the row of the assessment matrix, and its value is calculated during the evaluation. If not checked, the final answer itself is specified in the assessment matrix. | Checkbox. |
To how many decimal points value may be rounded | Using this field, shorter, rounded answers can also be considered correct. For example, if the correct answer is 5.7848 and rounding to one decimal place is allowed, then both the exact answer (5.7848) and the rounded answers (5.785, 5.78, and 5.8) will be considered correct. In the case of a range, a rounded range is also acceptable. For instance, if the range starts at 6.23 and rounding to one decimal place is allowed, the correct answer can also be 6.2, and so on. | Numeric field. Appears when the Value Type = Real number. |
The matrix contains rounded numbers | If this is checked, all answers provided by the solver that, when rounded, result in the value entered in the assessment matrix will be considered correct. | Checkbox. Appears when the Value Type = Real number. |
Allowable difference in percentage | The percentage by which the given answer can differ from the value in the assessment matrix. | Numeric field. Appears when the Value Type = Integer, Real number. |
A question used to determine the correctness of an answer | From the list, you can select the question ID with which the response to this content block's specific question will be evaluated. When making a selection, it is important to consider that this question must be computer-evaluable (it can receive 0 points), and points for this response will be assigned based on the evaluation of another question's response within the same task content block (either by the computer or a human). | Drop-down menu. |
Do not count response for results | When selected, the points awarded for this question are not included in the solver's total test score. This is used, for example, when the task points are determined by a calculated value in the content block. In tests where the total points are not counted and instead the result is displayed by individual indicators, the question will not be shown in the result view. | Checkbox. |
Computer-markable | Whether the question is automatically graded or not. When creating a new question, it is by default set to be automatically graded unless it is a content block for open text entry. If the task is to be manually graded, this checkbox should be unchecked. | Checkbox. |
Hybrid-markable | When marked, the solver's response is first compared with the answer in the assessment matrix. If they differ, the task is then directed to the evaluator for manual grading. | Checkbox. |
Evaluation matrix. Add | Adds a row to the assessment matrix. | Button. |
Order | Serial number, automatically filled by Examodo. | |
Response |
A text field for entering the answer. In the case of a textual type, the exact text response must be entered; for numeric responses, either the exact number or the starting point of the range should be provided. If multiple different answers are to be considered correct, each correct answer should be entered on a separate row, and the "Correct" box for that row should be checked, which will later be shown as the correct answer to the solver. |
Text field. |
End of range | Kui Vastus väljale on sisestatud vahemiku algväärtus, siis saab siia sisestada vahemiku ülemise piiri. | Numeric field. Appears when the Value Type = Integer, Real number. |
Condition | If a condition is described, the score for the answer listed in the assessment matrix will only be counted if the condition is met, i.e., the condition's truth value is true. The condition is described as a Python formula, which may depend on the answers to other questions. | Text field. |
Points | The assessment points awarded for a given answer. Points are given as real numbers, can include decimal places, and can be positive, negative, or zero. A row with 0 points in the assessment matrix may be necessary if a hit counter is used and you want the answer to be recorded in the counter. Negative points can be given for incorrect answers. For rows marked as "Correct," the points field may be left blank (in which case 1 point is counted). | Numeric field. |
Correct | A checkbox. Checking this box means that if no value is entered in the points field, the solver will receive 1 point for the given answer. If the solver is allowed to view the correct answer, marking this checkbox indicates that the row is the correct answer. | Checkbox. |
Match counter | The hit counter field where the counter name can be entered (the name can include letters, numbers, and underscores, and the first symbol cannot be a number). The counter allows grouping of answers, even across different content blocks (the counter applies within the task). If a counter name is entered, the system will count all answers that match the specific row and can be used in the formula of a calculated value content block. | Text field. |
An example response or marking guide | Here, the task creator can input a visible explanation or instructions for the evaluator regarding how to grade the task. The option to use rich text formatting is available. If an image of the expected result needs to be added, it can be inserted using the image upload button. | Rich text area. |
Show as correct response | if checked, the sample answer will be displayed to the solver as the correct answer | Checkbox. |