Frequently asked questions about Web Assessment
Questions and answers about Web Assessment to help you with both preparation and implementation
Overview
Before the assessment
-
Can I start using the Web assessment at any time? Is everything connected within the same system?
- How do I know if my computer meets the technical requirements?
- Some settings do not work on my computer – how can I quickly find a solution?
- Are the texts the same as before?
During the assessment
-
What does “Other answer” mean in the reading comprehension questions?
- What happens if the student moves? Will there still be a result?
After the assessment
-
What happens to the results? / Where are the results stored?
- Why do I only see one eye when I look at the student’s eye movements?
Other questions
- Is the Web assessment as reliable as assessment with an eye tracker?
-
Can I assess students if I have the role of Teacher in Lexplore?
Can’t find the answer to your question? Read the guide to assessment, which contains consolidated information before, during, and after an assessment. You are also welcome to contact us.
Before the assessment
Can I start using the Web assessment at any time? Is everything connected within the same system?
The two systems – assessment with an eye tracker and Web assessment – are connected. It is the same type of assessment, but conducted in different ways.
Before you start using the Web assessment, you must clarify this with your project manager or ambassador. You must also complete the training before you can start using the tool.
How do I know if my computer meets the technical requirements?
Some settings do not work on my computer – how can I quickly find a solution?
Are the texts the same as before?
During the assessment
Do I need to measure the screen? How important is it? Do I need to measure the screen every time I assess a student?
Yes, you need to measure the screen to ensure correct calibration of the webcam. The measurement allows the system to determine where the eyes are positioned on the screen, which is a prerequisite for reliable results.
You only need to measure the screen once per browser and computer. The setting is then saved, and you can carry out multiple assessments without measuring again, as long as you use the same computer and browser.
What does “Other answer” mean in the reading comprehension questions?
For all reading comprehension questions, there is an answer option called Other answer. This option was previously called Incorrect answer and is used when the student’s response does not match any of the listed answer options.
Keep in mind that the student’s answer may still be correct even if it does not exactly match one of the options. For example, it may:
- contain synonyms of the correct answer,
- use a different grammatical form, or
- be a well-formulated explanation that clearly shows the student has understood and can answer the question.
For some students, it may feel sensitive to see how their answers are recorded. As the Examiner, you can adapt the assessment situation, for example by:
- tilting or turning the screen away while answers are being recorded, or
- setting expectations before the assessment and clarifying that it reflects what the student can do right now, and that several answers may be relevant.
What happens if the student moves? Will there still be a result?
Yes – as long as a sufficient number of valid data points are recorded. To present a result, at least 70% of the measurements must be valid, meaning that the student’s gaze has been registered on the screen.
If the student moves a lot, data quality may be affected. The system is therefore designed to only present results when there is enough data for a meaningful assessment.
In other words: if you receive a result, the system has determined that the data quality is sufficient.
After the assessment
What happens to the results? / Where are the results stored?
After you have completed a Web assessment, the student’s results are automatically analysed immediately after the student has read the texts.
To view the results, in the same view where you conduct the assessment, click Published – View results, which appears next to the student’s name. This link will take you to the student’s results, which are stored under Insights – in the same place as the student’s other results.
You can also go directly to Insights and search for the student’s results there.
Why do I only see one eye when I look at the student’s eye movements?
The camera-based technology from Tobii calculates a combined gaze point based on both eyes. This is the point that is displayed.
Raw webcam data naturally contains more measurement variation than data from a dedicated eye tracker. Therefore, the data is processed and filtered before being shown in the portal. What you see in the visualisation is not raw data, but a quality-assured and adjusted representation of the student’s reading.
Visualisation in the portal:
Because webcam data contains more variation, we apply an intelligent adjustment that uses information about where the lines of text are on the screen. This means that the visualisation is an approximation. In some situations – for example, if a student restarts reading in the middle of the text – it may appear as if the student reads the same line several times.
What is important, however, is this: The results for reading speed and analysis are not affected.
The model is trained to interpret camera patterns and provide the same results as eye tracker recordings of the same reading. The visualisation is a support; the actual analysis is based on the underlying model.
Other questions
Is the Web assessment as reliable as assessment with an eye tracker?
Yes. The Web assessment is developed to provide the same type of results as our established eye tracker method.
The model is trained and validated to replicate the results from our traditional assessment and shows an accuracy of 0.97 (where 1.0 represents perfect agreement).
This means that you can use the results in the same way in your teaching – to understand the student’s reading fluency and identify the need for support. We continuously improve and strengthen the model through further validation and data collection.
Can I assess students if I have the role of Teacher in Lexplore?