Skip to content

A Guide to Tracking Progress

Posted by James Simms on February 1, 2018

Why is the Dashboard important?

Our aim is to create a platform where data flows continuously from the student to the teacher and back again. In time, we will add parents and carers into the mix too, so that all of the key players in ensuring students flourish are on the same page. This way, there are no surprises if a student falls behind, and the relevant support can step in to help right when the student needs it and not when it is too late.

All of this data is live and visible on your dashboard. We hope it is intuitive and easy to understand, but if you are unsure about any part of it, this guide is a good place to start. The purpose of the dashboard, with its multiple layers of data, is ultimately to provide you with a solid foundation from which to discuss learning with students.

 

Some key terms

Tutorials: The tutorial is the taught element of the lesson. Tutorials usually last between 8-14 minutes and include the key information required for a particular lesson. Students need to watch a total of 80% of the tutorial for it to be considered complete.

Online notes: Online note-taking is available whenever a student is in a tutorial. They can make a note and, by using a hashtag and a reference word (such as #levers), their note will become bookmarked against the specific moment in the video. This enables students to search through their notes and refer back to the video and moment where the content was taught. This not only helps keep notes organised but also helps with synoptic thinking by linking elements of learning across tutorials and, eventually, even across subjects.

Practice mode: Practice mode is where students can practice answering questions in a risk-free environment, without the perception of judgement. The teacher receives minimal feedback on student progress in practice mode: just the number of questions the student has answered.

Test mode: Once a student is happy and feels ready to test their understanding in a more formal setting (which reports to the teacher), then they can switch to test mode. This is where the last 12 questions answered becomes important as this will be their live comprehension level. There is no time pressure in test mode but students can't refer to their notes.

Checkpoint: Checkpoints are currently the most accurate measures of student understanding. They are note-free, time-pressured and will include questions from a range of lessons. Think of it as the end-of-unit test.

Completion level: The percentage of tutorials which have been completed. We consider that an individual tutorial has been completed when the student has watched over 80% of the total. This completion level is set to 80% so that, even if a student skips the introductions and the summary, the video will still register as completed. Our algorithm also won't credit students for time spent watching the same part of a tutorial twice, so whilst we recommend they do, the report you receive is 100% accurate.

Comprehension level: This is a live report of the student's level of understanding for a given topic. It is calculated based on the last 12 questions they have answered in test mode and checkpoints. So even if they understood the content really well when it was first studied, they might forget parts of this as time goes by. When a student comes back to that topic for revision, or later in the course, their score will be updated to reflect their current, genuine, level of understanding.

Progress: This is a measure of both the completion and comprehension of a course.

Effort: The effort is a measure of the time spent by the student in tutorials and in practice mode, together with the time spent in test mode. Used in conjunction with the progress data, it provides some context which will help when discussing progress with learners.

 

Multiple-Group View

As a teacher of multiple groups (or a manager overseeing multiple groups), it is helpful to be able to see, at a glace, the average completion level and comprehension level of the students within groups. We do not believe in averages much (we prefer to see each student an individual) but we understand that it can be helpful sometimes to see differences between groups for the purpose of sharing good practice or finding reasons why, as a group, students are progressing in different ways.

Progress

In order to compare the progress across groups, you can select the group (or groups) and the course from the left-hand panel, as shown below:

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Effort

Students' effort is measured in time spent during tutorials and practice mode and time spent in test mode. Comparing the effort data between groups can provide useful insights into how much time groups are spending in each area of the site.

Simply click the Effort tab to show the effort data for the groups being compared:

 

Checkpoints

There are multiple levels in the site for students to practice questions and test their understanding. Checkpoints are currently the most accurate measures of student understanding. They are note-free, time-pressured and will include questions from a range of lessons. Think of it as the end-of-unit test. You can compare the checkpoint data between groups by clicking on the Checkpoints tab.

 

Single-Group View

Feeding into the group-level data is the individual-class data. This level is mainly used by the teachers of individual groups to see how students are progressing in relation to expectations. As with the group view, the teacher can see progress, effort and checkpoints but, in the single-group view, they see the data on a student-by-student level.

Progress

Progress is measured as mastery of the lessons on the course. There is no comparison to a target grade, and there is no reference to some student being expected to achieve more than others. All students, when equipped with the resources, the correct behaviours and the support from teachers and family can master all of the content in their course. The progress tab shows the start date, exam date and the current 'Today' date. A student who is completely up-to-date regarding completion and comprehension will be tracking the 'Today' line.

As a helpful guide, we have included the group averages at the top of this page too.

 

Effort

Tracking the effort adds another layer of context to the discussion with a student. It is one of the steps to being able to discuss student performance in relation to effort. If a student is underperforming, the effort levels might reveal why. The same as if they are outperforming expectations. But what if someone is a high achiever without putting in the effort? Or working really hard, but this is not reflected in their progress? These are the difficult conversations that skilful teachers will be able to have with students, equipped with this powerful data. We believe this is the true essence of being a teacher, not delivering powerpoints.

 

Checkpoints

In the group view, you can see student-by-student checkpoint data. This allows you to see the comprehension level over time, and see the macro-areas which require a little more attention. This view will show the students' best checkpoint score.

 

Individual Student View

Underpinning all other layers of data is the individual student view. This is where the real richness comes, and it contains the finest level of data analysis on a lesson level. This micro-level of data allows you to really drill down, in discussion with the student, to which specific areas need to most attention, and which areas have been truly mastered. Teachers can see this for all of their students, and the students can see this themselves so that when you sit down and discuss progress, everyone is on the same page.

 

Progress

The progress tab for an individual student is a daily record of progress. it updates overnight to show an average of the daily test-mode and checkpoint scores.

Effort

For an individual student, you can see effort data on three levels: chapter, topic and lesson. Each of these allows you to see the comprehension and completion of that level.

For example, if you look at the chapters, you can see the completion and comprehension of the chapters in a course. It will show you the score that a student has achieved in test mode and checkpoints and the percentage of the tutorial which has been watched, along with the amount of time spent on each.

Drill down further, and you can see the same information, on a topic-by-topic level, showing the comprehension and completion of each topic within a chapter.

Finally, the most refined level is the lesson-by-lesson breakdown, showing the teacher and student the individual lessons where there may be gaps in their knowledge.

Checkpoints

Tracking an individual's progress via checkpoints is just as easy. When students complete checkpoints, their results are displayed in a bar graph as below. If they attempt the same checkpoint multiple times, their subsequent results appear alongside, making progress visible to both the student and teacher.

 

Equipped with this level of data, teachers can spend time working with individual students on the areas on which they are struggling and students can be confident that they are mastering lessons, topics and chapters and not leaving any gaps in their knowledge.