Analytics Metrics Definitions
- How are Analytics Overview metrics defined?
- How are Active User metrics defined?
- How are Engagement metrics defined?
- How are Course Progress metrics defined?
- How are Top Courses metrics defined?
- How are Top Skills metrics defined?
- How are User Leaderboard metrics defined?
How are Analytics Overview metrics defined?
The MasterClass at Work Analytics Overview page provides you with a snapshot view of some of the most critical metrics for your teams. Each section of your overview page corresponds to a page within your Analytics dashboard. You can drill into each subpage by navigating from the side bar or clicking “View Details” within each row.
All metrics are aggregated over the last 90 days, except for the User Leaderboard section, which contains data over the entire contract period.
The metrics and rows on the Analytics Overview page are defined as follows :
Redeemed Users - The number of users on the team you have filtered by, who have redeemed their seat and logged into the platform.
- 🗒️: For SSO configured licenses, a seat is redeemed the first time a user logs in with their organization.
- 🗒️: For non-SSO configured licenses, a seat is redeemed through the invitation link sent to the user via email.
Unredeemed Users - The number of users who have been invited, but have yet to accept their invite and log in to the platform.
- 🗒️: For SSO-configured licenses, this number will always be 0.
Open Seats Available - The number of remaining seats on the license that can be allocated. This metric is equal to the total seats on the license subtracted by redeemed users and unredeemed users. This metric is only available when filtered for the top level of your organization. If you have admin privileges for the top-level team, you will be filtered for the top-level team by default when loading the page.
Total Minutes Watched - The total minutes watched by users while they have been on the filtered team summed over the last 90 days. Minutes watched is determined by where the user left off in a lesson. See here for more details about our Active User report and see here for more details about our Engagement report.
Top Skills Row - The top 4 skills displayed are based on minutes watched for the filtered team. Skills include both main skill categories and sub-skills on our platform. Every sub-skill is mapped to a skill category. See here for more details about our skill mapping and skill metrics.
Top Courses Row - The top 4 courses are based on minutes watched for the filtered team. A course refers to classes (including classes with activities), series, and playlists. The Analytics Overview page includes data for classes and series. Courses are made up of lessons. See here for more details about our Top Courses report and metrics.
User Leaderboard Row - The top 4 users who have watched the most courses on the team you have filtered by. A course is watched when a user watches any lesson within that course and can only be watched once per user. A course refers to classes (including classes with activities), series, and playlists. See here for more details about our User Leaderboard report and metrics.
For users who are Admins of multiple teams and want to see the breakdown of metrics by team, the downloadable report on the Analytics Overview page provides a CSV file of critical metrics spread across the teams you are filtered for. The metrics available in the CSV include:
Team Name - The team or team(s) you are filtered for.
Total Minutes Watched - The total minutes watched by users while they have been on the filtered team summed over the last 90 days. Minutes watched is determined by where the user left off in a lesson.
How are Active User metrics defined?
The MasterClass at Work Active User page provides a trend chart of the active users in your organization for various interval and range selections.
- An active user is defined as a user that has reached the 15 second mark of any lesson during each interval selected. If a user is active in multiple intervals, then they will count as an active user in each of the intervals they were active for.
- The interval picker allows you to select what grouping of days you would like to view data for. The intervals supported in your Active User page are: Quarterly, Monthly, Weekly, and Daily.
The range picker allows you to choose the range of data you want to view data for. The ranges supported in your Active User page shift depending on the intervals selected. Ranges start at the beginning of the first day of the interval selected, and end at the last concluded interval. This means that
- For the “Quarterly” interval selection: the range will end at the last completed calendar quarter. This could be March 31st, June 30th, September 30th, or December 31st.
- For the “Monthly” interval selection: the range will end at the last completed calendar month.
- For the “Weekly” interval selection: the range will end at the last completed week, ending on Sunday.
- For the “Daily” interval selection: the range will end at the last completed day.
Once the desired interval and range has been selected, users can hover over the trend chart to see additional metrics for each interval in the range. Users can also access these additional active user metrics for the interval and range selected in the downloadable CSV report on the top right corner:
Unique Redeemed Users - The number of users on the filtered team who have redeemed their seat and logged into the platform.
- 🗒️: For SSO-configured licenses, a seat is redeemed the first time a user logs in with their organization.
- 🗒️: For non-SSO configured licenses, a seat is redeemed through the invitation link sent to the user via email.
Unique Active Users - The number of users who reached the 15 second mark of any lesson while on the filtered team. The Active Users page includes minutes watched data for lessons in classes and series.
% Active Rate - The unique active users in the interval divided by the number of redeemed users in the interval.
Minutes Watched - The minutes watched by users while they have been on the filtered team. Minutes watched is determined by where the user left off in a lesson. The Active Users page includes minutes watched data for classes and series.
Workbooks Downloaded - The sum of unique workbooks downloaded per device per day for each unique active user on the filtered team. Workbooks are downloaded by clicking on any class guide within any lesson.
Courses Added - The sum of the unique courses added to the watchlist for each unique active user on the filtered team. Courses are added to the watchlist by selecting “Add to My List” when hovering over the Course thumbnail.
How are Engagement metrics defined?
The MasterClass at Work Engagement page provides a trend chart of the total and average minutes watched in your organization for various interval and range selections.
- Minutes Watched - The minutes watched by users while they have been on the filtered team. Minutes watched is determined by where the user left off in a lesson. The Engagement page includes minutes watched data for classes and series.
-
Average Minutes Watched Per User - The minutes watched divided by the number of active users on the filtered team
- An active user is defined as a user that has reached the 15-second mark of any lesson during each interval selected. The Engagement page includes minutes watched data for lessons in classes and series.
- The interval picker allows you to select what grouping of days you would like to view data for. The intervals supported in your Active User page are: Quarterly, Monthly, Weekly, and Daily.
The range picker allows you to choose the start date and end date of data you want to view data for. The ranges supported in your Active User page shift depending on the intervals selected. Ranges start at the beginning of the first day of the interval selected, and end at the last concluded interval. This means that:
- For the “Quarterly” interval selection: the range will end at the last completed calendar quarter. This could be March 31st, June 30th, September 30th, or December 31st.
- For the “Monthly” interval selection: the range will end at the last completed calendar month.
- For the “Weekly” interval selection: the range will end at the last completed week, ending on Sunday.
- For the “Daily” interval selection: the range will end at the last completed day.
Once the desired interval and range has been selected, users can hover over the trend chart to see additional metrics for each interval in the range. Users can also access these additional active user metrics for the interval and range selected in the downloadable CSV report on the top right corner. Here are the metrics available in the CSV download:
Unique Redeemed Users - The number of users on the filtered team who have redeemed their seat and logged into the platform.
- 🗒️: For SSO-configured licenses, a seat is redeemed the first time a user logs in with their organization.
- 🗒️: For SSO-configured licenses, a seat is redeemed through the invitation link sent to the user via email.
Unique Active Users - The number of users who reached the 15 second mark of any lesson while on the filtered team.
% Active Rate - The unique active users in the interval divided by the number of redeemed users in the interval.
Minutes Watched - The total minutes watched by users while they have been on the filtered team. Minutes watched is determined by where the user left off in a lesson. The Engagement page includes minutes watched data for classes and series.
Workbooks Downloaded - The sum of unique workbooks downloaded per device per day for each unique active user on the filtered team. Workbooks are downloaded by clicking on any class guide within any lesson.
Courses Added - The sum of the unique courses added to the watchlist for each unique active user on the filtered team. Courses are added to the watchlist by selecting “Add to My List” when hovering over the Course thumbnail.
How are Course Progress metrics defined?
The MasterClass at Work Course Progress page provides an overview of analytics for specific courses that may have been watched by the users in your organization.
What is a course? A course is any collection of lessons across all formats: Classes (including classes with activities), Series, and Playlists.
There are four different sections on the course progress page:
- Effectiveness Rating Section
- Impact Survey
- Engagement Metrics
- User Details
The data that is shown in each of these sections is dependent on the filters selected at the top of the page. Admins can filter:
- [Default] By all users in the top-level team or organization
- By a different team that you are an admin for using the team filter in the top right corner
- If the course was shared:
- By users who were shared the course by any admin
- By users that you have shared the course with
The data shown in the rest of the sections on the page will be inclusive of all users who fit the criteria of the filters selected.
🗒️: The Course Progress page sections are selectively shown depending on the number of users who meet the filtering criteria. This is done to maintain user privacy.
- If one of the sections have been hidden, you will see the note “Some data is unavailable to display because not enough users have engaged with this course” at the top of the Course Progress page.
- Effectiveness Rating Section
This section displays the results of the answers to the first question in the MasterClass at Work survey that users see after they finish watching 3 lessons in any class or playlist, or after watching their first episodic lesson in a series.
The metrics displayed in this section are :
Total User Responses - The number of users who have selected a value for the effectiveness rating question.
Average Effectiveness Rating - The average of all responses to this question in the user survey.
Downloading the CSV for this section will provide you with all responses in a CSV format.
2. Impact Survey Section
This section displays the results of the impact question in the MasterClass at Work survey that users see after they finish watching 3 lessons in any class or playlist, or after watching their first episodic lesson in a series.
Users can choose to answer the impact survey question after they answer the effectiveness survey question above.
The metrics displayed in this section are :
Total User Responses - The number of users who have submitted a response to the impact survey question.
User Responses Per Option - The number of users who have submitted a response with that option selected. Multiple options can be selected in one response.
% Per Option - The user responses per option divided by the total user responses.
- 🗒️: If a user has selected other, that user’s free response answer will appear in the drop-down for the Impact Survey “Other” option section.
- 🗒️: Since this survey question is a multi-select question, the total user responses may not be equal to the sum of the user responses per option. This is because a user can select multiple options.
3. Engagement Section
This section displays an overview of engagement data for the users who fit the criteria of filters selected at the top of the page.
- Users can filter by team, by all users who shared the course (if applicable), and by users who you shared the course with (if applicable).
The metrics displayed in this section are :
Number of Users - The number of users that fit the criteria of filters selected at the top of the page.
% Watched - The number of users who watched the course divided by the total number of users that fit the criteria of filters selected at the top of the page.
Number of Users Who Watched - The number of users who watched the course. A course is watched when a user clicks on any lesson within that course. A course can only be watched once per user.
Average Minutes Watched Per User - The total number of minutes watched for that course divided by the number of users who watched that course. Minutes watched is calculated by the furthest progress made in that course.
Completion % - The % of users who have completed the course. A course is completed when the user has watched 95% of all of the lessons in the course.
- 🗒️: Classes with activities are considered completed when a user has marked all the Lessons and Activities in the class as “Done”
4. User Details Section
This section is only available if your organization has turned on Individual User Tracking. If your organization does not have Individual User Tracking turned on, this section will only display the users who were shared the course.
- Learn more about what Individual User Tracking is and how to turn it on here.
If available, this section displays an overview of engagement data for the users who fit the criteria of filters selected at the top of the page.
- Users can filter by team, by all users who shared the course (if applicable), and by users who you shared the course with (if applicable).
- See here for more information on how to use the Course Progress page, like selecting a specific course and/or filtering by only users who have shared that course.
🗒️: If Individual User Tracking is turned on, only users who have granted consent will be displayed in the table and downloadable CSV.
🗒️: This table shows any user in the filtered team filtered, who has either been shared the course or has any progress in the course (or both, depending on the filters selected). This is why the total users in the Engagement section and total users in the User Details section could be different.
🗒️: If the course has been shared, an additional “Shared By” column will display in the table next to the “First Shared On” column. There will also be an option to unshare the course with a user.
The metrics displayed in this section are defined as:
Number of Users - The number of users that fit the criteria of filters selected at the top of the page and have granted consent.
First Shared On - The date that the user was first shared the course.
Shared By - (if applicable) the Admin that first shared the course with the user.
Last Engaged On - The date that the user last watched the course. A course is watched when a user clicks on any lesson within that course.
% Complete - The % of the course the user has completed. This is calculated by summing the furthest minute a user has reached in each lesson of the course, and dividing that by the total minutes in the course.
Downloading the CSV for this section will provide you with additional metrics about the users who watched this course :
Shared By - (if applicable) the Admin that first shared the course with the user.
First Shared On - The date that the user first shared the course.
User Email - The email of the user who watched the course.
Course Title - The title of each course the user has watched.
Course Duration (in mins) - The duration of each course the user has watched, in minutes.
% Completed - The % completed for each course the user has watched. This is calculated by summing the furthest minute a user has reached in each lesson of the course, and dividing that by the total minutes in the course.
Minutes Watched - The total minutes watched for the user. This is calculated by summing the furthest minute a user has reached in each lesson of the course.
Date Started - The date the user started watching the course.
Date Completed - The date the user completed the course. A course is completed when the user has watched 95% of all of the lessons in the course.
- 🗒️: A course can have more than 95 “% Completed” but no “Date Completed" when the user has not watched 95% of each lesson in the course.
- 🗒️: Classes with activities are considered completed when a user has marked all the Lessons and Activities in the class as “Done”
Date Last Accessed - The date last viewed for each course the user has watched.
Course Primary Skill - The primary skill that each course the user has watched is tagged with. A course can only have one primary skill. This could be one of the 10 skill categories at the top of the MasterClass At Work library, or a sub-skill that displays in the library filters once clicking on a skill category.
How are Top Courses metrics defined?
The MasterClass at Work Top Courses page provides a table of your top 10 courses by minutes watched for the filtered team.
What is a course? A course is any collection of lessons across all formats: Classes (including classes with activities), Series, and Playlists.
What is a lesson? A lesson is any individual video in a course. The same or similar content from a lesson can be in multiple courses (for example, the same lesson content may appear in a class and a playlist), but each instance of a lesson is tracked separately.
- This means that if a lesson is watched under a class but also exists in a playlist, it will only count as watched under the class and minutes will not double count.
The Top Courses page includes minutes watched data for classes and series.
For each course listed in the page, users can view the :
Course Title - The title of each course the user has watched.
Course Type - The type of course that the user has watched. “Class” refers to any class (including classes with activities), “Series” refers to the episodic series on the platform, and “Playlist” refers to any playlists. You can filter for each of these course types in the MasterClass At Work library.
Course Primary Skill Category - The primary skill category that each course has been tagged with. A course can only have one primary skill. This will be one of the 10 skill categories at the top of the MasterClass At Work library.
Minutes Watched - The total minutes watched for each course by all the users who watched the course while on the filtered team.
Users can also download the CSV report in the top right corner to see a list of all courses watched by the filtered team:
How are Top Skills metrics defined?
Overview
The MasterClass at Work Top Skills page provides a table of your top 10 skills by minutes watched for the filtered team.
Skills include both main skill categories and sub-skills on our platform. Every sub-skill is mapped to a skill category. See our library for supported skill categories and sub-skills.
Skill categories and sub-skills can be tagged at the lesson level as well as at the course level.
- If a skill is only tagged at the course level, then minutes watched for that skill will be the minutes watched of that course.
- If a skill is only tagged at the lesson level, then minutes watched for that skill will be the sum of minutes watched for all lessons tagged with that skill.
- If a skill is tagged at the course and lesson level, then the minutes watched for that skill will be the maximum value of minutes watched at the course level or lesson level.
What is a course? A course is any collection of lessons across all formats: Classes (including classes with activities), Series, and Playlists.
What is a lesson? A lesson is any individual video in a course. The same or similar content from a lesson can be in multiple courses (for example, the same lesson content may appear in a class and a playlist), but each instance of a lesson is tracked separately.
- This means that if a lesson is watched under a class but also exists in a playlist, it will only count as watched under the class and minutes will not double count.
🗒️: Both courses and lessons can be tagged with any amount of skills. Minutes watched will be attributed to all the skills that a course or lesson is tagged with.
The Top Skills page includes minutes watched data for classes and series.
Users can also download the CSV report in the top right corner to see a list of all skills watched by the filtered team:
How are User Leaderboard metrics defined?
The MasterClass at Work User Leaderboard page provides individual user metrics for the different users in your organization, including courses watched and lessons watched.
What is a course? A course is any collection of lessons across all formats: Classes (including classes with activities), Series, and Playlists.
What is a lesson? A lesson is any individual video in a course. The same or similar content from a lesson can be in multiple courses (for example, the same lesson content may appear in a class and a playlist), but each instance of a lesson is tracked separately.
- This means that if a lesson is watched under a class but also exists in a playlist, it will only count as watched under the class and minutes will not double count.
In the dashboard, the terms and metrics included are :
Courses Watched - The total number of courses viewed by the user in the entire contract period. A course is watched when a user clicks on any lesson within that course. A course can only be watched once per user.
Lessons Watched - The total number of lessons viewed by the user in the entire contract period. A lesson is watched when a user clicks on the lesson. A lesson can only be watched once per user. The same or similar content from a lesson can appear in multiple courses (including playlists), but all instances of that lesson are tracked separately.
- This means that if a lesson is watched under a class but also exists in a playlist, it will only count as one watch. If it is also watched under the class it will count as two watches.
If you have Individual User Tracking turned on for your organization, you will have access to more detailed watch metrics in the downloadable CSV report. See here for how to access these additional metrics in your downloadable CSV report:
Course Title - The title of each course the user has watched.
Course Type - The type of course that the user has watched. “Class” refers to any class (with or without activities), “Series” refers to the episodic series on the platform, and “Playlist” refers to any playlists. You can filter for each of these course types in the MasterClass At Work library.
Course Duration (in mins) - The duration of each course the user has watched, in minutes.
% Completed - The % completed for each course the user has watched. This is calculated by summing the furthest minute a user has reached in each lesson of the course, and dividing that by the total minutes in the course.
Date Started - The date started for each course the user has watched.
Date Completed - The date completed for each course the user has completed. A course is completed when the user has watched 95% of all of the lessons in the course.
- 🗒️: A course can have more than 95 “% of Class Completed” but no “Date Completed" when the user has not watched 95% of each lesson in the course.
- 🗒️: Classes with activities are considered completed when a user has marked all the Lessons and Activities in the class as “Done”
Date Last Accessed - The date last viewed for each course the user has watched.
Course Primary Skill - The primary skill that each course the user has watched is tagged with. This could be one of the 10 skill categories at the top of the MasterClass At Work library, or a sub-skill that displays in the library filters once clicking on a skill category.
