Admin Analytics FAQ

Analytics

• What important updates are coming to my Analytics Dashboard in 2024?
• How can I view progress on a course?
• How can I unlock detailed user watch data in the User Leaderboard report?

What important updates are coming to my Analytics Dashboard in 2024?

The MasterClass at Work Analytics Dashboard is getting a set of major updates in 2024, including: 

1. NEW Filter by Custom Time Ranges
2. NEW Playlist and Historical User Data 
3. NEW Aggregated & Lesson Level Metrics
4. Redefined Metrics 
5. NEW Top Courses Filtering  

Read below to learn more about what changes you can expect to see:

Filter by Custom Time Ranges 

Admins can now select one of the preset time range options or select a custom range using the custom range picker at the top of the page. 

• 🗒️: The earliest possible date to select in the custom range picker is the start date of the organization.

The metrics you see below will be aggregated over the preset or custom range you select. If there is a trend graph on the page, the trend graph will display the entirety of the range you select broken up into the intervals selected. For example, the interval selected above is “Monthly”.

• 🗒️: Depending on the range and interval selected, partial intervals may exist in the beginning and end of the range. Exact dates will be specified when you hover on a data point in a trend graph. 

Playlist and Historical Data 

There are 3 course types on the Masterclass at Work platform today: classes (including classes with activities), series, and playlists. Today, data for playlists are only included in the Course Progress report and the User Leaderboard report. Data for classes with activities are only included from September 2023 forward. 

 

With this update, data for all MasterClass at Work content formats (classes, series, and playlists) will be included on all pages of the Analytics dashboard. Historical data for all content formats since the start date of your organization will also be included. 

 

🗒️: This means you can expect an increase in Minutes Watched and Active Users than what you have been seeing as engagement on all formats across all time gets included in your metrics. The Top Courses, Top Users, Top Skills may also change as all formats get included.

To learn more about the Course Progress report metrics, see this article. To learn more about the User Leaderboard report metrics, see this article.

 

Aggregated & Lesson Level Metrics

Today, some of the metrics that we provide can only be calculated over preset intervals. With this update, you will be able to aggregate these metrics over custom time ranges to better understand the activity and engagement of your organization. The metrics that will now be able to be aggregated over custom ranges are: 

 

Unique Active Users - The total number of unique users over a preset or custom time range who have consumed 1s of any lesson. A lesson is any individual video on the platform.

Avg Lessons Watched / User - The total lessons watched divided by the number of unique active users over a preset or custom time range. 

% Active Rate - The # of unique active users divided by the number of unique redeemed users over a preset or custom time range. 

Average Minutes Watched Per User - The total minutes watched divided by the number of unique active users over a preset or custom time range. 

Average Lessons Watched Per User - The total lessons watched divided by the number of unique active users over a preset or custom time range.

 

We will be adding additional lesson level metrics to the Admin Analytics Dashboard. For a specific course a user in your organization has watched, you will be able to see the following metrics in the downloadable CSV of your Course Progress and User Leaderboard reports:

 

Total Lessons - the total number of lessons in the course 

# of Lessons Watched - the total number of lessons in the course that the user has watched

% Lesson {X} Completed - for each lesson “X” watched, the % of that lesson that they completed, where % completion is calculated by the minutes watched of the lesson divided by the total duration of the lesson.

🗒️:This data is only available if you have Individual Member Tracking Turned on, see how to turn it on here.

 

Redefined Metrics 

In order to give a better understanding of the activity and engagement of your organization, we are redefining some of our metric principles to capture the activity in your organization with greater precision. The redefinitions and their impact on the current metrics include:

 

Today	Early 2024 Update
Minutes Watched Minutes watched is determined by where the user left off in a lesson.	Minutes Watched  Minutes watched is determined based on the minutes consumed of a lesson. If a 20 minute lesson is watched at 2X speed, it will still count as 20 minutes. If a 20 minute video is watched twice it will count as 40 minutes.  🗒️:This means any minutes watched metrics may be different than what you are used to seeing.
Active User  The number of users who reached the 15 second mark of any lesson while on the filtered team. A lesson is any individual video on the platform.	Active User  The number of users who have consumed any lesson content (1s or more). A lesson is any individual video on the platform. 🗒️:This means the number of active users may now be higher than what you may have seen on the reports so far.
Filtering for Team Data When viewing a report filtered for a team, the data displayed for a certain point in time includes actions taken by users who were on the team at that point in time.  This means that the report for a certain time range includes data for users who were previously on that team during that time range, but may not be on the team today. Similarly, if a user is on the team today but wasn’t in the range selected, their data will not be included.	Filtering for Team Data When viewing a report filtered for a team, the data will include any actions taken by users who are on that team (or in one or more of the sub-teams of that team) as of today, including their historical data.  Note: users can also be part of multiple teams.  🗒️:This means that viewing a report for a team over a certain time range will consistently show you the trend over time for the same set of users. Note that moving users between teams will modify the historical data for a report for a team, since the report will always display data for users who are on the team today.
Skills  Skills displayed include both main skill categories and sub-skills on our platform. Every sub-skill is mapped to a skill category. See our library for the 10 main skill categories and sub-skills under each category.	Skills  The skills displayed in the table on the dashboard are the 10 main skill categories on the platform. To dive deeper, you can find the minutes watched for all sub-skills in the CSV download available in the top right corner of the page.  Minutes are attributed to sub-skills and skill categories based on the lessons watched in a course. For each lesson watched in a course :  Minutes watched for that lesson are attributed to each sub-skill that lesson is tagged with and the parent skill category that the sub-skill falls under.  If a lesson is tagged with multiple sub-skills that fall under the same parent skill category, minutes will only be attributed to the parent skill category once. This is why the sum of minutes watched for all sub-skills under a parent skill category may not equal the number of minutes watched for that skill category. 🗒️:This means any minutes watched attributed to certain skills may be different than what you are used to seeing.

 

Top Courses Filtering

You will now be able to filter your Top Courses page by a specific skill category. The skills in the filter will correlate to each of the skill categories at the top of the MasterClass At Work library.

• Clicking on a skill category in the skill category filter will return the top 10 courses (ranked by minutes watched) tagged with that skill category at the course level.
• 🗒️: The Skill Category labeled next to the course is the one primary Skill Category of that course, but note that a course might be tagged with multiple Skill Categories.

How can I view progress on a course?

You can view progress of your users on any course by navigating to Reports > Course Progress page and selecting a course by typing to filter all courses (classes, series and playlists). 

The Course Progress page provides you with an overview of the course's overall completion percentage, the date it was shared, and the person who shared it.

To access progress for any course that has been shared, you can click the "View Progress” button on a course listed on the Shared Content page within your Admin Dashboard. This button will redirect to the Course Progress page under Reports, where you can track the progress of course completion.

🗒️: If user progress for individual tracking is enabled, you willalso be able to see the last engagement status and the percentage of completion. However, if this feature is turned off, you will only have visibility into who the course was shared with, without specific progress details. Reach out to your rep to turn this on for your company and ask for consent from users.

You can choose to only view progress for users who were assigned or recommended this course, or any user from the organization who already took the course.

You can also filter results by team.

How can I unlock detailed user watch data in the User Leaderboard report?

To better understand and track your team's progress, MasterClass at Work provides the User Leaderboard page. This article will guide you through its features and how to access more detailed watch data for your users.

By default, the new User Leaderboard page gives you aggregated classes started and lessons started for your individual users.

 

For organizations that wish to dive deeper into individual user metrics, we provide an option to access more granular data at the license level. 

In order to do so, we will prompt users to individually grant consent to allow their organization to view their class progress and completions. If consent is granted, you'll have access to detailed metrics for each course a consenting user has watched. These metrics, located in the downloadable CSV report, are:

• Course Title
• Course Type
• Course Duration (in mins)
• % Completed
• Date Started
• Date Completed
• Date Last Accessed
• Course Primary Skill

See here for details on how those metrics are defined. Data for users who do not grant consent will not be displayed in the CSV download.

To turn on Individual User Analytics, follow these steps : 

1. Reach out to your Masterclass At Work representative, or send an email to atwork@masterclass.com to better understand the behavior of turning this feature on for your users. 
   • See the template located in the Admin Resource Center titled “Individual User Tracking Request Template” for information on how you can request to turn this feature on. The Admin Resource Center is currently only available to All Access Admin. 
2. Communicate to your organization informing them that you have opted in to viewing individual user analytics and to please accept consent so your organization can better report on user engagement. 
   • See the template located in the Admin Resource Center titled “Individual User Tracking Organization Communication Template” for information on how to update the users in your organization of the change. The Admin Resource Center is currently only available to All Access Admin. 
3. A MasterClass At Work representative will turn on User Level Analytics for your organization and inform you once that is complete.