How to Use Playlist ‘Reports’

If you’ve created a Playlist and want to see how your users are getting along, we have the feature just for you! 

Introducing ‘Playlist Reports’, the brand new feature from Thinqi that lets you view statistics about your Playlist and go into each individual question, showing you content-specific graphs and statistics. This will allow you to see what you’re doing well in and what you might need to adapt.  

Statistics that are tailored to you and your purposes? We couldn’t be more excited. 

Accessing the Reports Feature

To get to your Playlist Reports, open the ‘Apps menu in the top right-hand corner of the page and click ‘Playlists’. This will take you to a list of your Playlists and Folders. 

Find the Playlist you want to see a report for and look for the drop-down menu. Click this and you will be presented with these options:

  • Rename will allow you to change your Playlist’s name.
  • Move to Folder’ means you can change its location.
  • Copy creates a duplicate of your Playlist.
    • Manage Share Links’ allows you to rename, revoke and create as many share links as you want without having to reproduce the Playlist’s content. If you want to read more about this, have a look at our help guide, How to Use Playlist ‘Share Links’
    •  ‘Reports is the feature we will be looking at (hold tight, we’ll get into that in a second).
  • Manage Contributors allows you to manage your Playlist’s contributors and requests.
  • Delete is where you can delete your Playlist. You will be asked to confirm the deletion.  

So, the moment we’ve all been waiting for— ‘Reports’. Click this option from the drop-down menu and you’ll be taken to an overview of learner performance in the Playlist’s assessments. 

Adding Filter Sets

On the right-hand side of the screen is the ‘Filter Set’ panel, where you can add up to three filter sets to change and compare the data you are viewing. 

Click ‘Add filter set’ and this will add a new filter set. 

Click on the first drop-down menu to change the data set you are looking at – choose between your organisations (which you can change in the organisations app in the app menu) and their nodes by clicking the arrow expand/ collapse button next to each organisation’s name as many times as you need to open up each node. In this example, you can see that the data changes when we click on the different region. Users can be added to different organisational nodes in the ‘Organisations’ app in the app menu. 

With each filter set you add,  you will be able to view data for that filter set’s ‘Users’, ‘Total Completions’, Average Score and Total Attempts’. The ‘Score Distribution bar also allows you to see the score distributions side by side. 

Viewing Reports

In the overview, you will see: 

  • How many users have completed the Playlist 
  • How many times it has been completed 
  • Users’ average scores across the board 
  • The total amount of times your Playlist has been viewed. 

Hover over each option to see more information about each section: for example, how many times each user completed the activities on average, the highest and lowest scores achieved and how many times each user viewed the activities on average. 

Below this, you will see the overall ‘Score Distribution’. This bar graph shows you how many people achieved certain scores in the overall Playlist.

To see more about each individual activity, find the drop-down menu at the very top of the page that says ‘Select an Activity’. Select the activity you want to view and you will see an overview page like the one before.

Head to the top of the page again and find the drop-down menu labelled ‘Select a Question’. Click this and then select the question you want to have a look at the statistics for.  

It’s worth noting that editing certain aspects of your Playlist will impact your reports. 

If you change anything about a specific question, then a new report will be generated for that question. The old question and all its statistics will still be in the drop-down menu, so if you notice that people are finding one question particularly difficult and choose to change it or the wording, you can compare the old statistics against the new. This will help you to see if it’s performing any better than before. 

At the top of the page for every question type, you will be able to see:

  • How many ‘Users completed the question
  • How many Answers were given (hover over to see the number of ‘average attempt(s)’)
  • The ‘Difficulty Index (hover over to see the percentage of users that gave correct and incorrect answers), which measures the difficulty of a question by determining how many students got it right
  • The ‘Discrimination Index (hover over to see a breakdown of this index), which measures how well a question can help quiz authors distinguish between users who have mastered the material and those who have not. 

Just like on the main page, you can add up to three filter sets to view the data compared with other sets of users. 

Depending on the question type, you will see subheaders with different graphs and statistics underneath them. Let’s have a look at which ways the data will be displayed for each question type: 

  • Looking at a ‘Multiple Choice’ question (Image or Text) will show you:
    • Answer Distribution
    • Correct vs Incorrect

And either ‘Answer Breakdown’ or, if the MCQ has more than one correct answer, ‘Popular Combinations’.

  • Sort’ and ‘Either/ Or’ questions will both display statistics for:
    • Number of Incorrect Items
    • Answer Distribution
    • ‘Correct vs Incorrect’
    • And ‘Most Difficult Items if the question included three or more columns to sort the options into.

  • Opening up the reports for ‘Cloze- Text Entry’ questions will show you:
    • Number of Incorrect Items
    • Answer Distribution
    • ‘Correct vs Incorrect.

  • You can learn about the following statistics for ‘Cloze- Select Answer’ questions:
    • Number of Incorrect Items
    • Answer Distribution
    • Correct vs Incorrect
    • Most Difficult Items’ (for more complex questions that have more than 2 choices).

  • Looking at the stats for ‘Reordering’ questions, you’ll see:
    • Number of Incorrect Items
    • Most Popular Answers
    • ‘Correct vs Incorrect’
    • ‘Most Difficult Items’.

In the top right-hand corner of the page is a button labelled ‘Get Report’. If you click on this and then on ‘Download’ once the report has been built, you’ll download a CSV of the Playlist’s responses. You can also download CSV reports for each individual quiz and question by navigating through the tabs at the top. 

When you’re in a particular question, you can navigate back to the very beginning of the Playlist report by clicking this icon at the top of the page.