This guide explains how to use the Content Dashboard to make targeted improvements to your course.

Before you begin

  1. Create a course.
  2. See Accessing the Content Dashboard to get your login credentials.
  3. Log in to the dashboard.

Deal with student feedback

The first step to course maintenance is to read what your students have to say about your course.

  1. Go to the Courses pane.
  2. From the Course drop-down, select the course you want to work on.
  3. From the y-axis radio buttons, select the metric # of feedback messages. 

The bar plot shows the number of feedback messages from students for each exercise in the course (or for each step of a multi-step exercise).

Click on one of the bars. Feedback messages for that bar will appear below. Before you read it, be warned that this is unscreened feedback. Some students get angry or rude in the messages; try not to get offended.

Read through as much of the feedback as you can. Things to look out for include:

  • Recurring problems. Are lots of students falling over the same issue?
  • Breaks and mistakes. Is anything factually incorrect or not working? Fixing mistakes is the easiest way to improve your course's rating.
  • Many not-accepted-right-answers. This indicates a problem with the SCTs (see below).

Deal with excessively difficult exercises

  1. From the y-axis radio buttons, change the metric to % asked hint .

The bar plot now shows the percentage of students who asked for the hint on each exercise.

If too many students are asking for a hint, that is usually a symptom of unclear instructions. A useful heuristic is that most exercises should have less than 35% of students asking for the hint.

  1. From the y-axis radio buttons, change the metric to % asked solution.

The bar plot now shows the percentage of students who asked for the solution on each exercise.

As a general rule, once a student asks for the solution, they don't learn as much as if they solved it themselves, so we try to keep this metric low. If too many students are asking for the solution, that is usually a symptom of an incorrect solution, unclear instructions, or vague hints.

A useful heuristic is that most exercises should have less than 20% of students asking for the solution.

Deal with student unhappiness

  1. From the y-axis radio buttons, change the metric to Average rating

Students can rate each exercise from 1 to 5. The bar plot now shows the average of these ratings.

DataCamp considers a score of 4.7 to indicate a good exercise, and 4.3 to indicate an acceptable exercise. (The majority of ratings from students are 4 or 5.)

Deal with bad SCT feedback messages

If there are many messages of type not-accepted-right-answer, then there may be a problem with the submission correctness tests. Create an issue in the GitHub repository for the course, then get in touch with your Content Quality contact at DataCamp.

Implementing the changes

After using the dashboard to locate problems, use the Teach editor to make your changes. Changes made to the master branch are live on datacamp.com, so you will need to create and work in another branch. When you're finished, open a pull request on GitHub to the master branch and tag your Content Quality contact as the reviewer. They'll let you know if they have any questions or concerns about your updates and will merge the changes live.

Did this answer your question?