Your survey results can be accessed from your Admin dashboard. Using the menu on the left side of the screen, navigate to "Surveys", then "Work Design Survey". This will bring up a list of all Work Design surveys that have been created. Select the survey you want to view from the list to display the results dashboard.
Navigating the Results Dashboard
The results dashboard will populate once eight responses have been received, and will update live as new responses are submitted, until the survey is closed. To close the survey, click the "Close Survey" button in the top right of the dashboard.
The table in the top left section of the results dashboard provides the number and percentage of respondents who have completed, started, and not started the survey. Next to the table is a circumplex showing the ratings for each factor, split into domain. Hover over each factor to see its score out of seven. Use the tabs above the circumplex to switch between domains.
Beneath the summary data, a table provides greater detail on responses for each factor. Click on each factor to see the response distribution graph (see below for how to interpret these).
The question mark icon next to each factor name provides the definition of the factor, along with tips and suggestions for potential improvement actions.
The tabs along the top of the table can be used to navigate between the three domains, as well as viewing the responses to outcome measures. The "Respondents" tab provides a list of users to whom the survey was sent, and their completion status. This is the only information about individual users available through the survey dashboard.
The filter tool can be used to interrogate the dashboard and view results from different demographic groups. There is no limit to the number of filters that can be applied, however when the number of users within a filtered group becomes fewer than 8, the dashboard will not populate.
Factor Scores
All Work Design Survey questions are answered on a seven-point Likert-type scale that either ask for a level of agreement (e.g. strongly agree to strongly disagree), or frequency of event occurrence (e.g. never to always). Numerical scores are attributed from 1-7 for these responses and then averaged to determine the score for the factor in question. For example, if a respondent answered "very often" (6 on the 7 point rating scale) on the three questions relating to the factor, the average score would be 6 for that factor.
Interpreting the Median Scores
Sorting the factors by median score is one way to determine priority areas for intervention. For ease of interpretation, the factor score (average of 1-7 rating) is converted to a score out of 100. A perfect score (i.e. 7 out of 7) is equivalent to a median score of 100, the worst possible score on a factor is 1/100 (1 out of 7), and the neutral point is 50 (i.e. 4 out of 7). Where needed, certain factors are reverse scored in order to maintain 100 as the ideal score and 1 as the least desirable.
Median factor scores are used in preference to averages in order to avoid the effects of outliers (especially in smaller samples). The median reflects the middle score (converted from a score out of 7 to a score out of 100), from the selected group for whom the survey data is being analysed. With this in mind, a median score above 50 means that the majority of respondents viewed this element of work favourably, a median score under 50 means that the majority of respondents viewed this element more negatively.
Interpreting Risk Rating Labels
It is also possible to order Work Design Survey results by risk level to determine priority areas. The Work Design Survey results dashboard contains three risk labels: "At Risk", "Neutral", and "Optimal". These can be toggled in the table depending on the risk level that is desired to be viewed across all survey scales. A frequency distribution (by percentage) of the three risk ratings can be viewed by selecting a specific factor.
Risk labels are applied by question level responses. The "At Risk" label refers to the percentage of respondents who have rated a factor as 1, 2, or 3 on the 7-point scale (up to a score of 3.5 when two or more question responses are averaged to create a factor score). The 4 or 5 rating (up to averaged score of 5.5) is labelled "Neutral", and the 6 or 7 rating (from an average score of 5.5 upwards) is labelled "Optimal".
Taken together, the median score and the risk rating labels provide a good understanding of employee perceptions as captured by the Work Design Survey and indicates potential priority areas for intervention.
Comparing Surveys
You can compare different surveys (e.g. the current survey with a previous survey), or compare groups within the same survey using the "Compare Surveys" feature. This feature can help to demonstrate change over time, or to identify team differences in perceptions of work factors that are protective or harmful to mental health.
From your Admin dashboard, use the menu on the left side of the screen to navigate to "Surveys", then "Work Design Survey". In the top right corner of the screen, choose "Compare Surveys".
A screen will open with a list of surveys available, with three steps at the top of the screen.
- Step 1 is "Choose Survey". Select the survey you want to use.
- Step 2 is "Choose Comparison". If you want to compare groups within a survey then select the same survey as step 1. Otherwise, select your preferred comparison survey.
- Step 3 is Confirmation. Check that you have chosen the right surveys, then click the blue "Compare" button.
The dashboard will now display the results from both surveys to facilitate comparison. To compare groups within the same survey, untick the "Use same filter" box, then apply filters to survey 1 and survey 2 to display group results. If you want to compare one group against the global results, then apply filters only to one of the surveys. A summary table at the top of the page will display the six factors that have the greatest median score difference between the two groups. The detailed table beneath the summary shows the risk label differences between the two groups for each factor.
