Purpose

This article introduces users to the Eightfold (EF) Survey Dashboard, including a general overview of the dashboard, information about each dashboard feature, and benefits of using the dashboard.

Audience

This article is directed toward Talent Acquisition/Talent Management users who have surveys enabled on Eightfold.

Background: Dashboard purpose

The Survey Dashboard is designed for the following purposes:

• Show survey data collected in the Eightfold surveys, including:
  • Candidate experience score (NPS)
  • Survey response rate
  • Survey raw data
  • etc.

• Help customers understand candidates or employees’ experience using a specific Eightfold product, and make decisions accordingly.

Accessing the dashboard

To access the dashboard, sign in to your Eightfold account, open the Insights tab, and select Survey Dashboard.

For first-time users

If you are a first-time user of the Survey dashboard, you will need to provision it before you can gain survey insights. Here’s how to provision the dashboard:

1. After signing in, go to More > Admin Console > Analytics > Provision Dashboards.
2. In the Survey Dashboard row, select the Actions icon.
3. Select Create and then Submit. Once you’ve provisioned the dashboard, it will appear as an option in the Dashboards tab.

Tabs overview

• All surveys: All surveys’ data.
• Career site post application survey (external applications): Survey data on the Career site post application survey.
• Careerhub post application survey (internal applications): Survey data on the Careerhub post application survey.
• Interview experience survey: Survey data on the Interview experience survey.
• Glossary

Filter Controls

Dashboard filter controls can be used to refine or subset the data shown in the dashboard. For example, to exclude data from a particular region in a dataset, or to select a certain date range.

Filter controls are located at the top of the dashboard.

The following filter controls are applied to the Survey Dashboard:

Survey Date (from - to)

The survey date is the date on which the survey was submitted. ‘Survey date From - To’ filters control the date range of all charts except for time series charts.

Please note that the date selected in ‘Survey Date To’ is not included in the date range selected. For example, the following filter controls:

‘Survey Date From’: ‘2022/12/01’

‘Survey Date To: ‘2023/01/01’

are selecting the whole month of December 2022, but 2023/01/01 is not selected.

Last N Months

This is also filters on survey date.

This filter control controls the time series charts such as ‘Surveys participants & response rate trend (Last 12M)’. The default value is 12 (last 12 months).

User Location Country

User location country refers to the country associated with the user. This could be different from the ‘position location country’ (for example, if an applicant living in the US applied for a position in Canada, the user location country is US, but the position location country is Canada).

This filter control will filter for the survey data of the users (survey participants) in the selected countries only.

Device

Device refers to the device (e.g., desktop, mobile) on which the user took the survey.

This filter control will filter for the survey data of the users (survey participants) with the selected device(s) only.

Survey ID (embedding ID)

(Only on tab ‘All surveys’) Survey ID refers to the embedding ID of the survey. Each survey will have a unique ID (e.g., ‘pcs_apply_thank_you_page’, ‘career_hub_post_apply_survey’).

This filter control will filter for the survey data of the selected survey ID(s) only.

Metrics and dimensions calculation

Survey participants

• Description: Number of users who submitted a survey in the selected time range, defined by event='submit_survey'. If a user has participated in multiple surveys, they are counted separately.
• Used in tab(s): All tabs
• Formula in Quicksight calculation: distinct_countIf({unique_id}, isNotNull({is_promoter}) AND event = 'submit_survey')
• Dataset(s):
  • survey analytics

Unique survey participants

• Description: Number of unique users who submitted a survey in the selected time range, defined by event='submit_survey'. If a user has participated in multiple surveys, this user is counted as 1 unique participant.
• Used in tab(s): All tabs
• Formula in Quicksight calculation: distinct_countIf({vs_cookie}, event='submit_survey')
  • with filter: namespace = 'survey'

• Dataset(s):

  • server log with positions

# of unique users receiving a survey:

• Description: Number of unique users who had a survey shown to them in the selected date range, defined by event='get_survey'. If a user has received multiple surveys, this user is counted as 1 unique user.
• Used in tab(s): All tabs
• Formula in Quicksight calculation: distinct_countIf({vs_cookie}, event='get_survey')
  • with filter: namespace = 'survey'

• Dataset(s):

  • server log with positions

Response rate

• Description: # of unique survey participants / # of unique users receiving a survey.
• Used in tab(s): All tabs
• Formula in Quicksight calculation: class="prettyprint">distinct_countIf({vs_cookie}, event='submit_survey') / distinct_countIf({vs_cookie}, event='get_survey')
  • with filter: namespace = 'survey'

• Dataset(s):

  • server log with positions

Average rating

• Description: The average of the ratings (number of stars) given by survey participants. Participants are asked to choose from 1 to 5 stars to rate their experience. (Eightfold is currently using a 5-star scale).
• Used in tab(s): All tabs
• Formula in Quicksight calculation: avg({rating})
  • with filters:
    • rating >= 0
    • is_promoter in (-1,0,1)

  
  

• Dataset(s):

  • survey analytics

% promoters

• Description: Promoters are survey participants that gave 5 stars in the survey. % of promoters = # of promoters / # of survey participants.
• Used in tab(s): All tabs
• Formula in Quicksight calculation: distinct_countIf({unique_id}, {is_promoter}=1 AND event = 'submit_survey') / {Survey participants}
• Dataset(s):
  • survey analytics

% detractors

• Description: Detractors are survey participants users that gave 1, 2, or 3 stars in the survey. % of detractor = # of detractors / # of survey participants.
• Used in tab(s): All tabs
• Formula in Quicksight calculation: distinct_countIf({unique_id}, {is_promoter}=-1 AND event = 'submit_survey') / {Survey participants}
• Dataset(s):
  • survey analytics

Candidate experience score (NPS)

• Description: % of promoters - % of detractors
• Used in tab(s): All tabs
• Formula in Quicksight calculation: {% Promoters} - {% Detractors}
• Dataset(s):
  • survey analytics

User email

• Description: The user email associated with the survey participant. If the user email is ‘Null’ that means no user email was captured.
• Used in tab(s): All tabs
• Formula in Quicksight calculation: N/A
• Dataset(s):
  • survey analytics

PCS post apply survey specific metrics and dimensions calculation

For each PCS post-apply survey, survey takers can change their rating of their application experience multiple times after submitting the initial answer (for example, they can select 5 stars, and then change to 4 stars, and then change to 3 stars). Technically, only the last rating submitted should be considered in the NPS calculation. Hence, some metrics calculation is slightly different from those above.

Survey participants - pcs survey

• Description: Number of users who submitted a survey in the selected time range, defined by event='submit_survey'. If a user has participated in multiple surveys, they are counted separately.
• Used in tab(s): Career site post application tab.
• Formula in Quicksight calculation: {Surveys taken - pcs_apply_thank_you_page} = distinct_countIf(concat({vs_cookie}, toString({position_id})), {embedding_id} = 'pcs_apply_thank_you_page' AND event = 'submit_survey')
• Dataset(s):
  • survey analytics

% promoters - pcs survey

• Description: Promoters are survey participants that gave 5 stars in the survey. % of promoters = # of promoters / # of survey participants. If the survey participant has submitted multiple ratings to the same survey (same application), only the last rating is used in the calculation.
• Used in tab(s): Career site post application tab.
• Formula in Quicksight calculation: distinct_countIf(concat({vs_cookie}, toString({position_id})), {is_promoter}=1 AND isNotNull({is last rating})) / {Surveys taken - pcs_apply_thank_you_page}
  • where {is last rating} = ifelse({t_create}=maxOver({t_create},[{embedding_id}, {vs_cookie}, {question_template_id}, {position_id}], PRE_AGG),rating, NULL)

• Dataset(s):

  • survey analytics

% detractors - pcs survey

• Description: Detractors are survey participants users that gave 1, 2, or 3 stars in the survey. % of detractor = # of detractors / # of survey participants. If the survey participant has submitted multiple ratings to the same survey (same application), only the last rating is used in the calculation.
• Used in tab(s): Career site post application tab.
• Formula in Quicksight calculation: distinct_countIf(concat({vs_cookie}, toString({position_id})), {is_promoter}=-1 AND isNotNull({is last rating})) / {Surveys taken - pcs_apply_thank_you_page}
  • where {is last rating} = ifelse({t_create}=maxOver({t_create},[{embedding_id}, {vs_cookie}, {question_template_id}, {position_id}], PRE_AGG),rating, NULL)

• Dataset(s):

  • survey analytics

Candidate experience score (NPS) - pcs survey

• Description: % of promoters - % of detractors
• Used in tab(s): Career site post application tab.
• Formula in Quicksight calculation: {% Promoters - pcs survey} - {% Detractors - pcs survey}
• Dataset(s):
  • survey analytics

Other metrics are the same.