Attachment N – Calculation of Survey Data

Note:  When calculating the DOT scores, we do NOT take the sum of the OA’s scores, but instead we take the sum of all responses from all participating procurement offices with in OAs. Example:  Some of our OA’s have just one procurement office, but others may have 2, 3, or 4 procurement offices or regions.  Instead of looking at just 9 or 10 OA responses, we look at 15 or 16 procurement offices when calculating our averages.

All Survey Results are calculated by a systems program, which is part of the PMAT2 System.  An OA’s total data is available to each OA for their use.  No OA may view another OA’s results.  Only the OSPE has access to all the data from every OA and office within an OA.  PMAT2 presents the data in a group of “canned” reporting formats for general use.  OA and DOT may extract their results and design other means of displaying their results.

Sample Question:

My procurement office works with me to develop procurement strategies early in the planning process.


 Strongly Agree

 Agree

 Disagree

 Strongly Disagree

 Not Applicable

 Very Important

 Important

 Not Important

4

3

2

1

 

3

2

1

 

 

 

SURVEY CALCULATIONS (For both Customer and Employee)

Business Measure

Calculation

Timelines

This score is determined in two stages:

Stage One: General Agreement Score is determined by first adding up all the “Strongly Agree” responses, dividing by the number or respondents, then adding up all the “Agree” responses, and dividing by the number of respondents. The sum of these two scores are then added together for the “General Agreement Score.”  Example:  125 responded “Strongly Agree” of 628 total responses to this question = 20%.  358 responded “Agree” of 628 total responses to this question = 57%. Add 20% to 57% = 77% “General Agreement” score for this question.

Stage Two: The number questions with “timeliness” as the business measure on each survey(Employee and Customer) multiplied by the total of the “General Agreement(s)” average score results in the final score for this business measure.  Example:  On a Employee Survey there are 2 questions and on Customer Survey there is 1 question = 3 timeliness questions.  The “general agreement” scores are 87% + 79% +68% = 234/3 questions = 78 as the final Timeliness score.  Please note some business measures are only found on one survey.

Service/Partnership

Same as above

Quality

Same as above

Strategic Value

Same as above

Technology

Same as above

Customer and Employee Satisfaction

This score is determined in two stages:

Stage One: For each question on each survey type, a score is derived by multiplying the “General Agreement Percentage” by the percentage of respondents that rated the question as “Very Important” and divide by 100 (expressed as a score note a percentage).  Example: 77% General Agreement X 53% Very Important = 4081/100 = 41 is what we will call the “stage one satisfaction score”.

Stage Two: All the “stage one satisfaction scores” for each survey are added up and divided by the sum of all the “very important” scores.  Example:  Assume there are 10 questions and the sum of all the “stage one satisfaction scores are 469 and the sum of all the “very important” scores for the 10 questions is 576.  Then 469/576=81% Satisfaction Rating.