Office of Operations
21st Century Operations Using 21st Century Technologies

Traffic Incident Management Training Post-Course Assessment Tool Final Evaluation Report

CHAPTER 5. LEVEL 3 RESPONDER AND SUPERVISOR TRAINING IMPLEMENTATION ASSESSMENTS

Approximately three months after attending a training session, participants and their supervisors are asked to take a survey that assesses the impact the training has had on participant behavior. From inception of the tool through August 15, 2017, a total of 434 individuals had completed Level 3 online surveys. Of those, 375 were Responder participants and 59 were Supervisors.

The responder discipline mix for Responder participants and Supervisors is shown in Figures 8 and 9 below.

Pie graph of the level 3 responder participant discipline mix.

Figure 8. Graph. Level 3 responder participant discipline mix.


Pie graph of the level 3 supervisor discipline mix.

Figure 9. Graph. Level 3 supervisor discipline mix.

The States where the Level 3 participants (both Responder and Supervisor) are based is shown in Figure 10 below.

Graph of the states where the responder and supervisor participants are located.

Figure 10. Graph. Level 3 participant base States.

Table 3 below contrasts the average responses of Responder participants and Supervisors for several key metrics in the Level 3 survey. The detailed survey responses for both Responder and Supervisors from inception of tool through August 15, 2017 are included in Appendix C.

Table 3. Average Level 3 key metrics.
Question Responder Supervisor
Since receiving the training, how would you describe your/your staff's awareness and efforts to minimize secondary crashes at traffic incident scenes? 85.3% more aware 72.6% more aware
Since receiving the training, how would you describe your/your staff's overall level of safety when working at traffic incident scenes? 78.0% more safe 77.0% more safe
Since receiving the training, how would you describe your/your staff's awareness and behavior when working around moving traffic and the "zero buffer"? 73.8% more aware 51.1% more aware
Since receiving the training, how would you describe your/your staff's safety practices when exiting your responder vehicle at traffic incidents? 71.1% more safe 55.4% more safe
Since receiving the training, how would you describe your safety awareness when working around vehicle fires? 61.2% more aware 45.2% more aware

Table 4 contrasts the average responses for participant respondents and supervisor respondents for areas where the training may have had less impact as the item in question was already fully implemented prior to training.

Table 4. Additional average Level 3 responder and supervisor metrics.
Question Responder Supervisor
Since receiving the training, how would you describe your/your staff's use of American National Standards Institute (ANSI)/ International Safety Equipment Association (ISEA) compliant high-visibility safety apparel, except for when Manual on Uniform Traffic Control Devices (MUTCD) -noted exceptions apply? 63.1%
no change/fully implemented prior
57.3%
no change/fully implemented prior
Since receiving the training, how would you describe your use of plain English in describing traffic incident scenes? 57.0%
no change/fully implemented prior
48.5%
no change/fully implemented prior
Since receiving the training, how would you describe your use of the Incident Command System (ICS) at traffic incidents? 56.8%
no change/fully implemented prior
40.2%
no change/fully implemented prior
Office of Operations