Evaluation Results Summary: National Traffic Incident Management (TIM) Responder Training Program
U.S. Department of Transportation
TIM Training Survey Types
Identifies whether the course materials and their delivery are effective, or if they need to be revised or enhanced.
Determines the effectiveness of the training in terms of how the student comprehends and retains the course information.
Provides an understanding of whether or not students implement the TIM procedures and strategies provided in the training.
Presents the operational benefits derived from the training programs.
In 2012, the Federal Highway Administration (FHWA) launched the National Traffic Incident Management (TIM) Responder Training Program. The TIM training program was developed by responders for responders and promotes consistent training of all responders to achieve the following three objectives.
The program includes a Train-the-Trainer (TtT) course that provides participants (i.e., trainers) the knowledge and materials necessary for them to conduct TIM training for TIM responders in their area, typically through use of the four-hour version of the training. Additionally, the National Highway Institute offers a free Web-Based Training (WBT) version of the four-hour TIM training course. Additional information about the training program is available at https://ops.fhwa.dot.gov/eto_tim_pse/about/tim.htm.
To assess participant learning and to capture the impacts of the training on operations, FHWA developed a suite of surveys that cover reaction, learning, behavior and results. The surveys were administered using either hard copies during training sessions or through an online tool.
Following is a summary of the survey results captured between January 2016 and August 2017.
Reaction Survey Results
Course evaluation surveys, for both TtT and responder training participants, were designed to solicit training participant feedback regarding training content and the instructor immediately following course participation.
During the 20 month assessment period, 381 TtT course evaluations and 290 responder training course evaluations were collected. Additionally, the TtT course evaluation was the only survey that was developed when the training program was originally launched in late 2012. The results of the nearly 3,700 TtT course evaluations collected between 2012 and 2017 are also included in the summary provided below.
All training participants were asked to rate if they agreed/disagreed with the following statement:
This course helped me further appreciate the responder and motorist safety element of TIM and how quick clearance also promotes safety.
Learning Survey Results
Prior to attending a TIM training session, participants were asked to complete the appropriate pre-test to assess their existing knowledge. Then, immediately following a training session, participants were asked to complete the appropriate post-test to assess their TIM knowledge after receiving the training. For the responder training course, there was an 81.5 percent improvement in scores pre-training to post-training, indicating the course effectively increased participants' knowledge of TIM.
Behavior Survey Results
Approximately three months after attending a training session, participants and their supervisors were asked to take a survey that assessed the impact the training has had on participant behavior. A total of 434 individuals, 374 participants and 59 participant supervisors, from 28 States completed this survey.
In addition to identifying changes in behavior, the survey results also highlighted areas where TIM practices were already in place prior to participation in a training session. Specifically, 62.8 percent of participants and 54.2 percent of supervisors indicated that use of high-visibility safety apparel was already implemented prior to receiving the training.
The table below summarizes responses for several key metrics in the survey.
Results Survey Results
Six months to a year after personnel attend a TIM training session, agency administrators, senior management and/or the State or regional points of contact, were asked to complete a results survey. The TIM training results survey assessed the impact on and operational benefits realized by an agency/ organization that has sent their personnel through the TIM training. Agencies and organizations from 21 States returned a total of 55 results surveys.
An additional measure of the success of the TIM training course in affecting change is the integration of the TIM policies and procedures taught as part of the curriculum into standard TIM practice. Respondents were asked to rate the degree to which they agree or disagree that the law or concept listed had been integrated into the written policies/procedures/directives followed by their agency/organization.
United States Department of Transportation - Federal Highway Administration