This report presents the test plan for developing, conducting, and analyzing surveys, interviews, and focus groups for the National Evaluation of the Minnesota Urban Partnership Agreement (UPA) under the United States Department of Transportation (U.S. DOT) UPA program. The information from these activities will be used in examining analysis areas contained in the Minnesota UPA National Evaluation Plan. This test plan is one of 11 test plans identified in the Minnesota UPA National Evaluation Plan.
The Minnesota projects are focused on reducing traffic congestion in the I-35W corridor and in downtown Minneapolis. ITS technologies underlie many of the Minnesota UPA projects, including those focused on tolling, real-time traffic and transit information, transit signal priority, and guidance technologies for shoulder-running buses. Figure 1-1 highlights the general location of the various Minnesota UPA projects, which are described below.
The Transit Advantage project became operational in December 2008. The majority of projects will be in operation by December 2009. The I-35W HOT lanes in the Crosstown Commons Section, the Cedar Avenue Lane Guidance System, and the Cedar Avenue Transit Station are scheduled for completion by October 2010.
The approach taken in this test plan is to build on the interviews and surveys already conducted by the Minnesota UPA partnership agencies. Historical information from these surveys and interviews helps establish the baseline conditions. To the extent possible, these surveys and interviews will be used in the post-deployment phase. Questions on the UPA projects will be added to some surveys and questions on topics related to the UPA projects will be monitored. To fully assess the impact of the UPA projects, additional surveys, interviews, and focus groups are needed, however. These additional surveys, interviews, and focus groups are presented in this test plan.
Table 1-2 presents all the major data elements to be obtained in each survey, interview, and focus group described in this test plan. The measures of effectiveness for each data element will be used are shown along with the evaluation of hypotheses/questions with which the MOEs are associated. The surveys, interviews, and focus group test plan supports all of the analyses areas, except the cost benefit analysis. Table 1-2 is organized by the population groups to be studied and then by the study instrument to be used. A total of 17 study instruments – surveys, interviews, and focus groups – are specified. These include both existing and new instruments needed for the national UPA evaluation. The proposed surveys, interviews and focus groups are based on current information from the local partners. Figure 1-2 presents the general timeline for conducting the various interviews, surveys, and focus groups. The ongoing surveys conducted by the local partner agencies are listed above the timeline, while the special surveys, interviews, and focus groups to be conducted for the UPA evaluation are listed below the timeline. As the test plan was being finalized, the Metropolitan Council indicated that a survey on MnPASS users/non-users will be added to the 2010 Travel Behavior Inventory. This information has been included in the test plan, but will be updated as more details are available from the Metropolitan Council. Also, Metro Transit has added new routes to the University of Minnesota. These routes will be added into the transit on-board ridership survey discussed in Section 5.0.
Preliminary questions are included in the test plan for the various surveys, interviews, and focus groups. These questionnaires build on previous surveys in the Twin Cities metropolitan area and use the common socio-economic questions included in the Metro Transit Customer Satisfaction surveys. It is realized the exact questions and approaches will be finalized based on further discussions with local partners, the market research firms, and the national evaluation team.
The remainder of this report is divided into 12 sections according to the study instruments.
Table 1-2. Surveys, Interviews, and Focus Groups Test Plan Data Elements and Use in Testing Hypotheses/Questions
Survey/Interview/ Focus Group |
Data Element |
Measures of Effectiveness |
Hypotheses/Questions* |
Baseline |
Post-Deployment |
Population – Telecommuters |
-
Humphrey Telecommuter Survey
|
1.1 Mode for typical work trip |
|
MNTele/TDM-1 |
X |
X |
-
Humphrey Telecommuter Survey
|
1.2 Vehicle used for work trip: make/year/ model |
- Used in emissions calculation
- Cost to employee per trip saved by telecommuting
|
MNEnv-1
MNEnv-3 |
X |
X |
-
Humphrey Telecommuter Survey
|
1.3 Departure times for trips to and from work |
-
Commuters who shift their travel times to off-peak hours
|
MNTele/TDM-1 |
X |
X |
-
Humphrey Telecommuter Survey
|
1.4 Length of work trip in miles and minutes |
-
VT and VMT reduction in the I-35W corridor in the peak
hours
- Cost to employee per trip saved by telecommuting
|
MNTele/TDM-1
MNEnv-1
MNEnv-3 |
X |
X |
-
Humphrey Telecommuter Survey
|
1.5 Days per week in alternative work option |
- VT and VMT reduction in the I-35W corridor in the peak
hours
- Cost to employee per trip saved by telecommuting
|
MNTele/TDM-1
MNEnv-1
MNEnv-3 |
X |
X |
-
Humphrey Telecommuter Survey
|
1.6 Perceptions of changes in congestion due to
telecommuting |
-
Perception of change in congestion due to telecommuting
|
MNTele/TDM-2 |
X |
X |
-
Humphrey Telecommuter Survey
|
1.7 Socio-demographic descriptors |
-
Used for analysis of other data elements
|
MNEquity-1
MNEquity-2 |
X |
X |
Population – Agency Stakeholders |
- Stakeholder Interviews
|
2.1 Agency Roles and Responsibilities |
- Observations from UPA participants
|
MNNonTech-1
MNNonTech-2
MNNonTech-3
MNNonTech-5 |
X |
X |
- Stakeholder Interviews
|
2.2 Institutional Arrangements – Keys to
Success |
- Observations from UPA participants
|
MNNonTech-1
MNNonTech-2
MNNonTech-3 |
X |
X |
- Stakeholder Interviews
|
2.3 Outreach Activities – Keys to Success |
- Observations from UPA participants
|
MNNonTech-1
MNNonTech-2
MNNonTech-3
MNNonTech-4
MNNonTech-6 |
X |
X |
- Stakeholder Interviews
|
2.4 Lessons Learned |
- Observations from UPA participants
|
MNNonTech-1
MNNonTech-2
MNNonTech-3
MNNonTech-4
MNNonTech-5
MNNonTech-6 |
X |
X |
I-35W Travelers |
- DMS Focus Groups
|
3.1 Commute behavior |
- General commute characteristics (mode, roads, time of day,
etc.)
|
Context for analysis of all hypotheses in this section |
|
|
-
DMS Focus Groups
|
3.2 Perceptions of congestion |
- Perceived changes in travel times, trip time reliability,
and duration and extent of congestion
|
MNCong-6
MNCong-7
MNCong-8
MNTransit-2
MNTransit-3 |
|
X |
-
DMS Focus Groups
|
3.3 Awareness and perception of DMS |
- Relative contribution of the DMS to congestion reduction
|
MNTech-3 |
|
X |
-
DMS Focus Groups
|
3.4 Change in travel behavior in response to DMS |
- Change in drivers switching to transit
|
MNTransit-1 |
|
X |
Transit |
- Metro Transit Customer Satisfaction Survey (CSS)
|
4.1 How make trip if did not ride bus? |
- Reduction in VMT
- Actual and percent change in drivers and carpoolers
willing to try transit.
|
MNENV-1
MNENV-3
MNTransit-2 |
X |
X |
- Metro Transit CSS
|
4.2 Frequency of bus use/days per week |
- Reduction in VMT
- Actual and percent change in drivers and carpoolers
willing to try transit.
|
MNENV-1
MNENV-3
MNTransit-2 |
X |
X |
- Metro Transit CSS
|
4.3?Perceptions of service quantity (number of
express trips, etc) and quality |
- Contribution of UPA strategies in contributing to mode
shift to transit.
|
MNTransit-4 |
X |
X |
- Metro Transit CSS
|
4.4 Number of years riding the bus |
- Actual and percent change in drivers and carpoolers
switching to transit.
|
MNTransit-2
MNTransit-3 |
X |
X |
- Metro Transit CSS
|
4.5 Change in cost |
- Change in travel costs for those switching from driving to
transit
|
MNCBA-1 |
|
X |
- Metro Transit CSS
|
4.5 Socio-economic demographic descriptors |
- Used for analysis of other data elements
|
MNEquity-1
MNEquity-2 |
X |
X |
- On-board Transit Rider Survey
|
5.1 Prior mode of transit riders |
- Actual and percent change in drivers and carpooler
switching to transit
|
MNTransit-2
MNTransit-3 |
|
X |
- On-board Transit Rider Survey
|
5.2 Reasons for using transit |
- Contribution of UPA strategies contributing to mode shift
to transit
|
MNTransit-4 |
|
X |
- On-board Transit Rider Survey
|
5.3 Length of commute in time and distance |
- Calculation of change in VMT
|
MNENV-1
MNENV-2 |
|
X |
- On-board Transit Rider Survey
|
5.4 Perception of UPA transit improvements (need
list, e.g. park and ride, travel time DMS, more frequent bus service) |
- Percentage of respondents citing a reduction in travel
time
- Percentage of respondents citing an improvement in travel
reliability
|
MNCong-9
MNCong-10 |
|
X |
- On-board Transit Rider Survey
|
5.5 Perception of Safety using HOT lanes, MARQ2
lanes, and guided bus |
- Changes in the perception of safety by travelers
|
MNSafety-2
MNSafety-3
MNSafety-4 |
|
X |
- On-board Transit Rider Survey
|
5.5 Change in cost |
- Change in travel costs for those switching from driving to
transit
|
MNCBA-1 |
|
X |
- On-board Transit Rider Survey
|
5.6 Socio-demographic descriptors |
- Used for analysis of other data elements
|
MNEquity-1
MNEquity-2 |
|
X |
Population – I-35W MnPASS Users |
- MnPASS Surveys
|
6.1 Prior Mode |
- Use of HOT and PDSL options
|
MNTolling-2 |
|
X |
- MnPASS Surveys
|
6.2 Frequency of use |
- Use of HOT and PDSL options
|
MNTolling-2 |
|
X |
- MnPASS Surveys
|
6.3 Reasons for use |
- Percentage of respondents citing a reduction in travel
time
- Percentage of respondents citing an improvement in travel
reliability
|
MNCong-6
MNCong-7 |
|
X |
- MnPASS Surveys
|
6.4 Perceptions of Safety using HOT lanes and
PDSL |
- Changes in the perception of safety by travelers
|
MNSafety-2 |
|
X |
- MnPASS Surveys
|
6.5?Travel costs |
- Travel costs for travelers switching from another mode to
HOT lanes
|
MNCBA-1 |
|
X |
- MnPASS Surveys
|
6.5 Socio-demographic descriptors |
- Used for analysis of other data elements
|
MNEquity-1
MNEquity-2 |
|
X |
- Travel Behavior Inventory – MnPASS Surveys
|
7.1 Prior Mode |
- Use of HOT and PDSL options
|
MNTolling-2 |
|
X |
- Travel Behavior Inventory – MnPASS Surveys
|
7.2 Frequency of use |
- Use of HOT and PDSL options
|
MNTolling-2 |
|
X |
- Travel Behavior Inventory – MnPASS Surveys
|
7.3 Reasons for use |
- Percentage of respondents citing a reduction in travel
time
- Percentage of respondents citing an improvement in travel
reliability
|
MNCong-6
MNCong-7 |
|
X |
- Travel Behavior Inventory – MnPASS Surveys
|
7.4 Perceptions of Safety using HOT lanes and
PDSL |
- Changes in the perception of safety by travelers
|
MNSafety-2 |
|
X |
- Travel Behavior Inventory – MnPASS Surveys
|
7.5 Travel costs |
- Travel costs for travelers switching from another mode to
HOT lanes
|
MNCBA-1 |
|
X |
- Travel Behavior Inventory – MnPASS Surveys
|
7.5 Socio-demographic descriptors |
- Used for analysis of other data elements
|
MNEquity-1
MNEquity-2 |
|
X |
Population – I-35W HOT Lane Carpoolers |
- Carpooler Survey
|
8.1 Prior Mode |
- Increase in average vehicle occupancy levels
|
MNTransit-3 |
|
X |
- Carpooler Survey
|
8.2 Frequency of use |
- Increase in average vehicle occupancy levels
- Reduction in VMT
|
MNTransit-4
MNCong-9
MNCong-10 |
|
X |
- Carpooler Survey
|
8.3 Reasons for Use |
- Contribution of strategies
- Perception of improvements
|
MNTransit-4
MNCong-9
MNCong-10 |
|
X |
- Carpooler Survey
|
8.4 Perceptions of safety using HOT lanes and PDSL |
- Changes in the perception of safety by travelers
|
MNSafety-2 |
|
X |
- Carpooler Survey
|
8.5 Socio-demographic descriptors |
- Used for analysis of other data elements
|
MNEquity-1
MNEquity-2 |
|
X |
- I-35W User Telephone Survey
|
9.1 Prior Mode |
- Increase in average vehicle occupancy levels
|
MNTransit-3 |
|
X |
- I-35W User Telephone Survey
|
9.2 Frequency of use |
- Increase in average vehicle occupancy levels
- Reduction in VMT
|
MNTransit-4
MNCong-9
MNCong-10 |
|
X |
- I-35W User Telephone Survey
|
9.3 Reasons for Use |
- Combination of strategies
- Perception of improvements
|
MNTransit-4
MNCong-9
MNCong-10 |
|
X |
- I-35W User Telephone Survey
|
9.4 Perceptions of safety using HOT lanes and
PDSL |
- Changes in the perception of safety by travelers
|
MNSafety-2 |
|
X |
- I-35W User Telephone Survey
|
9.5 Socio-demographic descriptors |
- Used for analysis of other data elements
|
MNEquity-1
MNEquity-2 |
|
X |
Population – I-35W General-Purpose Freeway Lane Users |
- I-35W South User Telephone Survey
|
10.1 Commute behavior |
- General commute characteristics (mode, roads, time of day,
etc.)
|
Context for analysis of all hypotheses in this section |
|
X |
- I-35W South User Telephone Survey
|
10.2 Perception of reduction in travel time |
- Perception of reduction in travel time
|
MNCong-6 |
|
X |
- I-35W South User Telephone Survey
|
10.2 Perception of improvement in trip-time reliability |
- Perception of improvement in trip-time reliability
|
MNCong-7 |
|
X |
- I-35W South User Telephone Survey
|
10.3 Awareness and perception of DMS |
- Relative contribution of the DMS to congestion reduction
|
MNTech-3 |
|
X |
- I-35W South User Telephone Survey
|
10.4 Perception of reduction in congestion |
- Perception of reduction in congestion
|
MNCong-8
MNCong-9 |
|
X |
- I-35W South User Telephone Survey
|
10.5 Perception of safety |
- Perception of safety by travelers
|
MNSafety-2 |
|
X |
- I-35W South User Telephone Survey
|
10.6 Socio-demographic descriptors |
- Used for analysis of other data elements
|
MNEquity-1
MNEquity-2 |
|
X |
Population – Minnesota State Patrol Officers |
- MN State Patrol Officer Interviews
|
11.1 Most common citation or violation issues |
- Change in violation rates
|
MNTolling-3 |
|
X |
- MN State Patrol Officer Interviews
|
11.2 Perception of changes in crashes and incidents
since HOT, ATM, DMS, and PDSL operational |
- Change in perception of safety
|
MNSafety-1
MNSafety-2 |
|
X |
- MN State Patrol Officer Interviews
|
11.3 Perception of change in congestion levels since HOT, PDSL, ATM, and DMS |
- Change in perception of traffic congestion
|
MNCong-3 |
|
X |
Population – FIRST Operators |
- FIRST Operator Interviews
|
12.1 Perception of changes in safety with active traffic management |
- Change in perception of safety
|
MnSafety-1
MnSafety-2 |
|
X |
- FIRST Operator Interviews
|
12.2 Perception of changes in crashes and incidents since HOT and PDSL operational |
- Change in perception of safety
|
MNSafety-1
MNSafety-2 |
|
X |
- FIRST Operator Interviews
|
12.3 Perception of change in congestion levels since HOT, PDSL, ATM, and DMS |
- Change in perception of traffic congestion
|
MNCong-3 |
|
X |
Population – Bus Operators |
- Bus Operator Interviews
|
13.1 Perception of changes in safety with active traffic management |
- Change in perception of safety
|
MNSafety-3 |
|
X |
- Bus Operator Interviews
|
13.2 Perception of changes in crashes and incidents since HOT and PDSL operational |
- Change in perception of safety
|
MNSafety-1
MNSafety-2
MNSafety-3
MNSafety-4 |
|
X |
- Bus Operator Interviews
|
13.3 Perception of change in congestion levels since HOT, PDSL, ATM, and DMS |
- Change in perception of traffic congestion
|
MnCong-3 |
|
X |
- Bus Operator Interviews
|
13.4 Perception of changes in safety with MARQ2 lanes |
- Change in perception of safety
|
MNSafety-3 |
|
X |
- Bus Operator Interviews
|
13.5 Perception of safety with bus lane guidance system |
- Perception of safety/safe operations
|
MNSafety-4 |
|
X |
- Bus Operator Interviews
|
13.6 Perception of safety with real-time transit and traffic DMS |
- Perceived changes in safety post-deployment
|
MNSafety-1 |
|
|
Population – Commercial Fleet Operators |
- Commercial Fleet Services/Operators Interviews
|
14.1 Use of I-35W |
- Percent of vehicles using I-35W
|
MNGoods-1 |
|
X |
- Commercial Fleet Services/Operators Interviews
|
14.2 Use of HOT lanes and PDSL |
- Percent of vehicles using tolled facilities
|
MNGoods-1 |
|
X |
- Commercial Fleet Services/Operators Interviews
|
14.3?Perceptions in changes in travel times and congestion due to UPA projects |
- Perceived advantages and disadvantages of UPA projects
- Percent change in travel times in general-purpose freeway
lanes
|
MNGoods-2 |
|
X |
- Commercial Fleet Services/Operators Interviews
|
14.4 Perceptions of changes in safety |
- Changes in the perception of safety by travelers
|
MNSafety-4 |
|
X |
- Commercial Fleet Services/Operators Interviews
|
14.5 Perception of change in congestion levels since HOT, PDSL, ATM, and DMS |
- Change in perception of traffic congestion
|
MNCong-3
MNGoods-3 |
|
X |
Population – Transportation-Sensitive Business Representatives |
- Transportation-Sensitive Business Representatives Interviews
|
15.1 Use of I-35W |
- Percent of vehicles using I-35W
|
MNGoods-1 |
|
X |
- Transportation-Sensitive Business Representatives Interviews
|
15.2 Frequency of Use of HOT lanes and PDSL |
- Percent of vehicles using tolled facilities
|
MNGoods-1 |
|
X |
- Transportation-Sensitive Business Representatives Interviews
|
15.3?Perceived changes in traffic congestion due to UPA projects |
- Perceived advantages and disadvantages of UPA projects
- Percent change in travel times in general-purpose freeway lanes
|
MNGoods-2
MNGoods-3 |
|
X |
- Transportation-Sensitive Business Representatives Interviews
|
15.4 Perceived time savings by using HOT lanes and PDSL |
- Percent change in travel times
|
MNGoods-2 |
|
X |
- Transportation-Sensitive Business Representatives Interviews
|
15.5 Impact by MARQ2 lanes |
- Change in the employers' perceptions about impacts on business operations
- Change in perceptions of transportation costs and benefits for businesses
|
MNBusiness-1
MNBusiness-2 |
|
X |
- Transportation-Sensitive Business Representatives Interviews
|
15.6 Perceptions of changes in safety |
- Changes in the perception of safety by travelers
|
MNSafety-4 |
|
X |
Population – Downtown Minneapolis Business Community |
- Downtown Minneapolis Business Community Interviews
|
16.1 Previous use of MARQ2 lanes |
- Change in the employers' perceptions about impacts on business operations
- Change in perceptions of transportation costs and benefits for businesses
|
MNBusiness-1
MNBusiness-2 |
|
X |
- Downtown Minneapolis Business Community Interviews
|
16.2 Perception of employees use of transit |
- Contribution of different elements to transit use
|
MnTransist-4 |
|
X |
- Downtown Minneapolis Business Community Interviews
|
16.3 Perceptions of impact of MARQ2 lanes |
- Change in employers' perception about impacts on business operation
- Change in perception of transportation costs and benefits
|
MNBusiness-1
MNBusiness-2 |
|
X |
- Downtown Minneapolis Business Community Interviews
|
16.4 Perception of safety of MARQ2 lanes |
- Change in perception of safety
|
MnSafety-3 |
|
X |
Population – Households in Region |
- MN/DOT Omnibus Survey (2008) and anticipated 2010 and 2011
|
17.1 Telecommute status |
- Baseline conditions and change over time
|
MnTele-1 |
X |
X |
- MN/DOT Omnibus Survey (2008) and anticipated 2010 and 2011
|
17.2 Number days a week telecommute |
- Calculation of change in VMT
|
MnENV-1
MnENV-3 |
X |
X |
- MN/DOT Omnibus Survey (2008) and anticipated 2010 and 2011
|
17.3 Socio-demographic descriptors |
- Used for analysis of other data elements
|
|
X |
X |
- Mn/DOT Perception Tracking Survey
|
18.1 Perception of DMS |
- Awareness and use of pre-UPA DMS
|
MnTech-3 |
X |
X |
- Mn/DOT Perception Tracking Survey
|
18.2 Perception of real-time transit and traffic DMS/change mode because of improvements |
- Contributions of strategies to mode change
|
MnTech-3 |
|
X |