Evaluation Methods and Techniques: Advanced Transportation and Congestion Management Technologies Deployment Program

Printable version [PDF 1.2 MB]
You may need the Adobe® Reader® to view the PDFs on this page.
Contact Information: Operations Feedback at OperationsFeedback@dot.gov

U.S. Department of Transportation
Federal Highway Administration
Office of Operations
1200 New Jersey Avenue, SE
Washington, DC 20590
ops.fhwa.dot.gov

December 2019
FHWA-HOP-19-053

---

Table of Contents

[ Foreword ] | [ Notice and Quality Assurance ] | [ Technical Report Documentation Page ] | [ List of Acronyms ]

• Chapter 1: Introduction
  • How to Use the Document
• Chapter 2: Evaluation Overview
  • Why Evaluate?
  • Assembling an Evaluation Team
  • Evaluation Planning Process
    • Set Evaluation Goals/Objectives
    • Develop Evaluation Questions
    • Identify Performance Measures
    • Develop Evaluation Design
    • Develop Data Management Procedures
    • Design Analysis Plan
  • Execute the Evaluation Plan
    • Acquire or Collect Data
    • Analyze Data and Draw Conclusions
    • Develop Annual Report(s)
    • Evaluation References
• Chapter 3: Performance Measures
  • Improve Safety
  • Improve Mobility/Reduce Congestion
  • Reduce Environmental Impacts
  • Optimize Multimodal Performance
  • Improve Access to Transportation Options
  • Effectiveness Of Providing Real-Time Integrated Transportation Information To The Public To Make Informed Travel Decisions
  • Cost Savings And Improved Return On Investment
  • Other Benefits/Lessons Learned
    • Performance Measure References
• Chapter 4: Methods and Analytic Techniques
  • Benefit-Cost Analysis
    • Goals of a High-Quality Benefit-Cost Analysis
    • Defining Benefits
    • Defining Costs
    • General Principles
    • Issues Specific to ATCMTD Project BCAs
  • Survey and Interview Methods
    • Target Population
    • Survey Design
    • Survey Administration
    • Sampling
    • Sample Size
    • Recruitment
    • Questionnaire Design
    • Response Rates
    • Privacy and Personally Identifiable Information (PII)
    • Institutional Review Board
    • Other Considerations
  • Emissions and Energy Estimates
    • On-Road Emissions Models and Tools
    • Methods of Evaluation
    • Methods and Analytic Techniques References
• Chapter 5: Technology-Specific Guidance
  • Adaptive Signal Control
    • Analysis Approaches
    • Data Collection
    • ASC References
  • Connected Vehicle
    • Evaluation Planning
    • Data Collection
    • CV References
  • Automated Vehicle
    • Rapidly Evolving Technologies
    • Human Factors and User Acceptance
    • Institutional Issues and Internal Capacity Building
    • Identifying Critical Stakeholders
    • Relationships with Private Sector Partners
    • Data Analysis and Management
    • AV References
• Appendix A: Evaluation Plan Checklist
• Appendix B: Annual Report Template
• Appendix C: Values for Benefit Cost Analysis

List of Tables

• Table 1. Evaluation Planning and Execution
• Table 2. ATCMTD FAST Act Goals and Objectives
• Table 3. Template with Example Evaluation Goals, Objectives and Evaluation Questions
• Table 4. Examples of Data Collection Methods
• Table 5. Example Methodology Template
• Table 6. Template for Data Collection Procedures
• Table 7. Performance Measures for Improving Safety
• Table 8. Performance Measures for Improve Mobility/Reduce Congestion
• Table 9. Additional Performance Measures Related to Signalized Control
• Table 10. Performance Measures for Reduced Environmental Impacts
• Table 11. Performance Measures for Improved Access to Transportation Options
• Table 12. Performance Measures for Effectiveness of Providing Real-Time Integrated Traveler Information
• Table 13. Performance Measures for Cost Savings and Return on Investment
• Table 14. Common Benefit Categories
• Table 15. Summary of Qualitative Methods
• Table 16. Survey Design Examples
• Table 17. Survey Administration Modes
• Table 18. Advantages and Disadvantages of Study Approaches
• Table 19. Data Collection Techniques
• Table 20: Example TEMPLATE for Evaluation Goals, Objectives, and Evaluation Questions
• Table 21: Example TEMPLATE for Evaluation Performance Measures and Methodology
• Table 22. Value of Reduced Fatalities and Injuries
• Table 23. Value of Travel Time Savings
• Table 24. Vehicle Operating Costs
• Table 25. Damage Costs for Pollutant Emissions
• Table 26. Social Cost of Carbon

List of Figures

• Figure 1. Graphic. Project Lifecycle
• Figure 2. Graphic. Project or Program Logic Model