SAN FRANCISCO URBAN PARTNERSHIP AGREEMENT
NATIONAL EVALUATION PLAN

U.S. Department of Transportation
Research and Innovative Technology Administration
Federal Highway Administration
Federal Transit Administration

FINAL
December 22, 2009
Publication No. FHWA-JPO-10-022

By
Battelle Memorial Institute
505 King Avenue
Columbus, OH 43201

Prepared for
United States Department of Transportation
Federal Highway Administration (FHWA)
Office of Operations
1200 New Jersey Avenue, S.E.
Washington, DC 20590

Contract No. DTFH61-06-D-00007/ORDER 07-T-08002/WO BA07-041

December 22, 2009

PDF Version 1.0 MB

---

QUALITY ASSURANCE STATEMENT

The U.S. Department of Transportation provides high-quality information to serve Government, industry, and the public in a manner that promotes public understanding. Standards and policies are used to ensure and maximize the quality, objectivity, utility, and integrity of its information. U.S. DOT periodically reviews quality issues and adjusts its programs and processes to ensure continuous quality improvement.

---

Technical Report Documentation Page

1. Report No FHWA-JPO-10-022	2. Government Accession No.		3. Recipient's Catalog No.
4. Title and Subtitle San Francisco Urban Partnership Agreement: National Evaluation Plan			5. Report Date December 22, 2009
			6. Performing Organization Code
7. Authors Carol Zimmerman and Gang Shao (Battelle); Kevin Balke (Texas Transportation Institute); Eric Schreffler (ESTC); Caroline Rodier and Susan Shaheen (University of California, Berkeley; and Lee Munnich (University of Minnesota Hubert H. Humphrey Institute).			8. Performing Organization Report No.
9. Performing Organization Name and Address Battelle 505 King Avenue Columbus, OH 43201			10. Work Unit No. (TRAIS)
			11. Contract or Grant No. DTFH61-06-D-00007/ORDER 07-T-08002/WO BA07-041
12. Sponsoring Agency Name and Address U.S. Department of Transportation Research and Innovative Technology Administration Federal Highway Administration Federal Transit Administration 1200 New Jersey Avenue, S.E. Washington, DC 20590			13. Type of Report and Period Covered
			14. Sponsoring Agency Code
15. Supplementary Notes
16. Abstract This report provides an analytic framework for evaluating the San Francisco Urban Partnership Agreement (UPA) under the United States Department of Transportation (U.S. DOT) UPA Program. The San Francisco UPA projects to be evaluated focus on those related to variable parking pricing. Those projects include variable pricing of on-street and off-street parking in the City of San Francisco, enhancements to 511 to include parking information, an integrated payment system for parking and transit, and expansion of telecommuting/TDM outreach activities to support the other projects. The San Francisco UPA national evaluation plan identifies major questions to be answered through the evaluation, the evaluation analyses to be used to address those questions, and the data needed for the analyses. It also outlines the test plans that will be used to collect and analyze the required data. The evaluation plan is based on the National Evaluation Framework (NEF) prepared for the U.S. DOT. Four objective questions that were posed by U.S. DOT serve as a starting point for the NEF and San Francisco evaluation plan. These questions are how much congestion was reduced; what contributed to the reduction and what were the associated impacts; what lessons were learned about non-technical factors for success; and what were the overall cost and benefit of the congestion reduction strategies. The four objective questions were translated into twelve evaluation analyses, which in turn consist of hypotheses and questions, measures of effectiveness (MOEs), and data required for the MOEs. This document presents the plan for evaluating the San Francisco UPA projects.
17. Key Word Urban Partnership Agreement, Congestion Reduction Demonstration, congestion pricing, variable pricing, parking, 511, congestion reduction, evaluation		18. Distribution Statement
19. Security Classif. (of this report)	20. Security Classif. (of this page)		21. No. of Pages 92	22. Price

---

ACKNOWLEDGEMENTS

Many individuals from the San Francisco partnership were helpful during the course of development of the evaluation plan. The following individuals were particularly instrumental in providing information and insight and their contribution is both recognized and appreciated: Jay Primus of the San Francisco Metropolitan Transportation Authority; Chester Fung and Margaret Cortes of the San Francisco County Transportation Agency; and Pierce Gould and Cheryl Chi of the Metropolitan Transportation Commission.

---

TABLE OF CONTENTS

ACKNOWLEDGEMENTS

LIST OF ABBREVIATIONS

• Background
• The San Francisco UPA
• Evaluation Analyses and Test Plans
• Next Steps

• 1.1 U.S. DOT Program to Reduce Congestion
  • 1.1.1 Urban Partnership Agreement/Congestion Reduction Demonstration Program Overview
• 1.2 Organization of this Report

• 2.1 The Transportation System and Congestion in San Francisco
• 2.2 The San Francisco UPA Local Partners
• 2.3 San Francisco UPA Projects and Deployment Schedules

• 3.1 National Evaluation Organizational Structure
• 3.2 National Evaluation Process and Framework
• 3.3 U.S. DOT Four Questions and Mapping to 12 Analyses
• 3.4 San Francisco UPA National Evaluation Process

• 4.1 Evaluation Analyses
  • 4.1.1 Congestion Analysis
  • 4.1.2 Pricing Analysis
  • 4.1.3 Telecommuting/TDM Analysis
  • 4.1.4 Technology Analysis
  • 4.1.5 Equity Analysis
  • 4.1.6 Environmental Analysis
  • 4.1.7 Goods Movement Analysis
  • 4.1.8 Business Impacts Analysis
  • 4.1.9 Non-Technical Success Factors Analysis
  • 4.1.10 Cost Benefit Analysis
• 4.2 Preliminary Evaluation Test Plans
  • 4.2.1 Traffic System Data Test Plan
  • 4.2.2 Parking Data Test Plan
  • 4.2.3 Transit System Data Test Plan
  • 4.2.4 Telecommuting/TDM Data Test Plan
  • 4.2.5 Traveler Information System Data Test Plan
  • 4.2.6 Surveys and Interviews Test Plan
  • 4.2.7 Environmental Data Test Plan
  • 4.2.8 Content Analysis Test Plan
  • 4.2.9 Cost Benefit Analysis Test Plan
  • 4.2.10 Exogenous Factors Test Plan

5.0 NEXT STEPS

List of Tables

• Table ES-1. Relationship among Test Plans and Evaluation Analyses
• Table ES-2. Illustrative Excerpt from the Pricing Analysis Approach
• Table 1-1. Summary of UPA/CRD Strategies by Site
• Table 2-1. San Francisco UPA Projects and Funding
• Table 2-2. UPA Project Schedules
• Table 3-1. U.S. DOT National Evaluation "Objective Questions"
• Table 3-2. U.S. DOT Objective Questions vs. Evaluation Analyses
• Table 4-1. Congestion Analysis Approach
• Table 4-2. Pricing Analysis Approach
• Table 4-3. Telecommuting/TDM Analysis Approach
• Table 4-4. Technology Analysis Approach: Parking Sensors
• Table 4-5. Technology Analysis Approach: Parking Information Dissemination Technologies
• Table 4-6. Technology Analysis Approach: Electronic Payment System Technology
• Table 4-7. Equity Analysis Approach
• Table 4-8. Environmental Analysis Approach
• Table 4-9. Goods Movement Analysis Approach
• Table 4-10. Business Impacts Analysis Approach
• Table 4-11. Non-Technical Success Factors Analysis Approach
• Table 4-12. Cost Benefit Analysis Approach
• Table 4-13. Relationships Among Test Plans and Evaluation Analyses
• Table 4-14. Data for the Evaluation Analyses
• Table 4-15. System Data Collection Schedule
• Table 4-16. Parking Data Collection Schedule
• Table 4-17. Transit System Data Collection Schedule
• Table 4-18. Traveler Information System Data Collection Schedule
• Table 4-19. Recommended Survey and Interviews
• Table 4-20. Content Analysis Tracking Log
• Table 4-21. Schedule for Content Analysis Data Collection
• Table 4-22. Economic Category and Segment for Sales Tax Revenue
• Table 4-23. Exogenous Factors Data Collection Schedule

List of Figures

• Figure ES-1. SFpark Pilot and Control Zones
• Figure 1-1. Percentage of Vehicle Miles Traveled by Congestion Level in Very Large Urban Areas, 1982 versus 2007
• Figure 2-1. San Francisco UPA Team
• Figure 2-2. SFpark Pilot and Control Zones
• Figure 2-3. Dynamic Message Signs Will Guide Drivers to Available Parking in San Francisco
• Figure 2-4. Real-Time Traffic Congestion Information on www.511.org
• Figure 3-1. Battelle Team Organizational Structure
• Figure 3-2. The National Evaluation Framework in Relation to Other EvaluationActivities
• Figure 3-3. San Francisco UPA National Evaluation Team
• Figure 3-4. Francisco UPA National Evaluation Process
• Figure 4-1. San Francisco UPA Projects Deployment and Evaluation Data Collection Schedule

---

U.S. DEPARTMENT OF TRANSPORTATION
ITS JOINT PROGRAM OFFICE, HOIT
1200 NEW JERSEY AVENUE, SE
WASHINGTON, DC 20590
TOLL-FREE "HELP LINE" 1-866-367-7487
WWW.ITS.DOT.GOV

EDL # 14527

U.S. DEPARTMENT OF TRANSPORTATION
RESEARCH AND INNOVATIVE TECHNOLOGY ADMINISTRATION
PUB. NO. FHWA-JPO-10-022

---

You may need the Adobe Acrobat Reader to view the PDFs on this page.