10-01-07 China ITS Final Course On IBEC Template

International Experience in Intelligent Transportation Systems
Mark Carter (SAIC USA) Steve Tarry (FaberMaunsell UK) Neil Perks (GHD China)
www.ibec-its.org
Primary Objectives of the Course

Primary Objectives
Expose participants to innovative approaches for solving transportation problems Aid participants in maximizing transportation investments
www.ibec-its.org
Course Sub-Objectives
Sub-Objectives
To provide an overview of ITS activities in Europe in North America To demonstrate the benefits of carefully measuring ITS improvements To provide guidance on how to measure ITS improvements Provide Case Studies of Recent ITS Activities
www.ibec-its.org
Agenda
Introduction Overview of ITS in North America and Europe How to maximize your ITS Investment Analysis Approaches and Techniques Evaluation Case Studies Additional Resources Wrap-up and Conclusions
www.ibec-its.org
Agenda
Time
9:00 9:15 9:15 10:30 10:30 10:45 10:45 11:15 11:15 12:00 12:00 13:00 13:00 14:00 14:00 14:40 14:40 15:20 15:20 15:35 15:35 16:15 16:15 16:45 16:45 17:00
5
Module
Introductions Overview of ITS in North America, Europe, and China Break Maximizing Your ITS Investment: Introduction Maximizing Your ITS Investment: A Process (Part I) Lunch Maximizing Your ITS Investment: A Process (Part II) Case Study #1: South Lake Tahoe Coordinated Transit System Case Study #2: Tunnel Safety Systems in Europe Break Case Study #3: Evaluation of the Integrated E-Screening / Electronic Toll Collection Deployment Additional Resources Wrap Up www.ibec-its.org
Feedback is Critical
Audience participation is strongly encouraged Please feel free to ask questions:
At the conclusion of each section At the end of the course During the presentations
www.ibec-its.org
Feedback is Critical
We want to learn through your questions and from your experiences Based upon your feedback we will update the course and make it available to the world
www.ibec-its.org
Questions?
www.ibec-its.org
Agenda
Introduction Overview of ITS in North America and Europe
Break
Maximizing Your ITS Investment: Introduction Maximizing Your ITS Investment: A Process (Part 1)
Lunch
Maximizing Your ITS Investment: A Process (Part 2) Evaluation Case Studies (Part 1)
Break
Evaluation Case Studies (Part 2) Additional Resources Wrap-up and Conclusions
www.ibec-its.org
Overview of ITS in North America, Europe, and China
10
www.ibec-its.org
Section Overview
This section will introduce:
Intelligent Transportation Systems (ITS) The benefits and cost of ITS The current status and future direction of ITS investments in:
USA Europe
11
www.ibec-its.org
Elements of An Effective Transportation System

Effective Transportation System
Construction Operations
12
Maintenance
www.ibec-its.org
Elements of Effective Operations

Effective Operations
Advanced sensor, computer, electronics, and communications technologies
Advanced Operations, Maintenance Strategies
13
Intelligent Transportation Systems (ITS)
www.ibec-its.org
ITS Classifications (USA)
14
www.ibec-its.org
Why Deploy ITS?

ITS are designed to optimize the performance of existing transportation infrastructure. Intended to preserve capacity and improve security, safety, and reliability.
Transportation Problem
Congestion at toll facilities Red light running crashes Work zone delays Delays from poorly timed signals Delays from roadway incidents
15
ITS Solution
Electronic toll collection Automated enforcement Improved traveler information Signal retiming programs Earlier detection
www.ibec-its.org
What are the Benefits of ITS?

Sample Findings - Freeway Management Systems:
Safety Mobility Productivity Efficiency Energy & Environment Customer Satisfaction Studies of traffic management centers using ramp meters show freeway management systems reduce accidents 1550%. Advanced Traffic Management Systems (ATMS) in the Astrodome area reduced street congestion delay by 46%. Variable speed limits with lane controls on the German Autobahn reduced injury accidents 20-29% saving approximately $4 million/year. After ramp meters were experimentally turned off in the Twin Cities of Minnesota, freeway volume declined 9% and peak period throughput decreased 14%.signs (DMSs) that In Denver, CO, dynamic message displayed real-time vehicle emission levels motivated most motoristsTwin Cities ramp meter shutdown test, support for a After the surveyed to consider repairs. complete shutdown fell from 21% to 14%.
16
www.ibec-its.org
What Are the Costs of ITS?

Example: Freeway Management System (T-REX) in Colorado, USA
Component Cycle Life (Years) 6 7 20 10 20 10 10 25 20 5 10 1 Total Capital Cost Annual Maintenance Cost Annual Operational Cost $400,000 $15,000 $21,960 $75,600 $13,800 $42,000 $7,000 $8,280 $37,800 $3,600 $18,000 $50,000 $150,000 $150,000 $250,000 $750,000 IMT Signals VMS CCTV Ramp Metering TMS HAR RWIS Fiber Optic Conduit/Cable Electronic Equip Software Design Costs Additional Personnel Costs State TOC City TOC County TOC Total System Costs 20 20 20 $7,800,000 $100,000 $100,000 $105,981,000 $377,800 $600,000 $2,205,000 $15,250,000 $8,400,000 $5,750,000 $2,100,000 $250,000 $1,250,000 $51,176,000 $5,000,000 $5,000,000 $1,000,000 $400,000 $100,000 $100,000 $100,000 $2,315,240
17
www.ibec-its.org
Do the Benefits Outweigh the Costs?

Often Yes However,
May be unexpected impacts
E.g. increase in crashes from electronic tolling
Difficult to procure and deploy effectively Human element is critical for success
18
www.ibec-its.org
Current Status of ITS in the US

Over 20 years of ITS research and development Many applications are now mature
ITS has become mainstreamed
Dedicated Federal funding for stand-alone ITS applications has been eliminated
Investment decisions are primarily made at the State, local and industry level
The Federal Government is

Coordinating these efforts Encouraging standardization Advancing new research and major initiatives
19
www.ibec-its.org
Success Stories (USA)

Significant deployment on metropolitan freeways
80% of toll facilities have electronic collection capabilities Nearly all major cities have freeway traffic management centers
Significant adoption of ITS by transit agencies

69% of transit agencies have automated vehicle technologies
Traveler information services are growing

Available in 24 of the 50 states
Accessible to 50% of the nations population in 2006
20
www.ibec-its.org
ITS Deployment Statistics (US)
21
www.ibec-its.org
Room for Improvement (USA)

Development of in-vehicle systems has been slow Relatively few inter-urban applications Limited surveillance on arterial streets Challenges with integration Impacts on congestion, safety, etc. remain small
22
www.ibec-its.org
Current Status of ITS in Europe

10-15 years in ITS research and development Some applications are now mature Each nation state has its own ITS applications The EU is encouraging standardisation, especially in the delivery of seamless services
23
www.ibec-its.org
Major Areas of ITS Investment in Europe

Urban on-road applications Inter-urban on-road applications Monitoring and enforcement applications Trip planning systems Driver information Freight and fleet management Automated vehicle applications Vulnerable road user applications
24
www.ibec-its.org
Deployment of ITS in Europe

EasyWay (2007-2013)
Over the last six years the European Commission (EC) has supported the roll-out of ITS on the Trans-European Road Network (TERN) through the Euro Regional Projects. EasyWay is the continuation of this European wide programme for ITS deployment now also including interfaces to the urban road networks. Within the EasyWay programme there are eight Euro Regional Projects.
25
www.ibec-its.org
EC Support
EasyWay (2007-2013)
The EC supports the programme of ITS Deployment with 300M (up to 20% of Costs). All European Road Authorities are able to seek support. EasyWay is not simply a source of funding from the EU but also an exchange of best practice between partners to develop seamless customer services.
26
www.ibec-its.org
Project Domains and Major Areas of ITS Investment in Europe
3. Traffic Management 4. Traveller Information and Control Services
9. Project Management
2. European Network of Traffic Centres
8. Horizontal Issues Evaluation
1. Road Monitoring Infrastructure
27
www.ibec-its.org
Focus of Evaluation Within Europe

European Evaluation Group
provides overview and best practice in the field of evaluation advises on how authorities might seek to optimise current and future project outputs and returns on investment fosters exchange of experience, results and lessons learnt and help analysis of transferability
28
www.ibec-its.org
Assessing What is Delivered

Evaluation will focus on
overall achievement of the EasyWay programme objectives through evaluation of standard indicators at a project level key performance measures related to traffic congestion, safety and environment identifying priority areas for further investment.
29
www.ibec-its.org
What This Means in Practice

Set up of a simple and feasible evaluation methodology with focus on standard indicators, primary and secondary, to asses impact of ITS Publicise guidance on how to document outcomes and analyse the transferability of solutions in different problem contexts (e.g. for new member states) Provide a global analysis of the impacts of EasyWay including deployment maps, list of best practices and remarkable results with clear examples Draft recommendations concerning further deployments and studies, regarding their potential impacts and contribution to achieving key policy objectives
30
www.ibec-its.org
Current Status of ITS in China Statistics

53 million cars on the road; Growth 11% per annum; 89,455 road fatalities in 2006; 15% of the annual world fatalities; Predicted to increase by 92% by 2020; 2.23 trillion yuan government investment over past 5 years.
31
www.ibec-its.org
Principal Issues Driving Transport Development

Improving road safety; Reducing congestion; Improving the environment; Improving public transport; Compliance with basic traffic laws; More informed education; Wide transport mix; Increased use of technology; Beijing 2008.
32
www.ibec-its.org
China Transport Solutions

Building new roads; Widening existing roads; Investing in new public transport;
Subways Bus Rapid Transit Light Rail New Buses
Reducing the number of vehicles on the road; Maximising vehicle capacity; Employing technological solutions.
33
www.ibec-its.org
Current Position of ITS in China

China is, in general, starting from a clean sheet; Major opportunities for the development of ITS; Interested in the most advanced technologies; Strong interest in ITS for solving safety and congestion issues; ITS often seen as a total problem solving tool; Strong financial investment in ITS; Strong bias toward technology and systems; ITS not often built into new infrastructure.
www.ibec-its.org
34
Issues Currently Retarding ITS Growth in China

ITS often seen as buying technology, not a solution; Considered to be a commodity item; Based around procurement and install, less interest in operational design or management; Cost rather than quality often the main factor in procurement; Little evaluation or accountability for the success of projects; Currently a lack of understanding of its true value, often by an uninformed client, is retarding growth in this sector; Excellent theoretical expertise, but little practical experience; Difficult for international expertise to penetrate an often closed home market; As a result many projects have been poorly implemented and have not delivered, what were often unrealistic expectations.
35
www.ibec-its.org
Future Direction for ITS: Federal (USA)

Federal Government has reduced funding for wide-spread, stand-alone deployment of ITS and is focusing on:
Nine areas of research
Cooperative Intersection Collision Avoidance Systems Electronic Freight Management Emergency Transportation Operations Integrated Corridor Management Systems Integrated Vehicle Based Safety Systems Mobility Services for All Americans Nationwide Surface Transportation Weather Observing and Forecasting System Clarus Next Generation 9-1-1 Vehicle Infrastructure Integration (VII)
A major initiative that leverages ITS

Congestion Initiative
36
www.ibec-its.org


37
www.ibec-its.org
Electronic Freight Manifest

Focused on truck-air-truck shipments between China and the US Testing the benefits of moving from paper based supply chains to electronic supply chains Prototype will:
Exchange information electronically in a standardized format; Provide an open architecture in which all shippers, across all modes can access needed information
38
www.ibec-its.org
Integrated Corridor Management

Freeway Management Arterial Management
Incident Management
39
www.ibec-its.org
Integrated Vehicle Based Safety Systems
40
www.ibec-its.org
Emergency Transportation Operations

Focused on use of technology to improve evacuations
Improved monitoring and coordination Support for reversed lanes
41
www.ibec-its.org


42
www.ibec-its.org
Large Federally led effort to reverse growing congestion Significant investment of resources
$100 Million to $1 Billion
Follows a coordinated blue-print / plan Leverages ITS with traditional and non-traditional transportation improvements
43
www.ibec-its.org
USA Congestion Initiative: Six Point Plan

Relieve urban congestion Unleash private sector investment resources Promote operational and technological improvements Establish a Corridors of the Future competition Target major freight bottlenecks and expand freight policy outreach Accelerate major aviation capacity projects and provide a future funding framework
Source: http://ops.fhwa.dot.gov/speeches/trafficsignalforum07/index.htm
44
www.ibec-its.org
USA Congestion Initiative: Point 1

Relieve Urban Congestion
Create urban partnerships Promote High Occupancy Vehicle (HOV) to High Occupancy / Toll (HOT) lane conversion Implement meaningful congestion management process Reduce impacts of bottlenecks
45
www.ibec-its.org
Urban Partnership Agreements

Implement broad congestion pricing
New or expanded bus rapid transit Expanded telecommuting / flexible work schedules Technology / operations strategies Selected five sites
Miami Minneapolis New York San Francisco Seattle
46
www.ibec-its.org
HOV to HOT Conversions

Champion High Occupancy Vehicle (HOV) to High Occupancy / Toll (HOT) Lane Conversions Assess opportunities for HOV to HOT conversions Provide technical support/training Identify role of technology in enforcement / pricing
47
www.ibec-its.org
Meaningful Congestion Management Process

Bring Operations into the Planning Process New Legislative requirement
48
www.ibec-its.org
Reduce Impacts of Bottlenecks

Initiate dialogue with States to pursue innovative solutions with near-term impacts Distribute Primer and lessons learned from Lead States Promote establishment of comprehensive bottleneck reduction programs
49
www.ibec-its.org
USA Congestion Initiative: Point 3

Promote Operational and Traveler Information Technological Work Zones Improvements Incident Management
Traffic Signal Timing
50
www.ibec-its.org
Real-Time Traveler Information

Nationwide 511 deployment Travel time on all urban DMS signs
51
www.ibec-its.org
Reduce Work Zone Delay

Implement work zone safety and mobility final rule
52
www.ibec-its.org
Reduce Incident Delay

Move it laws Quick clearance policies Full function service patrols Integrated transportation / law enforcement technology
53
www.ibec-its.org
Improve Traffic Signal Timing

Increase awareness/funding (Self Assessments and National Report Card) Champion regular signal retiming programs Release Adaptive Control Software (ACS) Lite
54
Springfield, MO
www.ibec-its.org
Future Direction for ITS: In Europe

Major investment in Galileo (the European Global satellite navigation system) Increasing emphasis placed on eSAFETY systems (collision avoidance etc)
Underpinned by Information and Communication Technologies (ICT)
Move is towards:
Intelligent ICT-based transportation (Co-operative vehicle highways, eCALL systems etc) Improved traffic and travel information Improved traffic management and road safety
ECs aims for the transport sector are:

More competitive alternatives (to the private vehicle) Integrated, greener, smarter, and safer transport systems 7th EC Framework to start in 2007 and last until 2013
55
www.ibec-its.org
What Should be Delivered

Europe-Wide Traveller Information Services
providing the European traveller with comprehensive real time traffic information
well-informed travel plans (pre-trip information) decisions during the journey (on-trip) focusing on real time, multi modal information
Europe-Wide Traffic Management Services

to detect incidents and emergencies ensuring safe and efficient use of the road network travellers and haulers also for cross-border transport.
56
www.ibec-its.org
What Should be Delivered

Freight and Logistics Services
optimise the capacity and efficiency of goods transport by providing safe and efficient access to intermodal terminals provide the European hauler with dedicated seamless services information on the TERN. effective management of hazardous or sensitive cargo will contribute to the overall goals and objectives of this activity.
Connected ICT Infrastructure

providing the end user services with data from systems that monitor the road situation in real time will also enable cross-border interoperability and continuity of services through harmonised data provided by connected systems.
57
www.ibec-its.org
The Way Forward for ITS in China

Often starting from a clean sheet, the opportunity exists for China to develop a strong ITS sustainable transport network; Learn, dont copy, experiences, of international implementations; Recognise the importance of design and operational management, otherwise what is planned is not often delivered; Develop full and well thought through implementations; evaluate the results and demonstrate that ITS can contribute toward and effective sustainable transport system if properly developed.
58
www.ibec-its.org
Questions?
59
www.ibec-its.org
Agenda
Break
Lunch
Break
60
www.ibec-its.org
Maximizing Your ITS Investment: Introduction
61
www.ibec-its.org
Section Overview
This section will answer a series of questions:
What is ITS evaluation? Who conducts ITS evaluation?
Role of EU and US Governments
Why evaluate ITS? How do we select the level of evaluation? What are the benefits of evaluation? What are the guiding principles
In Europe? In the US?
62
www.ibec-its.org
What is Evaluation?
The reasoned consideration of how well project goals and objectives are being achieved A feedback mechanism to ensure that project goals and objectives are met or exceeded
User Needs
Inform Decision Makers
Strategy
Feedback
Improve operations
Identify Project Objectives
Post-Implementation Evaluation
Pre-Implementation Evaluation
IMPLEMENTATION Monitoring
63
www.ibec-its.org
Is Evaluation a Report Card?

Evaluation is a process, not a report card
User Needs
Strategy
Feedback
Improve operations
64
www.ibec-its.org
Is it Acceptable to Report on Our Failures?

In ITS evaluation it is acceptable to report our successes and our failures
In fact it is critical that we report both Sometimes we learn more from what didnt work then we do from what did
65
www.ibec-its.org
Who Conducts ITS Evaluations?

In Europe and the US evaluations are conducted at the local level and Federal/EU level Most important consideration is independence
66
www.ibec-its.org
Why Do We Evaluate ITS?

Understand the impacts Quantify the benefits Help make future investment decisions Optimize existing system operation or design To improve the surface transportation system
67
www.ibec-its.org
How Do We Select the Level of Evaluation Required?

Level of evaluation required dependant on:
Maturity of technology Objectives of the evaluation Scale of the project Requirements of the funding agencies
68
www.ibec-its.org
Impact of the Maturity of Technology

Level of Evaluation Required
5.00 4.50 4.00
Level of Evaluation
3.50 3.00 2.50 2.00 1.50 1.00 0.50 0.00 Idea (New Concept) Plan Prototype Pilot off road Pilot on road Large scale Implementation Full scale implementation (proven demonstration (Proven benefits but (level of product, highly location benefit in predictable dependant) question) benefits)
Remaining evaluation to be undertaken on Application
Level of Application development
69
www.ibec-its.org
Continuum of Techniques for Evaluation
Idea
Plan
Prototype
Pilot test
Checklist Delphi Simulation & models Laboratory tests Field trials Impact monitoring
Largescale demos
Full-scale implementation
70
www.ibec-its.org
S1
How can ITS Evaluation be Useful: Process Improvement

In-Vehicle Navigation Deployment to Public Sector in Texas
Initial reaction was lukewarm Evaluation revealed ineffective training and maintenance When these improved, satisfaction increased substantially Para-transit drivers now demand vehicle with units
71
www.ibec-its.org
Slide 71 S1 Suggest adding exxamples as a "fly in" box of some type.

SAIC, 9/28/2003
How can ITS Evaluation be Useful: Programming Assistance

Metropolitan Model Deployment Evaluation
Aided traveler information resource allocation and programming decisions
Versus
72
www.ibec-its.org
S3
How can ITS Evaluation be Useful: Policy Analysis

Minnesota Ramp Metering
Public / Legislative questions of effectiveness Shut system down for evaluation
Freeway travel times increased 22% while meters were off This led to increased public support
Led to operational improvements
73
www.ibec-its.org
Slide 73 S3 Too much text/too many sub-bullets on slide. Seems to be a mixture of points and examples.
SAIC, 9/28/2003
Guiding Principles (Europe)- 1/3

Be clear about the reasons for undertaking evaluation Use and build on national approaches to ex ante appraisal and ex post evaluation Ensure national objectives are adopted within the evaluation framework Clearly state the objectives of the application
74
www.ibec-its.org

Clearly describe the environment in which the ITS application resides Clearly describe the measurement approach taken Determine the spatial and temporal perspective of the evaluation Use well-established indicators in measuring the impacts
75
www.ibec-its.org

Express the results in real and not just relative numbers Clearly indicate the level of statistical significance of the result, if appropriate Provide supporting information
76
www.ibec-its.org
Guiding Principles (USA)

Focus limited evaluation resources on data gaps Develop and follow a standardized approach Use sound scientific methods Allow visibility into the process Ensure consistency and transferability Carefully set the context Report on impacts Positive and Negative
Evaluation is a Process
77
www.ibec-its.org
Questions?
78
www.ibec-its.org
Agenda
Break
Lunch
Break
79
www.ibec-its.org
Maximizing Your ITS Investment: A Process
80
www.ibec-its.org
Section Overview
This section will introduce:
Present a common approach to evaluation Walk through each major step
81
www.ibec-its.org
The Evaluation Process in Europe and North America

1. Form an evaluation team 2. Develop an evaluation strategy 3. Develop an evaluation plan or plans 4. Develop test plans 5. Perform data collection and analysis 6. Reporting
82
www.ibec-its.org
Evaluation Process
Form Evaluation Team
Develop Strategy
Identify Project Objectives User Needs Strategy
Reporting
Feedback
Develop Evaluation & Test Plan

Refine Strategy
Improve operations
Data Collection & Analysis
Evaluation Process: Form Evaluation Team Develop

Strategy
Reporting
Feedback

Refine Strategy
Improve operations
Form the Evaluation Team

Need to decide who will be involved Questions of independence Access to data Need for an evaluation champion
85
www.ibec-its.org
Evaluation Process: Develop Strategy

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
Developing a Strategy
Evaluation Strategy Elements
What is the problem to be addressed? What are the project objectives? What are the evaluation objectives? What is the general evaluation approach?
Technical Analysis Impact Analysis User Analysis Socio-Economic Analysis Financial Analysis
87
www.ibec-its.org

Identify the objectives of the system implementers
In US Why was the project implemented? In Europe What are the goals of the effort?
What is the problem that is being addressed?

88
www.ibec-its.org
Consider User Needs

Must consider needs of the project and the evaluation from the perspective of:
Users: Traffic managers and operators, passengers, commercial drivers, emergency services, etc. Decision makers: Those responsible for production, introduction, and/or implementation of ITS applications:
Governmental agencies, road infrastructure owners, system operators
89
www.ibec-its.org
Consider Needs of Other Stakeholders and Funding Agencies

Other Stakeholders:
Residents along a highway Citizens of a town affected by poor air quality
Requirements and Preferences of Authorities (European Union, U.S., National, Regional)

Improving system interoperability Promoting the transport telematics industrial sector International, national or regional objectives of improving transport efficiency in a specific area
90
www.ibec-its.org
Develop Evaluation Objectives

Cross reference the following evaluation areas to Project Objectives and User Needs
Technical Assessment: system performance, reliability Impact Assessment: safety, environment, transport efficiency, user behavior, etc User Acceptance Assessment: users opinions, preferences, willingness to pay Socio-economic Evaluation: benefits and costs of system implementation Financial Assessment: capital/operating costs
91
www.ibec-its.org
Technical Assessment
Determines technical parameters of system performance
Delay time of system reaction Capacity of information link Hardware reliability
Determines how far a system meets technical requirements and expected objectives Does not address impacts of system beyond its boundaries
92
www.ibec-its.org
Impact Assessment
Measurement or estimation of effects of an application
Safety and Security Environmental conditions Transport efficiency/economy
. . . For the particular Target Groups likely to be affected
93
www.ibec-its.org
Socio-economic Assessment
Estimation of social gains and losses resulting from implementation in comparison with:
The existing situation, or Alternatives
Measures of:
Direct and indirect costs and benefits Non-monetary factors
Typical approaches:
Cost-benefit analysis Multi-criteria analysis (utility analysis)
94
www.ibec-its.org
User Acceptance Assessment

Estimates users attitudes toward and perception of application(s) investigated Users may be
Operators who implement and operate the system Passengers using the service Drivers who buy and use in-vehicle equipment for the service
Measures of interest to drivers:

Improvements in safety Travel time reliability Etc
95
www.ibec-its.org
Financial Assessment
Appropriate when application is intended to affect capital or operating costs of a transport service Only impacts internal to the application and its costs
Investment and operating costs Revenues
Important input: Evidence of users willingness to buy or use the service
96
www.ibec-its.org
May combine elements of all

E.g. Electronic Freight Manifest described earlier combines the following assessments
Technical data reliability Impact changes in supply chain efficiency Socio-economic benefits to the public User Acceptance continuation of program beyond pilot Financial Return on investment
97
www.ibec-its.org
Evaluation Process: Evaluation and Test Plans Develop

Strategy
Reporting
Feedback

Refine Strategy
Improve operations
Evaluation Process: Evaluation Plans Develop

Strategy
Reporting
Feedback

Refine Strategy
Improve operations
Elements of an Evaluation Plan

Evaluation Approach
Statement of hypotheses Refinement of testing approach
Evaluation Management plan Preliminary description of final reports and outreach plan
100
www.ibec-its.org
Statement of Hypotheses
What are evaluation hypotheses?
If-then statements about outcomes Should be measurable Should be testable
How do we develop them?

Translated from evaluation goals and expected impacts
101
www.ibec-its.org
Sample Hypothesis: Portlands Transit Tracker
Evaluation Objective
Assess bus riders perceptions of personal security
Hypothesis
Transit Tracker will increase bus riders perceptions of personal security
102
www.ibec-its.org
Refinement of Testing Approach

Measures of effectiveness (Metrics) Data Sources Potential Analysis Methods
103
www.ibec-its.org
What Makes a Good Metric?

Is accepted by and meaningful to the customer Tells how well goals and objectives are being met Is simple, understandable, logical, and repeatable Shows a trend Is unambiguously defined Allows for economical data collection Is timely Is sensitive
Source: Serving The American Public: Best Practices In Performance Measurement (http://govinfo.library.unt.edu/npr/library/papers/benchmrk/nprbook.html)
104
www.ibec-its.org
US National ITS Program Goals and Measures - 1/2

Goal Area
Safety
Measure
Reduction in the overall rate of crashes Reduction in the rate of crashes resulting in fatalities Reduction in the rate of crashes resulting in injuries
Mobility
Reduction in travel time delay Reduction in travel time variability Improvement in customer satisfaction
105
www.ibec-its.org
US National ITS Program Goals and Measures - 2/2

Goal Area
Efficiency
Measure
Increase in freeway and arterial throughput Cost savings Decrease in vehicle emissions Decrease in vehicle energy consumption
Productivity Energy and the Environment
Customer Satisfaction is the Bottom Line

106
www.ibec-its.org
Surrogate Measures
Its not always possible to obtain objective measures Often we need to use surrogates
Safety
Have used speed variability as an indicator of crash risk
Environment
Have derived environmental impacts from speed profiles
Security
Requires creative surrogates such as reporting frequency, response time, etc.
107
www.ibec-its.org
Case Study: Variable Speed Limits - Denmark
Construction Site
108
www.ibec-its.org
Testing Approach Denmark Variable Speed Limit Example

Objective Hypothesis Measure of Effectiveness
Posted speeds Actual speeds Driver perception
Data Source
Method of Analysis
Descriptive Statistics Telephone survey
Determine if drivers comply with posted speeds Determine impacts on speed variability
Drivers will comply with posted speeds
Logs Loop data Questionnaire
System will lead to more homogeneous speeds System will lead to more homogenous flows The system will be easy to set up and work reliably
Speed variability
Loop data
Analysis of Variance
Determine impact on traffic flow
Flow variability
Loop Data
Investigate maintenance requirements
Implementer perceptions Mean Time Between Failure
Interview results System logs
Descriptive statistics
109
www.ibec-its.org
Testing Approach Denmark Variable Speed Limit Example

Objective Hypothesis Measure of Effectiveness
Posted speeds Actual speeds Driver perception
Data Source
Method of Analysis
Descriptive Statistics Telephone survey
Determine if drivers comply with posted speeds Determine impacts on speed variability
Drivers will comply with posted speeds
Logs Loop data Questionnaire
System will lead to more homogeneous speeds System will lead to more homogenous flows The system will be easy to set up and work reliably
Speed variability
Loop data
Determine impact on traffic flow
Flow variability
Loop Data
Investigate maintenance requirements
Implementer perceptions Mean Time Between Failure
Interview results System logs
Descriptive statistics
110
www.ibec-its.org
Evaluation Management Plan

iFlorida Security Evaluation Evaluation Strategy Evaluation Plan Evaluation Management Evaluation Test Plan Data Collection Analysis Reporting of Findings Monitor Progress Integrate with Other Evaluations Finalize Objectives Conduct Interviews Synthesize Interviews Produce C&C Report
Finalize Hypotheses
Collect Log Data Conduct Vulnerability Assessments Observe Mock Exercises
Analyze Log Data Review Vulnerability Assessments Review Mock Exercises
Produce VA Report Produce Evacuation Report
Identify Data Requirements
Design Data Collection
Design Data Analysis Specify Report Content Estimate Resources Required
Schedule Work Breakdown Structure / Resource Allocation Describe Coordination with project staff
111
Data Management Plan
www.ibec-its.org
Description of Final Reports and Outreach Plan

Signal Priority Everyone Wins!
Thats the Game!
Protecting the Transportation System
Signal Priority Brochure

River City SEMS
Special Events Case Study
Speed (mph)
Confidential Vulnerability Assessment
Travel Time Variability

60 50
43
42
53
52
44
40 30 20 10 0
6-7 am
42
41
43
I-5 7-8 am Barbur 8-9 am 9-10 am
Day
Technical Report
112
ITS America Presentation
www.ibec-its.org
Evaluation Process: Test Plan

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
Example: Freight Reservation System (FIRST)
114
www.ibec-its.org
Develop Evaluation Test Plans

The Detailed Methodology for the evaluation One or more test plans for each test Lays out how test will be conducted Identifies
Staff Equipment and supplies Procedures Timing of evaluation tests
115
www.ibec-its.org
Sample Elements of the FIRST Test Plan

1A surveyor to be located near the security booth, but may have to move dependent on the end of the queue. The responsibility of this surveyor is to mark down a container number and the time it passed then radio that information to surveyor #2. 2A surveyor to be located near the gatehouse. This surveyor will be responsible for measuring and recording the time the identified unit arrived at the gate for processing. Additionally this surveyor will monitor a random sampling of vehicles in process at the gate.
Gatehouse
2. Surveyor
1. Surveyor
Transaction Type
Empty In Empty Out Load In Load Out Chassis In Chassis Out
Total Number of Vehicles
Percent Trouble
Average Time in Terminal (Minutes)
116
www.ibec-its.org
Evaluation Process: Data Collection & Analysis

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
Data Collection and Analysis: Overview

Implementation of each test plan There are three general approaches:
Before and After Studies
Accident rates before and after ramp metering
With and Without Studies

Satisfaction of travelers with and without in-vehicle navigation devices
Performance Improvements
Human factors analysis of traveler information web site interface
118
www.ibec-its.org
Data Collection and Analysis: Pre-Implementation Activities

Collect before data identified in test plans
Objective - Baseline speed profiles Subjective Travelers satisfaction with existing transit service
Work with implementers to facilitate after data Provide early feedback

Share baseline data, past experiences
Consider Undertaking a Design Review

Evaluation of systems engineering processes
119
www.ibec-its.org
Experience in ITS Implementation Delays

Deployments of ITS are often delayed
This can impact evaluation
Schedule Resources Validity of results
Work with project partners for realistic assessments of schedule Consider with and without studies where possible Automate data collection as much as possible
120
www.ibec-its.org
Data Collection and Analysis: During Implementation Activities

Monitor deployment as specified in test plans Record the deployment experience
Deployment Costs Challenges Mitigation strategies Unique approaches
Lessons that will aid others in similar deployments
121
www.ibec-its.org
Data Collection and Analysis: Post Implementation Activities

Collect after data identified in test plans Obtaining data may be simplified
System itself may automatically provide data
Obtaining appropriate data may be difficult

Need to account for learning curve Need to control for external factors
Other improvements Seasonal Weather
122
www.ibec-its.org
Phoenix Cross-Jurisdictional Signal Coordination Example: Overview

Signals Coordinated within Scottsdale Signals Coordinated No coordination at within Tempe jurisdictional boundary
City of Scottsdale
123
City of Tempe
www.ibec-its.org
Phoenix Cross-Jurisdictional Signal Coordination Example: Overview

ITS Allows Coordination along entire length of Roadway
City of Scottsdale
124
City of Tempe
www.ibec-its.org
Data Collection Activities

Collected before data for 3 days before and after changes
Allowed 1 month between data collection period
Measured Impact Using

Floating Cars
GPS Equipped Vehicles 301 trips through corridor
Controlled for External Factors with

Tube Counts Turning Movement Counts
125
www.ibec-its.org
Phoenix Cross-Jurisdictional Signal Coordination Example: Results

Numerous statistically significant improvements
1% reduction in stops 2% reduction in fuel consumption 7% reduction in crash risk 6% increase in speeds
as detailed below:
Northbound
Southbound Average
AM Peak Midday PM Peak AM Peak Midday PM Peak Speed BEFORE (km/h) Speed AFTER (km/h) (% change) 45.4 43.5 38.5 47.5 46.9 45.4 (-3.2%) 29.5 38.7 (+31%)
41.9 44.5 (+6.2%)
47.9 46.0 41.0 48.2 (+5.5%) (+5.7%) (+6.5%) (+1.5%)
www.ibec-its.org
Phoenix Cross-Jurisdictional Signal Coordination Example: Results from Micro-Simulation

Also used micro-simulation to study potential impacts of alternative signal timing plans
Could lead to reduce delay
Stops were reduced 1% in deployed conditions Could be reduced 10% under further signal improvements
Could lead to further energy benefits

Fuel consumption was reduced 2% in deployed conditions Could be reduced 6% under further signal improvements
127
www.ibec-its.org
Evaluation Process: Reporting

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
Reporting and Feedback

Evaluation
Is not a report card It is a process (continuous improvement) It provides a perspective for others
It is vital to explain the context in which the application resides and the context in which the evaluation was undertaken Evaluation can help shape international national agendas Need to report successes and failures
129
www.ibec-its.org
Reporting and Feedback Activities

Target reporting to maximise benefit
Presentation to the board Internal memos Cost reporting Formal Reports
Provide feedback to implementation

Identify weak areas to be improved Identify strong areas to build on for both existing and new implementations
130
www.ibec-its.org
Reporting Results: In the U.S.

Projects receiving certain ITS federal funds are required to transmit results of evaluation
Field Operational Tests (FOTs) ITS earmark projects Reports to be submitted to ITS benefits and costs database
http://www.benefitcost.its.dot.gov
Transmittal of results only requested of locallyfunded projects
131
www.ibec-its.org
Reporting Results: In Europe

Dependant on National Rules For EU (part) funded projects the evaluation requirement varies:
TEMPO Trans-European Network ITS projects
Must carry out evaluations, must report in common format for EU
6th Framework Research Programme

Results must be disseminated
132
www.ibec-its.org
Reporting Activities
Audience
General Public
Needs
Awareness information
Report Style
Sunday Supplement info, video presentations PowerPoint Presentation
Board of Directors
High-level, summary info
Mid-Level Managers Technical Staff
General information, limited technical detail Detailed information and implementation support
Briefing book summary document, 8 12 pages Implementation Guides; 60 100 pages
133
www.ibec-its.org
EU Tempo Framework 1/2

Summary of Methods and Results Aimed at those undertaking evaluations Seeks to enable accurate comparison between projects Contents list
Description of the problem Description of the ITS project Evaluation Methodology Impacts of the Project Transferability of the Results Technical Annex
Length 20-30 pages
134
www.ibec-its.org
EU Tempo Framework 2/2

Designed so that results can be summarised into one to two page information notes and guidance for decision makers Designed so that those interested in the detail of the evaluation can request more information
135
www.ibec-its.org
Questions?
136
www.ibec-its.org
Agenda
Break
Lunch
Break
137
www.ibec-its.org
Case Study: South Lake Tahoe Coordinated Transit System
138
www.ibec-its.org
Background: South Lake Tahoe

Rural resort community at the California-Nevada state border at the south end of Lake Tahoe Popular for casinos, beaches, skiing Peak tourist seasons in summer and winter
139
www.ibec-its.org
Background: Transit in Tahoe

Area spans two counties in two states - regional planning agency (TRPA) oversees entire area including transit Transit services in South Lake Tahoe
Fixed Route
BlueGO Fixed Route for residents Nifty 50 Trolley for tourists
Demand-Responsive
BlueGO Door-to-Door for residents Casino Shuttle for tourists
140
www.ibec-its.org
Background: CTS Project

Consolidation of casino shuttles Consolidation of operation of all 4 transit services Addition of ITS technologies
3 Separate Casino Shuttles for 3 Main Casinos
15 vehicles
Harveys
Harrahs
Caesars
1 Common Casino Shuttle for all Casinos and Hotels
5 vehicles
141
www.ibec-its.org
Background: ITS Technologies for Transit Operator

Automated Vehicle Location (AVL)
Dispatchers and supervisors track vehicles through GPS and monitor on-time performance
Computer-Aided Dispatch (CAD)

Trips reserved through automated trip reservation system automatically scheduled and assigned to drivers
Mobile Data Terminals (MDTs)

Messages transmitted between drivers and dispatch
142
www.ibec-its.org
Background: ITS Technologies for Transit Customers

Automated Trip Reservation System for the Casino Shuttle
Trip reservation kiosks at all 5 casinos and at 25 hotels Dedicated phones with direct connection to dispatchers (over 50 dedicated phones)
143
www.ibec-its.org
Project Goals
Provide same level of service at a lower cost Improve operational efficiency
Technology (e.g., previously had paper manifests for drivers) Less shuttles in operation at a given time One service provider for all 4 transit services
Improve customer satisfaction to grow transit ridership and get people out of cars (particularly tourists)
144
www.ibec-its.org

Led by independent evaluation contractor (SAIC)
Included experts in
Transit operations Data collection and analysis Survey design and survey analysis
Included representatives from

Deployment team (CTS Board, TRPA,etc) Federal Department of Transportation

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
145
Monitoring
www.ibec-its.org
Develop Evaluation Strategy

Perform a limited quantitative systems impact study
Limited because we found that it is difficult to get data when working with casinos most of their numbers are considered proprietary
Perform a customer satisfaction study Interview stakeholders to document challenges, institutional issues, and lessons learned to share with other agencies

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
146
Monitoring
www.ibec-its.org
Develop Evaluation and Test Plans

Evaluation Objectives
Assess the impact of CTS on transit ridership
Hypotheses
CTS will result in increased transit ridership CTS will result in increased use of transit by visitors
Measures of Effectiveness
Ridership Ridership on visitor-oriented transit services Traffic volumes on segments of US 50 relative to visitor activity Number of passengers carried relative to service provided Transit operating costs relative to service provided Transit operator perceptions of CTS benefits Passenger perceptions of reliability, wait time, and travel time
Assess the impact of CTS on traffic congestion Assess the impact of CTS on transit system efficiency
ITS will result in reduced traffic Volumes With CTS, transit services will operate with greater efficiency than the existing transit system
Assess transit operator perceptions of the system and the technologies Assess the impact of CTS on customer satisfaction with transit services in South Lake Tahoe
CTS will benefit transit operators
With CTS, transit riders will be more satisfied with available transit services
Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
147
Monitoring
www.ibec-its.org
Data Collection and Analysis

Collected and analyzed before/after customer intercept surveys (distributed on-board casino shuttle)
Collected 694 surveys in total Baseline surveys - Aug 2002 Post-deployment surveys - Aug 2004 / Mar 2005
Gathered and analyzed before/after data

Traffic volume Transit ridership Room-nights sold Casino revenue
Performed interviews at key stages in the project and synthesized findings

Develop Strategy

Reporting
Feedback

Refine Strategy
Improve operations
148
www.ibec-its.org
Findings Technological Challenges

Automated phone trip reservation system
Too few phone lines, long queues, system hang-ups, callers stuck in endless loops Pulled the automated system and working out these bugs before turning it back on to customers
Automated kiosk trip reservation system

Initial roll-out suffered a lot of problems User interface too complicated for many users Worked with system integrator to simplify menu from 7-8 screens to only 2 screens and reactivated kiosks 6 months later

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
149
Monitoring
www.ibec-its.org
Findings Impact on Transit Ridership / Traffic Volumes

Traffic volumes decreased from 2003 to 2005
Winter peak traffic decreased by 10.2% Summer peak traffic decreased by 7.7%
7.5% increase in ridership on casino shuttle over this same time period Percent of tourists with access to a car while in Tahoe dropped from 91% to 80% from 2002 to 2004
Monthly CTS Casino Shuttle Ridership - October 2003 to September 2005
Monthly Passenger Trips 25,000 20,000 15,000 10,000 5,000 0 Oct-03 Nov-03 Dec-03 Jan-04 Feb-04 Mar-04 Apr-04 May-04 Jun-04 Jul-04 Aug-04 Sep-04 Oct-04 Nov-04 Dec-04 Jan-05 Feb-05 Mar-05 Apr-05 May-05 Jun-05 Jul-05 Aug-05 Sep-05

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
150
www.ibec-its.org
Findings Impact on Efficiency

5-8 buses provided on-demand casino shuttle service with wait times of 15-20 minutes during peak times Consolidated system provides the same level of service with only 3-4 buses Small measured efficiency gains in terms of
Cost per passenger-trip Passenger trips per operating hour Passenger trips per mile
Long-term expected benefits

Reduced operational costs Reduced fuel consumption Reduced wear on vehicles

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
151
www.ibec-its.org
Findings Impact on Transit Operators

Drivers
Benefit in receiving automated trip changes through their Mobile Data Terminals
Dispatchers
Benefit in having real-time vehicle location at their fingertips can tell customers where the buses are when they call Benefit in having kiosk trip requests automatically assigned by the CAD system

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
152
Monitoring
www.ibec-its.org
Findings Impact on Customer Satisfaction

Ease of booking a trip
78% of those booking by phone and 67% of those booking via a kiosk satisfied or very satisfied 90% of baseline survey respondents satisfied or very satisfied
Information received about expected wait time

72% receiving information by phone satisfied or very satisfied * 62% receiving information via a kiosk satisfied or very satisfied
Reported reasons for not using a phone or kiosk to book a trip

About 1/3 reported that they were not aware of it 20% of phone users and 16% of kiosk users reported that they were aware of it but that they did not want to use it

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
153
Monitoring
www.ibec-its.org
Findings Impact on Customer Satisfaction (Continued)

Number of stops to pick up and drop off other passengers
83% of baseline respondents and 80% of post-CTS respondents satisfied or very satisfied
Time spent waiting for a shuttle, cost of a trip, total travel time, and service overall
78-89% satisfied or very satisfied 86% reported that wait time was about what I expected or shorter than I expected
Comparison between consolidated service and independentlyoperated service

85-88% reported that the service was about the same as before, somewhat better than before, or significantly better than before

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
154
Monitoring
www.ibec-its.org
Findings Institutional Issues and Lessons Learned

Stakeholders felt that forming a Board was key to their success in managing interests of both public and private stakeholder
Strong leader who understands both sides also critical
Found that technology can be challenging when dealing with tourists

New potential customers every day who are not familiar with transit options or trip reservation technologies Important to know who your audience is and to do a lot of usertesting Critical to keep the user interface as simple as possible

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
155
Monitoring
www.ibec-its.org
Questions?
156
www.ibec-its.org
Case Study: EU Tunnel Safety
157
www.ibec-its.org
EU Tunnel Safety Systems

Inter-continental Channel Tunnel
Vehicles transported by train approximately 30km
Urban Tunnels
Cities often use motor tunnels to take traffic under rivers or estuaries generally less than 1km
158
www.ibec-its.org
Tunnel Types
Inter-continental Channel Tunnel
Vehicles transported by train approximately 30km
Interurban Network
Motor tunnels ranging from 2-3 Km, up to 25Km
Urban Tunnels
Cities often use motor tunnels to take traffic under rivers or estuaries generally lest than 1km
159
www.ibec-its.org
Alpine Tunnels
The alpine regions of Europe contain many motor tunnels - the longest being the Laerdal Tunnel at 24.5 km.
The Gottard Base Tunnel, currently under construction is 54km long and is being built as a rail tunnel with motor vehicles carried on trains
160
www.ibec-its.org
Why Safety Systems?

Mont Blanc Fire on 24 March 1999 emphasised the importance of safety in tunnels
41 fatalities Tunnel carried twice its intended capacity of vehicles Inaccessible to emergency services Unique problems, high temperatures, chimney effects, caustic smoke
161
www.ibec-its.org
What Was Learnt From This Incident?

Many safety systems turned off or inoperative Reliability is key No coordinated safety response No advice given to motorists Operational safety systems did allow a response when the fire was detected. Some Lives were saved
162
www.ibec-its.org
Pre-Emptive Measures Required

Need to prevent accidents, not just deal with them Tunnels now have lower accident rates than the rest of the road network Systems available to prevent accidents Now EU mandate requires all tunnels over 500m long to have an emergency broadcast system Over 2000 of these tunnels in Europe
163
www.ibec-its.org
Emergency Broadcast
Emergency broadcast overrides FM signal and provides in car information over all active radio receivers in cars Provides information on actions and routes to take Can be linked to emergency services
164
www.ibec-its.org
Intelligent Road Studs To help Guide Motorists

Light Emitting Diode Low running costs Choice of colours Can be controlled or linked into most ITS Systems
165
www.ibec-its.org
Gabilbier Tunnel
Hardwired studs along the sidewalls Single bore tunnel controlled by traffic lights
166
www.ibec-its.org
Gabilbier Tunnel (Continued)

Studs strobe along current direction of travel Helps eliminate optical illusions of distance
167
www.ibec-its.org
Paris Tunnel d' Antony

On the southern ring road of Paris Delineate the tunnel carriageway edges Strobe along the tunnel equivalent to the road speed limit of 50kph Can also be configured that in time of emergency the studs strobe towards the nearest exit or refuge within the tunnel
168
www.ibec-its.org
Tunnel Systems
Many different components go into making tunnels safe
Monitoring Surveillance Communications Management and maintenance
Many different systems working together
169
www.ibec-its.org
Tunnel Safety Systems:

Tunnel Safety Systems
Traffic Related Systems
Tunnel Plant CCTV Monitoring Communications Monitoring and Control
Management Systems
170
www.ibec-its.org
Integration with city Traffic control system (UTMC)
Lane control signs
Traffic Signals at portal
Lane Signalling on Message Signs Portals and approaches Barriers at portal
Traffic detection, Single and stopped vehicle
Fixed text message On portals Signs on approaches
171
www.ibec-its.org
CCTV Monitoring
CCTV Systems
Inside Tunnel
Tunnel approaches
Security
172
www.ibec-its.org
Communications
Communications
Smoke control panels Emergency Telephones Radio Rebroadcast

Driver instructions from message boards
Emergency Services
173
Mobile Phones
Radio Stations
www.ibec-its.org
Tunnel Plant
Tunnel Plant monitoring and control
Environmental Monitoring and control Fire Detection
Other Tunnel Subsystems
Lighting
Visibility
Ventilation
Pump/Sump monitoring
Emergency Panel monitoring
Power Monitoring And energy Management
Cross passage door monitoring
Supply health and Switching
Generator and UPS Status
174
www.ibec-its.org
Management Systems
Management Systems
Preventative Spares Management Asset Management maintenance management
Job control and Staff rostering
175
www.ibec-its.org
Evaluation of Tunnel Safety Systems

Difficult to test outside of use Used only in emergency or Drill Drill conditions differ from genuine use Hence incident required for evaluation Mont Blanc case study provides an insight into the potential benefits of investing in Tunnel Safety Systems
176
www.ibec-its.org
Mont Blanc Case Study

Work began on Mont Blanc Tunnel in 1953 Systems added and upgraded over the decades Two semi autonomous tunnel halves with different systems -allows comparisons between different setups
177
www.ibec-its.org
History of Events
17 truck fires between 1965 and 1990, mostly minor and dealt with quickly 11th January 1990 fire highlighted problems with existing methods and systems
First report of fire by driver from emergency telephone Emergency services approaching the vehicle had difficulty with the smoke levels in the tunnel No fires spotted at entrance to tunnel
178
www.ibec-its.org
History of Events
Some evaluation undertaken of previous incidents
This led to 18 refuges created in the tunnel Refuges saved many lives in the 1999 incident however level of casualties in the catastrophe in 1999 due in part to not fully evaluating previous incidents
179
www.ibec-its.org
Lessons Learnt From 1999 fire

Following on from the fire a report was produced, its recommendations were:
Have preliminary truck inspections before entry into the tunnel Revaluate the definition of a hazardous cargo, with respect to tunnels Put in place automatic incident detection systems Institute unified operating systems Have a single control centre with an overview of all systems Communications and electrical networks must be robust enough, either physically or through redundancy, to withstand a fire
180
www.ibec-its.org
Lessons Learnt (Continued)

Install systems to protect vehicle spacing Rebroadcast radio to allow command and control to issue instructions to motorists Ensure that there are clearly marked safe enclosures for tunnel users Put in place a first rescue service, run by trained fire-fighters and to have immediate response A safety plan must be put in place to institute actions and to communicate with public agencies. This should be tested through an annual drill
181
www.ibec-its.org
Things Done Well

Whilst tunnel fire was critical, many responses were appropriate The existing safety shelters saved many lives The CCTV cameras, although quickly made useless by the dense smoke did provide a useful early warning
182
www.ibec-its.org
Other Things of Note

Traffic lights in tunnel were not obeyed
However their use was appropriate and had they been complied with, lives would have been saved
The existing Hazardous Load procedures would have been effective in reducing casualties had the cargo been classified as such The response times of the emergency services were superb
Only hampered by a lack of communications and equipment
183
www.ibec-its.org
Legislative Response
Reclassification of high calorie goods as hazardous Tunnels longer than 1km to have a designated tunnel manager and safety supervisor Equipment be thoroughly inspected not less than once in every five years
184
www.ibec-its.org
Putting Things Into Practice A55 Tunnels, Wales

Major Incident Plan (MIP) developed for each tunnel detailing significant features and supporting operational facilities
Lighting, pumping, ventilation control, CCTV, tunnel sign control systems
MIPs include standard procedures from each emergency service + contact details (widely and freely available to all stakeholders)
185
www.ibec-its.org
Traffic Management Plans

Predefined outer cordon points and traffic management plans in place to control diversions Secure roadside stores with cones, signs and plans to allow basic setting of road closures and diversions Strategic diversions through national centre
186
www.ibec-its.org
Signing for Initial Evacuation Points
187
www.ibec-its.org
Forward Command Post

Focal point for on-site managers from Traffic Wales and Emergency services
188
www.ibec-its.org
Taking Control of the Situation

Equipment at Forward Command Post - taking control of the situation
189
www.ibec-its.org
Agenda
Break
Lunch
Break
190
www.ibec-its.org
Case Study: Integrated Electronic Screening / Electronic Toll Collection
191
www.ibec-its.org
Problem Statement
The I-95 Corridor is a critical transportation link in the USA
It is at or near capacity It faces challenges with Delays, Productivity, and the Environment
192
www.ibec-its.org
Proposed Solution
Leverage known benefits of
Electronic Toll Collection (ETC) Electronic Screen (E-Screen)
Target Commercial Vehicle Operations Encourage increased use:
Electronic Toll Collection E-Screening
193
www.ibec-its.org
Proposed Approach
Develop integrated ETC/E-Screening transponder tag
194
www.ibec-its.org
Why Evaluate?
Federal and State (I-95 Coalition) interests
State (I-95 Coalition) goals for evaluation
Is the pilot program worth additional investment? What will be the impact on delays? What will be the impact on the environment?
Federal goals for evaluation

Is this is a successful model that we should share with others? What would be the impact of this approach if fully undertaken?
Both Federal and State (I-95 Coalition) contributed funds

$400,000 USD
195
www.ibec-its.org

Lead by independent evaluation contractor (SAIC)
Included experts in
Commercial vehicle operations Data collection and analysis Environmental modeling
Included representatives from

State (I-95 Coalition) Federal Department of Transportation

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
196
Monitoring
www.ibec-its.org
Develop Strategy
Consistent with partners goals
Can an integrated tag be successfully developed? Will this tag be purchased and used? What will be the impact on
Delays? The environment?
Should the pilot be continued?

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
197
Monitoring
www.ibec-its.org
Develop Evaluation and Test Plans

Goal
Improve mobility at weigh stations and toll collection facilities.
Hypothesis
ETC and E-screening will improve the mobility of transponder-equipped commercial vehicles at weigh stations and toll collection facilities.
MOE
Travel time through facilities. Travel time variability through facilities. Number of commercial vehicles passing through weigh stations per day. Vehicle delays. Fuel consumption. Estimated emissions reductions.
Data Sources or Requirements

Field measurement of travel times and travel time variability through facilities. Field counts of commercial vehicles. Weigh station records. Field measurements of delays. Industry records on fuel consumption. Estimation of emissions reductions using typical idle rates.
Reduce fuel consumption and emissions at toll facilities.
With reduced delays and idle time, fuel consumption and emissions will be reduced.
Improve customer satisfaction.
The use of one transponder for both ETC and E-screening will help promote industry acceptance and use. Drivers will perceive a time savings association with use of the technology. Enforcement officials will benefit from the carriers use of the technology.
Industry acceptance/ endorsement of technology. Incentives offered by state agencies to encourage use of transponders. Drivers perceived time savings. Enforcement officials assessment of technology and perception of benefits.
Surveys/interviews/Focus groups with motor carriers, drivers, and enforcement officials.

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
198
www.ibec-its.org
Data Collection and Analysis

Four primary studies
Market Analysis Direct Observation Impact on Delays Productivity Analysis Modeled Environmental Analysis

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
199
Monitoring
www.ibec-its.org
Findings Market Analysis

Deployment was technically successful Adoption rates were low
Approximately 2500-3000 integrated tags distributed Limited E-Screening in the corridor
Limits incentive to adopt integrated tags
#
6
Hypothesis
(Key Hypothesis) The use of one transponder for both ETC and E-screening will promote industry acceptance and use of the transponder technology (Key Hypothesis) Drivers will perceive time savings and other benefits associated with the use of the transponder technology (Key Hypothesis) Motor carriers will perceive a time and cost savings benefit with the use of the transponder technology
Finding
Mixed
Mixed
8
Mixed
Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
200
Monitoring
www.ibec-its.org
Findings Impact on Delays Continued

Toll Facilities: George Washington Bridge Tappan Zee Bridge Albany Exit 23 Entry Albany Exit 23 Exit Albany Exit 24 Entry Albany Exit 24 Exit Perryville Weigh Stations:
Clearance Time Without ETC 25 46 58 79 56 109 81 Mainline Travel Times 145 143 103 190 255 391
Clearance Time With ETC 12 7 33 23 38 51 55 Travel Times Through Weigh Station 70 65 45 88 74 90
Average Time Savings
13 39 25 56 18 58 26
Average Time Savings
Avg Savings of 36 seconds per truck per toll facility
Perryville Hyattstown West Friendship New Market Union Greenwich
75 78 58 103 181 302
Avg Savings of 133 seconds per truck per weigh station
201
www.ibec-its.org
Findings Impact on Delay Continued

If I drive from Baltimore to New York City what kind of timesavings can I expect?
Average savings per toll facility: 36 seconds Estimated number of toll facilities: 7 Estimated average travel time without EZ-Pass: 3 hrs 15 min * Estimated average travel time with EZ-Pass: 3 hrs 11 min Savings of 4.2 minutes or 2% of trip
Note: Savings may be understated due to system benefit of ETC
* We do not have measurements from all toll facilities on the Baltimore / NYC route, we must
extrapolate from facilities outside of the route
202
www.ibec-its.org
Findings Impact on Delay Continued

For some of the facilities we can convert the numbers to annual point savings
Average Annual Truck Volume
4.2 million 0.125 million 2.2 million 1.4 million
Facility
George Washington Bridge Tappan Zee Bridge Albany Exit 24 Facilities Perryville
Estimated Maximum Annual Time Savings (100% Subscription)

15,166 hours 1354 hours 35,444 hours 10,111 hours
203
www.ibec-its.org
Findings Productivity Study

Facility:
Toll Facilities: George Washington Bridge Tappan Zee Bridge Albany Exit 23 Entry Albany Exit 23 Exit Albany Exit 24 Entry Albany Exit 24 Exit Perryville Weigh Stations: Perryville Hyattstown West Friendship New Market Union Greenwich 75 78 58 103 181 302 $1.48 $1.54 $1.14 $2.03 $3.56 $5.95 13 39 25 56 18 58 26 $0.26 $0.77 $0.49 $1.10 $0.35 $1.14 $0.51
E-Screening or ETC Average Time Savings
Value of Time Savings per Event

Estimated Maximum Time Savings Value (100% Subscription)
Facility
George Washington Bridge Tappan Zee Bridge Albany Exit 24 Facilities Perryville
$1.1 million $0.1 million $2.4 million $1.8 million
Value of time $71.05/hr: The 2004 Urban Mobility Report, David Schrank and Tim Lomax, Texas Transportation
Institute, The Texas A&M University System, September 2004. Accessed from: http://mobility.tamu.edu
204
www.ibec-its.org
Findings Environmental Impacts

Percent Reduction in Emissions (grams) During a Typical 24 hour Period
Pollutant Species
VOC % Reduction CO % Reduction NOX % Reduction 45857.46 79136.00
All Cash Transaction

10645.30
Observed CashE-ZPass Split

7366.6 30.8% 60563.5 23.5% 43175.0 5.8%
All E-ZPass Transactions

6011.0 43.5% 52884.6 33.2% 42065.9 8.3%
205
www.ibec-its.org
Impact of Evaluation
States (I-95) Coalition will continue pilot project
With limited direct support
Federal government considering further study to

Investigate potential impacts if system were deployed nationally Identify additional methods to support adoption of tags

Develop Strategy
Reporting
Feedback

Refine Strategy
Improve operations
IMPLEMENTATION
206
Monitoring
www.ibec-its.org
Questions?
207
www.ibec-its.org
Agenda
Break
Lunch
Break
208
www.ibec-its.org
Additional Resources
209
www.ibec-its.org
Support and Outreach: European Websites

UPDATED DETAILS FOR TEMPO WEBSITE TEMPO website http://tempo.austriatech.org
ADDITIONAL WEBSITES UK Toolkit Approach to Assessing Costs and Benefits of ITS http://ITSToolkit.co.uk English Highways Agency Library of Technology Pilots http://ITSRadar.co.uk
210
www.ibec-its.org
Support and Outreach: Conferences and Publications

Conferences: ITS America Annual Meeting, ITS World Congresses, TRB, European Transport Conference, etc. Resource material (books, publications, etc)
Past/current guidelines/model evaluation plans from US & Europe ITS Handbook 2000: Recommendations from the World Road Association (PIARC) Intelligent Transportation Systems Primer (ITE/USDoT/ITS America) Introduction to Transportation Systems, by Joseph Sussman Intelligent Transportation Systems Architectures, by Bob & Judy McQueen
211
www.ibec-its.org
Support and Outreach: Conferences and Publications

Update of PIARC ITS Handbook, by Dr John Miles International Benefits, Evaluation and Costs (IBEC) Working Group:
Important resource for participating in evaluation activities and contacting evaluation specialist world-wide IBEC has 320 members from 40 countries Web site: www.ibec-its.org Questions to IBECs 320 members can be sent via IBECits@yahoogroups.com To join IBEC, send an email to Steven.Turvey@Fabermaunsell.com
212
www.ibec-its.org
Support and Outreach: US DOT Resources

US ITS Program Evaluation
Support and outreach activities
US web sites for further information

Evaluation section of Joint Program Office web site
www.its.dot.gov/eval/index.htm
Web site has section entitled Evaluation Guidelines

www.its.dot.gov/itsweb/EVAL/eguide_resguide.htm
Products available now or planned for the future

www.its.dot.gov/eval/Documents/orderform.pdf
ITS Benefits and Costs Databases: impacts of ITS report and provision of unit costs of ITS components
www.benefitcost.its.dot.gov
213
www.ibec-its.org
ITS JPO Home Page
214
www.ibec-its.org
Technology Applications Overview
215
www.ibec-its.org
Taxonomy Sub-Elements
216
www.ibec-its.org
Application Overview
217
www.ibec-its.org
Benefits Information
218
www.ibec-its.org
Detailed Benefits Reports
219
www.ibec-its.org
Benefits Information From Around the World
220
www.ibec-its.org
Application Cost Information
221
www.ibec-its.org
Deployment Statistics
222
www.ibec-its.org
Lessons Learned
223
www.ibec-its.org
Questions?
224
www.ibec-its.org
Agenda
Break
Lunch
Break
225
www.ibec-its.org
Wrap Up and Conclusions
226
www.ibec-its.org
What is Evaluation?
Evaluation is the reasoned consideration of how well project goals and objectives are being achieved
To cause changes in the project so that it eventually meets or exceeds it goals and objectives An essential ingredient of good project management
227
www.ibec-its.org
Why do Evaluation?
Why undertake evaluations?
Essential element of good project management Enables the optimisation of applications Justifies public expenditure and represents good value Demonstrates the benefits (technical, financial and socio-economic) of individual applications Enables lessons to be learned for the future evaluation reports are resources supporting outreach to other planning/considering deployment
It adds value to the investments being made

228
www.ibec-its.org
How do you Evaluate?

Develop Strategy
User Needs Strategy
Reporting
Feedback

Refine Strategy
Improve operations
Process
1. Form an evaluation team 2. Develop an evaluation strategy 3. Develop an evaluation plan or plans 4. Develop test plans 5. Perform data collection and analysis 6. Reporting
230
www.ibec-its.org
How much Evaluation?

How much evaluation do you do?
Level of evaluation required dependent on:
Maturity of technology Objectives of the evaluation Scale of the project Requirements of the Government or funding agencies
231
www.ibec-its.org
Importance of Strategy
You need to develop a strategy Elements of the Evaluation Strategy
What is the problem to be addressed? What are the project objectives? What are the evaluation objectives? What is the general evaluation approach?
Technical Analysis Impact Analysis Institutional Analysis Economic Analysis
232
www.ibec-its.org
Who does it?

Who does evaluation?
The TEAM But, you need an evaluation champion
233
www.ibec-its.org
What to Evaluate?
Remember, there is NO right or wrong answer as to what to evaluate just guiding principles But consider:
Technical Analysis Impact Analysis Institutional Analysis Economic Analysis
234
www.ibec-its.org
When to Evaluate?
Before implementation
To justify expenditure and to measure baseline conditions Establish improvement goals
After implementation
To provide evidence of the impacts of the application Demonstrate trends across time Obtain feedback from users, operators, public administrations and funding agencies
The duration needed is dependant on the requirements for robustness of results / statistical significance
235
www.ibec-its.org
Where to Evaluate?
Need to consider the sphere of influence of the application concerned Technical assessment focuses on the application Impact assessment focuses on the area and users affected by the application
236
www.ibec-its.org
Conclusions - 1/2
We hope that this Training Course has enabled you to:
Recognise the importance of evaluation Identify the major elements of an evaluation Select appropriate performance measures for evaluation Select appropriate evaluation techniques and available tools
Evaluation is an on-going process and should be part of a project from the initial conceptual phase through development & design to on-site implementation
237
www.ibec-its.org
Conclusions - 2/2
Evaluation has been a driving force for the development of ITS over the years and will continue to be so But predicting the future in ITS is never easy
Some past predictions/forecasts have not panned out Need to reflect and respond to ever changing aspects of society and the environment
Where would we be now, if people had not evaluated ITS products and services?
238
www.ibec-its.org
Thank You
239
www.ibec-its.org
How to Contact Us
Mark R. Carter
mark.r.carter@saic.com
Jennifer Rephlo
jennifer.a.rephlo@saic.com
Steve Tarry
steve.tarry@fabermaunsell.com
240
www.ibec-its.org

10-01-07 China ITS Final Course On IBEC Template

Hochgeladen von

Dokumentinformationen

Originalbeschreibung:

Originaltitel

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

10-01-07 China ITS Final Course On IBEC Template

Hochgeladen von

Copyright:

Verfügbare Formate

International Experience in Intelligent Transportation Systems

Primary Objectives of the Course

Evaluation Case Studies (Part 2) Additional Resources Wrap-up and Conclusions

Overview of ITS in North America, Europe, and China

Elements of An Effective Transportation System

Elements of Effective Operations

Advanced sensor, computer, electronics, and communications technologies

Advanced Operations, Maintenance Strategies

Intelligent Transportation Systems (ITS)

ITS Classifications (USA)

Why Deploy ITS?

What are the Benefits of ITS?

What Are the Costs of ITS?

Do the Benefits Outweigh the Costs?

Current Status of ITS in the US

The Federal Government is

Success Stories (USA)

Significant adoption of ITS by transit agencies

Traveler information services are growing

ITS Deployment Statistics (US)

Room for Improvement (USA)

Current Status of ITS in Europe

Major Areas of ITS Investment in Europe

Deployment of ITS in Europe

Project Domains and Major Areas of ITS Investment in Europe

3. Traffic Management 4. Traveller Information and Control Services

2. European Network of Traffic Centres

8. Horizontal Issues Evaluation

1. Road Monitoring Infrastructure

Focus of Evaluation Within Europe

Assessing What is Delivered

What This Means in Practice

Current Status of ITS in China Statistics

Principal Issues Driving Transport Development

China Transport Solutions

Current Position of ITS in China

Issues Currently Retarding ITS Growth in China

Future Direction for ITS: Federal (USA)

A major initiative that leverages ITS

Future Direction for ITS: Federal (USA)

A major initiative that leverages ITS

Electronic Freight Manifest

Integrated Corridor Management

Integrated Vehicle Based Safety Systems

Emergency Transportation Operations

Future Direction for ITS: Federal (USA)

A major initiative that leverages ITS

USA Congestion Initiative: Six Point Plan

USA Congestion Initiative: Point 1

Urban Partnership Agreements

HOV to HOT Conversions

Meaningful Congestion Management Process

Reduce Impacts of Bottlenecks

USA Congestion Initiative: Point 3

Real-Time Traveler Information

Reduce Work Zone Delay

Reduce Incident Delay

Improve Traffic Signal Timing

Future Direction for ITS: In Europe

ECs aims for the transport sector are:

What Should be Delivered

Europe-Wide Traffic Management Services