Office of Operations
21st Century Operations Using 21st Century Technologies

Appendix B. Sample Test Procedure

This appendix contains a sample system level test procedure for Dynamic Message Signs.

Intelligent Transportation System System Test Procedure

Test 3 - Data Functional Element

Technical Test Procedure (TTP) - 3.2 Dynamic Message Signs (DMS)

1. Objective and Scope

This test procedure shall verify, by demonstration, that the ITS provides data for display by the DMS, monitors the DMS to detect failures, logs failures to the database, reports failures to the operator, takes the failed equipment off-line, and alerts maintenance personnel of failures.

This technical test procedure (TTP) shall be executed from a control position within the TMC constituting a single test case.

2. Requirements Traceability

This test shall partially verify the following system level requirements:

3.3.4.1.1(1) The ITS shall provide data such that DMS can disseminate information advising the traveler.

3.3.4.4.1(2) DMS shall provide periodic feedback as to operational status, diagnostic messages, and displayed message.

3.3.4.4(3) The system shall also monitor all of the field equipment under its control, and shall identify any component failures.

3.3.4.6(6) At a minimum, the following events shall be logged:

  • Traffic Management.
    • Incident detection and clearance.
    • Events scheduled.
    • Message and/or control and status changes for DMS, HAR, HAT, (future) TCS, (future) RMS, etc.
  • System Management.
    • System restart/shutdown.
    • Equipment on-line/off-line.
    • User log-in/log-out.
    • Data file archive, or retrieval.
    • System initialization.
  • Equipment Status Changes.
    • Power failure recovery.
    • Computer system failure.
    • Any system hardware failure or restoration.
    • Any field hardware failure or restoration.
    • Any system parameter modifications or re-configurations.

3.3.4.6.1(5) The database shall provide accurate and current information for dissemination to the motoring public through ATIS, the broadcast media, and other users.

3.10(1) The ITS shall have the ability to monitor the operation of those components which provide status, detect failures, log failures to the database, report failures to the operator, take the failed equipment offline, and alert maintenance personnel of failures.

3.10(2) Equipment within the ITS shall be monitored to detect any potential errors or reduced performance (provided the equipment will support bi-directional communication).

Completion of this procedure and TTPs- 1.3, 1.4, 3.3, 3.5 and 4.5 shall fully verify the requirements.

3. Prerequisites/Special Requirements

Level 3 verification testing shall have been successfully completed on the applicable portions of the DMS control functionality prior to this test.

4. Limitations

This test shall be limited to a demonstration of the DMS capability only.

5. Special Test Equipment

No special test equipment is required for this test.

6. Test Configuration

6.1 Equipment

The following equipment shall be configured to support this test.

At the TMC:

  • Application Server
  • Database Server
  • Operator Workstation

At the Highway Patrol Dispatch Center: Not applicable to this test.

In the Field:

  • Representative DMS shall be utilized to demonstrate the capability of displaying messages to the motorist.

6.2 Data Requirements

A list of approved DMS messages shall be pre-loaded into the TMC database prior to the start of this test. At least two distinct messages shall be available for each DMS involved in the test configuration. DMS test messages shall include single- and two-phase messages where appropriate for the DMS sign type being tested. Two-phase messages shall demonstrate specified blanking intervals between message phases and message updates. The message content shall identify the particular DMS and clearly indicate that it is a test message.

7. Resources

7.1 Facilities

Use of the following facility is required to perform this test procedure:

  • TMC.

7.2 Personnel

The following personnel are required to accomplish this test procedure (exclusive of support personnel required to configure the system to support the test):

  • Test Conductor.
  • Test Operator.
  • Test Witness.
  • Maintenance Technician (single DMS location).
  • Test Observer (DMS Locations).

8. Test Description and Procedure Steps

This test shall demonstrate the capability to select messages from a library of messages, download them to a DMS for display, monitor the DMS, log and report failures. This test will also demonstrate the system's ability to bring a DMS back on line after a failure has been detected.

A test observer will be used to view different messages displayed at selected DMS sites. This observer will use a cellular phone or a radio to communicate DMS display results.

The detailed steps to be performed for each test case of this procedure follow. The procedure worksheets are to be completed and signed by the test witness(es). The test conductor will also sign the completed worksheet.

ITS TEST PROCEDURE

TTP-3.2 Dynamic Message Signs

Start Date: _________

Time: ___________

Test Case No. _1_ of _1_ Cases for this Procedure.

Test Site(s) Involved:

[x] Primary TMC
[ ] Secondary TMC
[ ]Highway Dispatch Center
[x] Field
[ ] Other (specify) _________________________

Test Conductor: ________________

Test Witness(es): ________________

Test Operator(s): ________________

Test Observer(s): ________________


Step No./ Check Off Procedure Steps Expected Results/ Comments/ Test data Results Pass (P) or Fail (F)
1 [ ]  Record the console identifier for this operator position.
2 [ ]  On the display screen enter the username and password of the test user with access to all system commands. The User Interface consisting of a Main Menu, Alarm Status Window and GIS map is displayed. The GIS map also contains a menu of commands.
3 [ ]  Select Freeway > Dynamic Message Sign > DMS Unit Control from the Main Menu pull down. A Dynamic Message Sign Status and Unit Control Screen appears.
4 [ ]  Click on the Browse Button Dynamic Message Sign Selection Screen Appears displaying a list of available DMSs.
5 [ ]  Record identifier for Dynamic Message Sign Selection. Dynamic Message Sign Selection Unit # ___________
Location ________________
6 [ ]  Select the Dynamic Message Sign Unit and click on the OK button. Dynamic Message Sign Selection Screen disappears.
7 [ ]  View Unit # and Location in the Selected DMS on the Dynamic Message Sign Control Screen. A DMS matching the Unit # in step 5 is displayed.
8 [ ]  Click on the Sign Control Button. A Sign Control Screen opens.
9 [ ]  Click Yes and OK. The DMS is in a manually controlled mode.
10 [ ]  Select and Read Message to be sent to the DMS.
11 [ ]  Send the Message
12 [ ]  Verify the message sent by having a field technician to communicate the display.
13 [ ]  Repeat steps 10 - 12 four additional times.
14 [ ]  Repeat steps 4 - 13 two additional times at other DMS sites.
15 [ ]  Request Maintenance Technician to disconnect the communication interface that corresponds to the last DMS Unit # recorded in step 5.
16 [ ]  Click the Configuration Parameters button and view the Loss Default Message # text field. A Loss Default Message number is displayed.
17 [ ]  Click the ... button next to the Loss Default Message # text field. A Text Message Display Screen opens with the Message Name and the Phase 1 and Phase 2 Text Messages.
18 [ ]  Request a reading of DMS display from Test Observer. The DMS message is the same as the Loss Default Message in the above step.
19 [ ]  View the Status/Alarm Management list box under the Main Menu. An alarm appears in the Status/Alarm Management window. This alarm displays as a category 2.
20 [ ]  Record the identifier for the new alarm displayed in the Status/Alarm Management window of the Main Menu.

Time Alarm Received ______
Category ________________
Priority ________________

21 [ ]  In the Status/Alarm Management Window of the Main Menu, click on the new alarm. The Alarm Details/Comments Display Window appears.
22 [ ]  Input Alarm comments information and click OK. The Alarm Details/Comments Display Window closes.
23 [ ]  Select Events > On Line Viewer from the Main Menu. An Event Log Viewer Screen opens with a list box of Events.
24 [ ]  View List Box. An Event with an alarm time matching that in step 11 and a category 2 should be present in the list. Also, the event type ID should be 403.
25 [ ]  Click on the Close Button. Event Log Viewer closes.
26 [ ]  Select Freeway > Dynamic Message Sign > DMS Unit Control from the Main Menu pull down. A Dynamic Message Sign Status and Unit Control Screen appears.
27 [ ]  Click on the Browse Button Dynamic Message Sign Selection Screen Appears displaying a list of available DMSs.
28 [ ]  Select the Dynamic Message Sign Unit # that was disconnected in step 15 and click on the OK button. Dynamic Message Sign Selection Screen disappears.
29 [ ]  View Unit #, Location and Status on the Dynamic Message Sign Control Screen. The Unit # and Location should match the Unit # and Location recorded in Step 5. The Status should indicate that the Device is Not Active.
30 [ ]  Select Maintenance > Inventory > Set Status from the Main Menu. The Inventory – Set Status Screen opens.
31 [ ]  Select the Inventory ID matching the failed DMS and click on the Out of Service toggle button in the Status Form and the Save button on the Inventory – Set Status screen. The Inventory - Set Status screen disappears.
32 [ ]  Request Maintenance Technician to reconnect the communication interface to the DMS.
33 [ ]  Select Freeway > Dynamic Message Sign > DMS Unit Control from the Main Menu pull down. A Dynamic Message Sign Status and Unit Control Screen appears.
34 [ ]  Click on the Browse Button Dynamic Message Sign Selection Screen Appears displaying a list of available DMSs.
35 [ ]  Select the Dynamic Message Sign Unit # that was disconnected in step 10 and click on the OK button. Dynamic Message Sign Selection Screen disappears.
36 [ ]  View Unit #, Location and Status on the Dynamic Message Sign Control Screen. The Unit # and Location should match the Unit # and Location recorded in Step 5. The Status should indicate the Device is Active.
37 [ ]  Select and Send a message to the DMS.  
38 [ ]  Request a reading of the DMS display from the field Test Observer. Message is the same as the message sent to the DMS.
39 [ ]  Click the Sign Control Button on the DMS Control Screen. A Sign Control Screen opens.
40 [ ]  Click No and OK The Sign Control Screen closes.
41 [ ]  Click the Close Button on the Dynamic Message Sign Control Screen. The Dynamic Message Sign Control Screen Closes.
42 [ ]  Select Maintenance > Inventory > Set Status from the Main Menu. The Inventory – Set Status Screen opens.
43 [ ]  Select the Inventory ID matching the failed DMS and click on the In Service toggle button in the Status Form and the Save button on the Inventory - Set Status screen. The Inventory – Set Status screen disappears.
44 [ ]  Select Admin > Exit from the Main Menu. End of Test.

Completion Date: ___________

Time: ___________

Test Conductor __________________________
(signature)

Test Witness(es)_________________________
(signature)

Previous | Next
Office of Operations