Citation

Li S, Wu T. Nat. Hazards Rev. 2023; 24(3): e04023018.

Copyright

(Copyright © 2023, American Society of Civil Engineers)

DOI

10.1061/NHREFO.NHENG-1631

PMID

unavailable

Abstract

To reduce life threats and financial losses under hurricane weather and traffic conditions, stakeholders need to make a sequence of decisions (e.g., enforcing traffic control and/or broadcasting travel advisory) with the presence of various uncertainties, which could be formulated as a Markov decision process (MDP). To effectively solve the MDP for optimal operation of hurricane-impacted transportation networks, a risk-informed decision-support framework is proposed consisting of both a decision-making environment and tool. The decision-making environment involves essentially three coupled modules of hurricane hazard, transportation infrastructure, and traffic flow, where the uncertainties from natural environment, built environment, and human behavior are examined. Specifically, multiple correlated hazards for each specific storm are capsulated in the hurricane hazard module, representative hurricane-vulnerable infrastructure components and associated moving vehicles are evaluated in the transportation infrastructure module, and network-level traffic relations are addressed in the traffic flow module. In view of the complexity and intractability of a hurricane-transportation infrastructure-traffic system through full model representation, the efficient low-dimensional modeling approaches including both physics-based analytical and data-driven surrogate models are utilized in all these three simulation modules. Considering an explicit probabilistic model for the decision-making environment (and hence state transition function) is not available, the operation optimization (involving competing objectives of traffic safety and mobility) is accomplished through a deep reinforcement learning-based decision-making tool that learns to act optimally (involving both traffic control and travel advisory actions) by directly interacting with the environment. A hypothetical case study is conducted to verify the applicability and effectiveness of the proposed framework as a testbed for optimal operation of hurricane-impacted transportation networks.

Language: en

Keywords

Decision-making framework; Hurricane hazard; Reinforcement learning; Traffic flow; Transportation infrastructure