Abstract:Aiming at the problem that the traditional path planning method can not plan the optimal path according to the timevarying characteristics of urban road network weight, a timevarying road network path planning method based on double deep Qnetwork was proposed. Firstly, the urban road network model with timevarying weights is constructed, in which the weights at each time period of the road segment are generated by random functions. Then, the state features, interaction actions and reward functions are designed to model the timevarying weight network path planning problem, and DDQN algorithm is used to train the agent to learn the timevarying weight characteristics of the road network. Finally, the path is planned according to the modeled state features to realize the effective path planning of the timevarying weight network. The experimental results show that the agent trained by DDQN algorithm has better global optimization ability in the timevarying weight road network. Compared with the rolling path planning algorithm, the proposed method can plan the optimal path under different circumstances, which provides a new idea for the path planning of the road network with timevarying weights.