How can LLMs improve CAV decisions using transformers?
SPformer: A Transformer Based DRL Decision Making Method for Connected Automated Vehicles
September 24, 2024
https://arxiv.org/pdf/2409.15105This paper proposes SPformer, a new architecture using deep reinforcement learning (DRL) to improve multi-vehicle collaborative decision-making in autonomous driving scenarios.
SPformer leverages a transformer encoder with a novel "policy token" to allow vehicles to learn from the global traffic state, enhancing cooperation. Additionally, it incorporates physical positional encoding to provide the network with a better understanding of vehicle locations, leading to more effective decision-making than traditional CNN or GNN approaches.