Profiling Vehicles for Improved Small Cell Beam-Vehicle Pairing Using Multi-Armed Bandit

Creative Commons License

Kose A., Foh C. H., Lee H., Moessner K.

12th International Conference on Information and Communication Technology Convergence, ICTC 2021, Jeju Island, South Korea, 20 - 22 October 2021, vol.2021-October, pp.221-226 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 2021-October
  • Doi Number: 10.1109/ictc52510.2021.9620863
  • City: Jeju Island
  • Country: South Korea
  • Page Numbers: pp.221-226
  • Keywords: Beam Handover, mmWave Networks, 5G
  • Abdullah Gül University Affiliated: No


© 2021 IEEE.The 5G technology has tapped into millimeter wave (mmWave) spectrum to create additional bandwidth for improved network capacity. The use of mmWave for specific applications including vehicular networks has widely discussed. However, applying mmWave to vehicular networks faces challenges of high mobility nodes and narrow coverage along the mmWave beams. In this paper, we focus on a mmWave small cell base station deployed in a city area to support vehicular network application. We propose profiling vehicle mobility for a machine learning agent to learn the performance of serving vehicles with different mobility profiles and utilize the past experiences to select appropriate mmWave beam to service a vehicle. Our machine learning agent is based on multi-armed bandit learning model, where classical multi-armed bandit and contextual multi-armed bandit are used. Particularly for the contextual multi-armed bandit, the contexts are vehicle mobility information. We show that the local street layout has naturally constrained vehicle movement creating distinct mobility information for vehicles, and the vehicle mobility information is highly related to communication performance. By using vehicle mobility information, the machine learning agent is able to identify vehicles that can remain within a beam for longer time period to avoid frequent handovers.