تخصیص منابع در شبکه‌های دسترسی رادیویی باز: یک رویکرد نظریه بازی مبتنی بر تعادل همبسته

نوع مقاله : علمی-پژوهشی

نویسندگان

1 دانشجوی دکتری، دانشکده مهندسی کامپیوتر، دانشگاه علم و صنعت، تهران، ایران

2 استاد، دانشکده مهندسی کامپیوتر، دانشگاه علم و صنعت، تهران، ایران

چکیده

شبکه دسترسی رادیویی به عنوان واسط میان دستگاه­های کاربر و شبکه هسته، ارتباط بی­سیم یکپارچه را میان دستگاه­ها فرآهم می­آورد. شبکه دسترسی رادیویی باز (O-RAN)، الگوی به روز شده­ای از الگو­های طراحی RAN به مانند RAN اَبری و RAN مجازی­سازی شده است که علاوه بر ویژگی­های جداسازی ریزدانه­تر در کارکردهای شبکه و استفاده از معماری تحت سرویس­دهنده­های همه­منظوره، از مزیت استفاده از کنترل­کننده­های هوشمند بهره می­برد و مناسبت بیشتری با شبکه­های نسل پنجم و ششم دارد. از این رو تخصیص منابع در O-RAN نیاز به رویکردهای متفاوتی دارد. کنترل­کننده­ها در O-RAN به دو صورت نزدیک به بلادرنگ و غیر بلادرنگ هستند که اولی از برنامه­های کاربردی به نام xApp و دومی از برنامه­های کاربردی به نام rApp به منظور کنترل منابع شبکه بهره می­برد. ما در این مقاله مسئله تخصیص توأم واحدهای رادیویی باز (O-RU) به کاربران و زیرکانال به O-RUها را در شرایط کیفیت کانال غیرقطعی و متغیر با زمان در نظر می­گیریم، مسئله را با استفاده از بازی­های مُدوله شده مارکُفی فرمول­بندی کرده و یک الگوریتم رهگیر تعادل چند­­ عامله برای حصول همگرایی و رهگیری نقطه کاری پایدار شبکه پیشنهاد می­دهیم. همچنین از طریق شبیه­سازی، کارایی روش پیشنهادی با راهکارهای پیشین مرتبط مقایسه و ارزیابی می­شود.

کلیدواژه‌ها

موضوعات


عنوان مقاله [English]

Resource Allocation in Open Radio Access Networks (O-RANs): A Correlated Equilibrium Game Theoretic Approach

نویسندگان [English]

  • Mahbod Hamzeh 1
  • Vesal Hakami 2
1 School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran.
2 School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran.
چکیده [English]

Radio access network (RAN) provides integrated wireless communication between user devices and the core network as an interface. Open Radio Access Network (O-RAN) is an updated model of RAN design, similar to cloud RAN (C-RAN) and virtualized RAN (vRAN). In addition to finer-grained disaggregation features in network functions and the use of general-purpose server architecture, O-RAN benefits from the use of smart controllers, making it more suitable for 5G and 6G networks. Consequently, resource allocation in O-RAN requires different approaches. Controllers in O-RAN are categorized into Near-Real-Time (Near-RT) and Non-Real-Time (Non-RT) types, where the former utilizes applications called xApps and the latter uses applications called rApps to manage network resources. In this paper, we address the problem of joint allocation of open radio units (O-RUs) to users and sub-channels to O-RUs under uncertain and time-varying channel quality conditions. We formulate the problem using Markov modulated games and propose a multi-agent tracking equilibrium algorithm to achieve convergence and track the stable operating point of the network. Furthermore, through simulations, the efficiency of the proposed method is compared and evaluated against previous related solutions.

کلیدواژه‌ها [English]

  • O-RAN
  • resource allocation
  • game theory
  • correlated equilibria
[1] Polese, L. Bonati, S. D’Oro, S. Basagni and T. Melodia, "Understanding O-RAN: Architecture, Interfaces, Algorithms, Security, and Research Challenges," in IEEE Communications Surveys & Tutorials, vol. 25, no. 2, pp. 1376-1411, 2023.
[2] Sharara, T. Pamuklu, S. Hoteit, V. Vèque and M. Erol-Kantarci, "Policy-Gradient-Based Reinforcement Learning for Computing Resources Allocation in O-RAN," 2022 IEEE 11th International Conference on Cloud Networking (CloudNet), pp. 229-236, 2022.
[3] Mollahasani, M. Erol-Kantarci and R. Wilson, "Dynamic CU-DU Selection for Resource Allocation in O-RAN Using Actor-Critic Learning," 2021 IEEE Global Communications Conference (GLOBECOM), Madrid, Spain, pp. 1-6, 2021.
[4] Hammami and K. K. Nguyen, "Multi-Agent Actor-Critic for Cooperative Resource Allocation in Vehicular Networks," 2022 14th IFIP Wireless and Mobile Networking Conference (WMNC), Sousse, Tunisia, pp. 93-100, 2022.
[5] Kazemifard and V. Shah-Mansouri, “Minimum delay function placement and resource allocation for Open RAN (O-RAN) 5G networks,” Computer Networks, vol. 188. Elsevier BV, p. 107809, 2021.
[6] -H. Lai, L.-H. Shen, and K.-T. Feng, “Intelligent Load Balancing and Resource Allocation in O-RAN: A Multi-Agent Multi-Armed Bandit Approach.” arXiv, 2023.
[7] Narmanlioglu and E. Zeydan, "Learning in SDN-based multi-tenant cellular networks: A game-theoretic perspective," 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM), pp. 929-934, 2017.
[8] Zhou, M. Elsayed and M. Erol-Kantarci, "RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning," 2021 IEEE 32nd Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Helsinki, Finland, pp. 1179-1184, 2021.
[9] Bejani, R. , Kalantari, M. and Eftekhari Moghaddam, A. M., "A Game Theory Framework to Cooperate Nodes in Malicious Nodes Detection Process in Wireless Sensor Network," TABRIZ JOURNAL OF ELECTRICAL ENGINEERING, vol.47, no.4, pp. 1329-1342, 2018.
[10] Filali, Z. Mlika and S. Cherkaoui, "Open RAN Slicing for MVNOs With Deep Reinforcement Learning," in IEEE Internet of Things Journal, vol. 11, no. 10, pp. 18711-18725, 2024.
[11] Hakami, V. , Mostafavi, S. A. and Arefinezhad, Z., "RL-based Resource Allocation for Improving Throughput in Cellular D2D Communications, " TABRIZ JOURNAL OF ELECTRICAL ENGINEERING, pp. 50, no. 3, pp. 1165-1177, 2020.
[12] Zhang and L. Cai, "Packet-Level Channel Model for Wireless OFDM Systems," IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference, Washington, DC, USA, pp. 5215-5219, 2007.
[13] Rastovac and D. Vukobratovic, "Modeling LTE-A channel using FSMC model for OFDM systems," 2012 20th Telecommunications Forum (TELFOR), Belgrade, Serbia, pp. 436-439, 2012.
[14] Xu and Z. Cao, "A Packet Loss Reduction Scheduling Scheme With Cross-layer Design for OFDM Downlinks," MILCOM 2006 - 2006 IEEE Military Communications conference, Washington, DC, USA, pp. 1-7, 2006.
[15] Heng Wang and N. B. Mandayam, "A simple packet-transmission scheme for wireless data over fading channels," in IEEE Transactions on Communications, vol. 52, no. 7, pp. 1055-1059, 2004.
[16] Hong Shen Wang and N. Moayeri, "Finite-state Markov channel-a useful model for radio communication channels," in IEEE Transactions on Vehicular Technology, vol. 44, no. 1, pp. 163-171, Feb. 1995.
[17] J. Aumann, “Correlated Equilibrium as an Expression of Bayesian Rationality,” Econometrica, vol. 55, no. 1. JSTOR, p. 1, Jan. 1987.
[18] Hart and A. Mas-Colell, “A Reinforcement Procedure Leading to Correlated Equilibrium,” Economics Essays. Springer Berlin Heidelberg, pp. 181–200, 2001.
[19] Namvar Gharehshiran, V. Krishnamurthy and G. Yin, "Distributed Tracking of Correlated Equilibria in Regime Switching Noncooperative Games," in IEEE Transactions on Automatic Control, vol. 58, no. 10, pp. 2435-2450, 2013.
[20] Todisco, S. Bartoletti, C. Campolo, A. Molinaro, A. O. Berthet and A. Bazzi, "Performance Analysis of Sidelink 5G-V2X Mode 2 Through an Open-Source Simulator," in IEEE Access, vol. 9, pp. 145648-145661, 2021.
[21] S. Sutton, A.G. Barto, Reinforcement Learning: An Introduction, MIT Press, 2018.
[22] H. Sandholm, "Population Games and Evolutionary Dynamics, ser, " Economic Learning and Social Evolution. Cambridge, MA, USA: MIT Press, 2011.