Proceedings of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013)

A Q-learning-Based Dynamic Spectrum Allocation Algorithm

Authors
Chunying Lv, Jiyang Wang, Fei Yu, Hui Dai
Corresponding Author
Chunying Lv
Available Online March 2013.
DOI
10.2991/iccsee.2013.195How to use a DOI?
Keywords
cognitive radio, Q-learning, dynamic spectrum allocation, channel and power selection, autonomy
Abstract

Contraposing the status of spectrum resources is tension and spectrum utilization is low, the dynamic spectrum allocation technology is studied. Due to lack of central control entity in distributed cognitive networks, cognitive users need to select channel and power for communication intellective. Based on the intelligence of Q-learning, we proposed an improved dynamic spectrum allocation algorithm. The state space, action space and reward function of the algorithm are built in the paper, and the agents are guided to perform actions through designing the reward function. The algorithm gives fully autonomy selective to cognitive users. This strengthened the dynamic management of spectrum resources. We also did many experiments. Numerical simulation results show that the proposed algorithm can not only realize the autonomy of channel and power allocation, but also improve system throughput compared to others. It boosts spectrum utilization effectively.

Copyright
© 2013, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

Volume Title
Proceedings of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013)
Series
Advances in Intelligent Systems Research
Publication Date
March 2013
ISBN
10.2991/iccsee.2013.195
ISSN
1951-6851
DOI
10.2991/iccsee.2013.195How to use a DOI?
Copyright
© 2013, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

TY  - CONF
AU  - Chunying Lv
AU  - Jiyang Wang
AU  - Fei Yu
AU  - Hui Dai
PY  - 2013/03
DA  - 2013/03
TI  - A Q-learning-Based Dynamic Spectrum Allocation Algorithm
BT  - Proceedings of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013)
PB  - Atlantis Press
SP  - 771
EP  - 775
SN  - 1951-6851
UR  - https://doi.org/10.2991/iccsee.2013.195
DO  - 10.2991/iccsee.2013.195
ID  - Lv2013/03
ER  -