The University of Southampton
University of Southampton Institutional Repository

Cooperative cache in cognitive radio networks: A heterogeneous multi-agent learning approach

Cooperative cache in cognitive radio networks: A heterogeneous multi-agent learning approach
Cooperative cache in cognitive radio networks: A heterogeneous multi-agent learning approach

Deploying distributed cache in cognitive radio networks (CRNs), which spreads popular contents to the edge of network during the off-peak time through spectrum sharing, can reduce the deliver delay to users nearby without causing severe interference to the primary network. However, due to the un-predicable contents requirement as well as the band occupation of primary users, it is non-trivial to optimize the cache storage and contents fetching strategy of users dynamically. The letter proposes a heterogeneous multi-agent deep deterministic policy gradient (MADDPG) approach, which takes users and cache servers as two different types of agents to learn the cooperation and competition for mutual benefits. The numeral simulation demonstrates that comparing with the other single or homogeneous deep reinforcement learning (DRL) approaches, the proposed heterogeneous MADDPG can further reduce the delivery delay of users and enhance the cache efficiency of SBSs.

Cognitive radio networks, Cooperative cache, Multi-agent deep deterministic policy gradient
1089-7798
1032-1036
Gao, Ang
c50ad415-a1c3-4592-beee-b1ff254eb087
Liu, Hengtong
5d5daa91-6306-4417-9ace-a90e624e8483
Hu, Yansu
ce2f0b39-c4bd-4097-ae9c-46a04db9ef10
Liang, Wei
9576aa89-5e9a-489f-ae64-1f30628d3514
Ng, Soon Xin
e19a63b0-0f12-4591-ab5f-554820d5f78c
Gao, Ang
c50ad415-a1c3-4592-beee-b1ff254eb087
Liu, Hengtong
5d5daa91-6306-4417-9ace-a90e624e8483
Hu, Yansu
ce2f0b39-c4bd-4097-ae9c-46a04db9ef10
Liang, Wei
9576aa89-5e9a-489f-ae64-1f30628d3514
Ng, Soon Xin
e19a63b0-0f12-4591-ab5f-554820d5f78c

Gao, Ang, Liu, Hengtong, Hu, Yansu, Liang, Wei and Ng, Soon Xin (2022) Cooperative cache in cognitive radio networks: A heterogeneous multi-agent learning approach. IEEE Communications Letters, 26 (5), 1032-1036. (doi:10.1109/LCOMM.2022.3151877).

Record type: Article

Abstract

Deploying distributed cache in cognitive radio networks (CRNs), which spreads popular contents to the edge of network during the off-peak time through spectrum sharing, can reduce the deliver delay to users nearby without causing severe interference to the primary network. However, due to the un-predicable contents requirement as well as the band occupation of primary users, it is non-trivial to optimize the cache storage and contents fetching strategy of users dynamically. The letter proposes a heterogeneous multi-agent deep deterministic policy gradient (MADDPG) approach, which takes users and cache servers as two different types of agents to learn the cooperation and competition for mutual benefits. The numeral simulation demonstrates that comparing with the other single or homogeneous deep reinforcement learning (DRL) approaches, the proposed heterogeneous MADDPG can further reduce the delivery delay of users and enhance the cache efficiency of SBSs.

Text
CoopertiveCacheGao - Accepted Manuscript
Download (754kB)

More information

Accepted/In Press date: 22 January 2022
Published date: 1 May 2022
Additional Information: Funding Information: The work was supported by Shaanxi Natural Science Foundation 2021GXLH-01-15, 2021JM-186. Xian Technology Plan 21RGZN0018 and Taicang Keypoint Science and Technology Plan TC2019SF03. Publisher Copyright: © 1997-2012 IEEE.
Keywords: Cognitive radio networks, Cooperative cache, Multi-agent deep deterministic policy gradient

Identifiers

Local EPrints ID: 456538
URI: http://eprints.soton.ac.uk/id/eprint/456538
ISSN: 1089-7798
PURE UUID: 51a75501-c218-438e-b952-e0d3cf99bb4c
ORCID for Soon Xin Ng: ORCID iD orcid.org/0000-0002-0930-7194

Catalogue record

Date deposited: 04 May 2022 17:13
Last modified: 17 Mar 2024 02:46

Export record

Altmetrics

Contributors

Author: Ang Gao
Author: Hengtong Liu
Author: Yansu Hu
Author: Wei Liang
Author: Soon Xin Ng ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×