TITLE:
Q-Learning-Based Adaptive Waveform Selection in Cognitive Radar
AUTHORS:
Bin WANG, Jinkuan WANG, Xin SONG, Fulai LIU
KEYWORDS:
Waveform Selection; Q-Learning; Space Division; Cognitive Radar
JOURNAL NAME:
International Journal of Communications, Network and System Sciences,
Vol.2 No.7,
October
21,
2009
ABSTRACT: Cognitive radar is a new framework of radar system proposed by Simon Haykin recently. Adaptive waveform selection is an important problem of intelligent transmitter in cognitive radar. In this paper, the problem of adaptive waveform selection is modeled as stochastic dynamic programming model. Then Q-learning is used to solve it. Q-learning can solve the problems that we do not know the explicit knowledge of state-transition probabilities. The simulation results demonstrate that this method approaches the optimal wave-form selection scheme and has lower uncertainty of state estimation compared to fixed waveform. Finally, the whole paper is summarized.