¹ Northeastern University, Shenyang, China
² Northeastern University at Qinhuangdao, Qinhuangdao, China

---

Abstract—How to optimally decide or select the radar waveform for next transmission based on the observation of past radar returns is one of the important problems in cognitive radar. In this paper, stochastic dynamic programming model is proposed. Then temporal difference learning method is used to realize the adaptivity of waveform selection. The simulation results show that the uncertainty of state estimation using temporal difference learning is less than that using fixed waveform. Temporal difference learning method approaches the optimal waveform selection scheme but has lower computational cost. Finally, the whole paper is summarized.

Index Terms—waveform selection, stochastic dynamic programming, temporal difference learning, cognitive radar

[PDF]

Cite: Bin Wang, Jinkuan Wang, Xin Song, and Yinghua Han, " Temporal Difference Learning Waveform Selection," Journal of Computers vol. 5, no. 9, pp. 1394-1401, 2010.