AbstractSpace communications require high data rate information transmission at low bit error rate (BER). In this paper, we present a pilot symbol‐assisted, iterative demodulation and decoding system for high‐order continuous phase modulated (CPM) signals. We consider CPM signals because they are especially suitable for space communications due to their high spectral efficiency and constant envelope property.Coherent demodulation is adopted because of its superior BER performance over non‐coherent demodulation like differential detection. To track the time‐varying channel state information (CSI) caused by the Doppler effect in space communications, pilot symbols are inserted periodically in the data stream to serve as references for channel estimation. Due to the inherent memory in continuous phase modulation, those pilot symbols are set to be data dependent so that the CPM phase trellis can be forced to some pre‐defined reference state at certain time epochs. In addition, pilot symbols are used as parity check symbols in demodulating each pilot frame to help reduce decoding errors. Powerful forward error correcting codes (convolutional codes) are then combined with the phase trellis of the CPM signal to form a structure similar to serial concatenated convolutional codes so that the BER performance can be significantly improved by applying iterative processing. Compared with other joint detection and decoding systems, the proposed system has high power‐bandwidth efficiency and low computational complexity by using pilot symbols to separate channel estimation from demodulation, which is even more significant in high‐order modulation.To further improve the receiver performance, information is exchanged between the CPM demodulator, the convolutional decoder, and the channel estimator. First, the channel estimator uses the information from CPM demodulator to construct an estimate of the phase trajectory of the transmitted signal and filters all received samples on this estimated phase trajectory to obtain a more accurate estimation of the CSI. Then the CPM demodulator combines this newly estimated CSI with the extrinsic information from the convolutional decoder to generate more reliable soft decisions, which is to be used as input to the convolutional decoder. This process can be carried out iteratively to improve the BER performance. Although there may be some errors in reconstructing the phase trajectory which will cause an increase in channel estimation errors, the number of errors will decrease at high signal‐to‐noise ratio and the accuracy of the estimated CSI will improve due to the increased sampling rate.At last, it should be pointed out that although the proposed system is designed for CPM signals, it applies in general to other signals modulated with memory such as differential phase‐shift keying. We have already obtained similar results for differential QPSK in Rician fading channels. Copyright © 2002 John Wiley & Sons, Ltd.