There exist in the literature two natural generalizations of low density parity check (LDPC) codes: 1) LDPC convolutional codes or sometimes also called spatially coupled LDPC codes which have shown to be able to reach Shannon capacity in a practical way. 2) Moderate density parity check (MDPC) codes which are linear codes possessing a parity check matrix whose row weight is not more than O(√n), still allowing efficient decoding with high probability. MDPC codes became a highly interesting class of block codes for the purpose of doing code-based cryptography.In this paper we study MDPC convolutional codes and some of their basic properties. At the end of the paper we explain how one can construct a new code-based cryptographic system. This new system can be seen as a convolutional version of the famous BIKE system currently evaluated for possible standardization by the National Institute for Standards and Technology (NIST).