Pattern recognition systems using information from the pattern which follows the present pattern are discussed. Parametric learning methods in the supervised and unsupervised machines are proposed and compare favorably with conventional methods. Furthermore, a semilinear machine with a nonparametric learning method is considered. The results of computer experiments with artificially generated data and with handprinted alphanumeric characters are given to show that the approach we adopt is quite useful for recognition of Markovian patterns.