Ambiguous pattern recognition is a very important technology in the field of science including engineering application nowadays, it uses methods of fuzzy mathematics enabling the computer to recognize and judge the objective things. But, the research on ambiguous pattern recognition system rarely involves the field of security, while in fact both the participant of the pattern recognition and the database need to protect their privacy. This paper mainly introduces the secure multi-party computation into the field of ambiguous pattern recognition, raises a new solution for the secure multi factor ambiguous pattern recognition system under the half honest model, and proves the validity and security of the protocol.