Immunotherapy, including immune checkpoint inhibitors and adoptive cell transfer, has obtained great progress, but their efficiencies vary among patients due to the genetic and epigenetic differences. Human MEX3B (hMEX3B) protein is an RNA-binding protein that contains two KH domains at the N-terminus and a RING domain at its C-terminus, which has the activity of E3 ubiquitin ligase and is essential for RNA degradation. Current evidence suggests that hMEX3B is involved in many important biological processes, including tumor immune evasion and HLA-A regulation, but the sequence of substrate RNA recognized by hMEX3B and the functional molecular mechanisms are unclear. Here, we first screened the optimized hMEX3B binding sequence on the HLA-A mRNA and reported that the two tandem KH domains can bind with their substrate one hundred times more than the individual KH domains. We systematically investigated the binding characteristics between the two KH domains and their RNA substrates by nuclear magnetic resonance (NMR). Based on this information and the small-angle X-ray scattering (SAXS) data, we used molecular dynamics simulations to obtain structural models of KH domains in complex with their corresponding RNAs. By analyzing the models, we noticed that on the KH domains’ variable loops, there were two pairs of threonines and arginines that can disrupt the recognition of the RNA completely, and this influence had also been verified both in vitro and in vivo. Finally, we presented a functional model of the hMEX3B protein, which indicated that hMEX3B regulated the degradation of its substrate mRNAs in many biological processes. Taken together, our research illustrated how the hMEX3B protein played a key role in translation inhibition during the immune response to tumor cells and provided an idea and a lead for the study of the molecular mechanism and function of other MEX3 family proteins.