Zoonotic poxviruses such as mpox virus (MPXV) continue to threaten public health safety since the eradication of smallpox. Vaccinia virus (VACV), the prototypic poxvirus used as the vaccine strain for smallpox eradication, is the best-characterized member of the poxvirus family. VACV encodes a serine protease inhibitor 1 (SPI-1) conserved in all orthopoxviruses, which has been recognized as a host range factor for modified VACV Ankara (MVA), an approved smallpox vaccine and a promising vaccine vector. FAM111A (family with sequence similarity 111 member A), a nuclear protein that regulates host DNA replication, was shown to restrict the replication of a VACV SPI-1 deletion mutant (VACV-ΔSPI-1) in human cells. Nevertheless, the detailed antiviral mechanisms of FAM111A were unresolved. Here, we show that FAM111A is a potent restriction factor for VACV-ΔSPI-1 and MVA. Deletion of FAM111A rescued the replication of MVA and VACV-ΔSPI-1 and overexpression of FAM111A significantly reduced viral DNA replication and virus titers but did not affect viral early gene expression. The antiviral effect of FAM111A necessitated its trypsin-like protease domain and DNA-binding domain but not the PCNA-interacting motif. We further identified that FAM111A translocated into the cytoplasm upon VACV infection by degrading the nuclear pore complex via its protease activity, interacted with VACV DNA-binding protein I3, and promoted I3 degradation through autophagy. Moreover, SPI-1 from VACV, MPXV, or lumpy skin disease virus was able to antagonize FAM111A by prohibiting its nuclear export. Our findings reveal the detailed mechanism by which FAM111A inhibits VACV and provide explanations for the immune evasive function of VACV SPI-1.