Influenza and COVID-19 continue to pose global threats to public health. Classic antiviral drugs have certain limitations, coupled with frequent viral mutations leading to many drugs being ineffective, the development of new antiviral drugs is urgent. Meanwhile, the invasion of influenza virus can cause an immune response, and an excessive immune response can generate a large number of inflammatory storms, leading to tissue damage. Toll-like receptor 3 (TLR3) recognizes virus dsRNA to ignite the innate immune response, and inhibit TLR3 can block the excess immune response and protect the host tissues. Taking TLR3 as the target, SMU-CX1 was obtained as the specific TLR3 inhibitor by high-throughput screening of 15,700 compounds with IC50 value of 0.11 µM. Its anti-influenza A virus activity with IC50 ranged from 0.14 to 0.33 µM against multiple subtypes of influenza A virus and also showed promising anti-SARS-CoV-2 activity with IC50 at 0.43 µM. Primary antiviral mechanism study indicated that SMU-CX1 significantly inhibited PB2 and NP protein of viruses, it can also inhibit inflammatory factors in host cells including IFN-β, IP-10 and CCL-5. In conclusion, this study demonstrates the potential of SMU-CX1 in inhibiting IAV and SARS-CoV-2 activity, thereby offering a novel approach for designing antiviral drugs against highly pathogenic viruses.