Most structurally characterized broadly neutralizing antibodies (bnAbs) against influenza A viruses (IAVs) target the conserved conformational epitopes of hemagglutinin (HA). Here, we report a lineage of naturally occurring human antibodies sharing the same germline gene, VH3-48/VK1-12. These antibodies broadly neutralize the major circulating strains of IAV in vitro and in vivo mainly by binding a contiguous epitope of H3N2 HA, but a conformational epitope of H1N1 HA, respectively. Our structural and functional studies of antibody 28-12 revealed that the continuous amino acids in helix A, particularly N49HA2 of H3 HA, are critical to determine the binding feature with 28-12. In contrast, the conformational epitope feature is dependent on the discontinuous segments involving helix A, the fusion peptide, and several HA1 residues within H1N1 HA. We report that this antibody was initially selected by H3 (group 2) viruses and evolved via somatic hypermutation to enhance the reactivity to H3 and acquire cross-neutralization to H1 (group 1) virus. These findings enrich our understanding of different antigenic determinants of heterosubtypic influenza viruses for the recognition of bnAbs and provide a reference for the design of influenza vaccines and more effective antiviral drugs.