Understanding the membrane interactions of the N-terminal 17 residues of the huntingtin protein (HttN) is essential for unraveling its role in cellular processes and its impact on huntingtin misfolding. In this study, we used atomic force microscopy (AFM) to examine the effects of lipid specificity in mediating bilayer perturbations induced by HttN. Across various lipid environments, the peptide consistently induced bilayer disruptions in the form of holes. Notably, our results unveiled that cholesterol enhanced bilayer perturbation induced by HttN, while phosphatidylethanolamine (PE) lipids suppressed hole formation. Furthermore, anionic phosphatidylglycerol (PG) and cardiolipin lipids, along with cholesterol at high concentrations, promoted the formation of double-bilayer patches. This unique structure suggests that the synergy among HttN, anionic lipids, and cholesterol can enhance bilayer fusion, potentially by facilitating lipid intermixing between adjacent bilayers. Additionally, our AFM-based force spectroscopy revealed that HttN enhanced the mechanical stability of lipid bilayers, as evidenced by an elevated bilayer puncture force. These findings illuminate the complex interplay between HttN and lipid membranes and provide useful insights into the role of lipid composition in modulating membrane interactions with the huntingtin protein.