This study explores a novel approach to enhancing cognitive proficiency by targeting neural mechanisms that facilitate science and math learning, especially mental rotation. The study specifically examines the relationship between upper alpha intensity and mental rotation skills. Although prior neurofeedback research for increasing upper alpha highlights this correlation, mostly with familiar objects, novel chemistry and math learning prompts envisioning unfamiliar objects which question the persistence of this correlation. This study revisits the upper alpha and mental rotation relationship in the context of unfamiliar objects with a single neurofeedback session and examines the efficiency of manual and automatic neurofeedback protocols. Results will provide a basis for integrating neurofeedback protocols into learning applications for enhanced learning. Our study encompassed three cohorts: Group 1 experienced an automatic neurofeedback protocol, Group 2 received a manual neurofeedback protocol, and the control group had no neurofeedback intervention. The experimental phases involved EEG measurement of individual upper alpha (frequency of maximal power + 2Hz) intensity, mental rotation tasks featuring geometric and unfamiliar molecular stimuli, one neurofeedback session for applicable groups, post-treatment upper alpha level assessments, and a mental rotation retest. The neurofeedback groups exhibited increased levels of upper alpha power, which was correlated with improved response time in mental rotation, regardless of stimulus type, compared to the control group. Both neurofeedback protocols achieved comparable results. This study advocates integrating neurofeedback into learning software for optimal learning experiences, highlighting a single session's efficacy and the substantial neurofeedback protocol's impact in enhancing upper alpha oscillations.