The differentiation of fresh and frozen-thawed fish is a relevant authenticity aspect as in the European Union fish holds a high statistical risk of being adulterated. Here, nuclear magnetic resonance spectroscopy (NMR) in combination with principal components analysis followed by linear discriminant analysis (PCA-LDA) was used for a non-targeted based differentiation of fresh from frozen-thawed fish. To identify the most promising NMR approach(es), six different approaches were applied to 96 fish samples (mackerel, trout, cod). These approaches included different sample preparation procedures and different NMR methods to investigate both the lipid fraction and the polar fraction of the fish samples. After cross-validation embedded in a Monte Carlo resampling design, six independent classification models were obtained. Evaluation of the multivariate data analysis revealed that the most promising approaches were the 1H NMR analysis of the lipid fraction (correct prediction of about 90.0%) and the 1H NMR based screening of minor components of the lipid fraction with a correct prediction of about 91.9%. 1H NMR analysis of the water extract of the fish samples showed a correct prediction of about 82.6%. Hence, a general differentiation of fresh from frozen-thawed fish via non-targeted NMR is feasible, even though the underlying sample batch contained different fish species. Additional fish samples need to be analyzed with the three most promising NMR approaches to further improve the developed classification models.