O-H bond stretching vibrations in hydrogen-bonded complexes embedded into cryogenic neon matrices are subtly downshifted from cold gas phase reference wavenumbers. To the extent that this shift is systematic, it enables neon matrices as more universally applicable spectroscopic benchmark environments for quantum chemical predictions. Outliers are indicative of either an assignment problem in one of the two cryogenic experiments or they reveal interesting dynamics or structural effects on the complexes as a function of the environment. We compile 6 literature-known pairs of experimental data in jet and neon matrix expansions and realize a 6-fold expansion of that number through targeted matrix isolation and/or slit jet expansion spectroscopy presented in this work. In many cases, the neon matrix shift is less than the uncertainty of the currently best-performing blind quantum chemical predictions for the gas phase, but in specific cases, it may exceed the currently achievable theoretical accuracy. Some evidence for a positive correlation of the matrix shift with the hydrogen bond shift is found, similar to observations for helium nanodroplets. Outliers in particular for water acting as a donor are discussed, and in a few cases they call for a future reinvestigation. Substantial improvement in the correlation of the matrix shift with the hydrogen bond shift is achieved for ketone monohydrates by removing a vibrational resonance. New insights into nitrile hydration isomerism are obtained, and the linear OH stretching spectrum of the jet-cooled ammonia-water complex is presented for the first time. Vibrational spectroscopy in weakly perturbing solid rare gas quantum matrices for the benchmarking of gas phase theory and future explicit theoretical treatments of the quantum matrix environment to better understand the outliers are both encouraged.