Thermo-optical and nonlinear property characterization of refractive optical components is essential for endoscopic instrumentation that utilizes high-power, high-repetition-rate ultrafast lasers. For example, ytterbium-doped fiber lasers are well suited for ultrafast laser microsurgery applications; however, the thermo-optical responses of many common lens substrates are not well understood at 1035 nm wavelength. Using a z-scan technique, we first measured the nonlinear refractive indices of CaF2, MgF2, and BaF2 at 1035 nm and found values that match well with those from the literature at 1064 nm. To elucidate effects of thermal lensing, we performed z-scans at multiple laser repetition rates and multiple average powers. The results showed negligible thermal effects up to an average power of 1 W and at 10 W material-specific thermal lensing significantly altered z-scan measurements. Using a 2D temperature model, we could determine the source of the observed thermal lensing effects. Linear absorption was determined as the main source of heating in these crystals. On the other hand, inclusion of nonlinear absorption as an additional heat source in the simulations showed that thermal lensing in borosilicate glass was strongly influenced by nonlinear absorption. This method can potentially provide a sensitive method to measure small nonlinear absorption coefficients of transparent optical materials. These results can guide design of miniaturized optical systems for ultrafast laser surgery and deep-tissue imaging probes.