Mineralization of bone, from the tissue level to whole bones, is associated with mechanical properties. The relationship between bone tissue mineralization and micromechanical properties may be affected by age, disease, and drug treatment. Patients with severely suppressed bone turnover (SSBT) suffered atypical fractures while on bisphosphonate treatment. The role of tissue level mineralization in predicting material level properties of SSBT bone may be different from that of other osteoporotic patients and of normal subjects. The aim of this study was to compare the relationships between mineralization and micromechanical properties of bone biopsies from patients with SSBT, bisphosphonate-naive osteoporotic patients with typical vertebral fracture, and normal young and age-matched subjects. We used nanoindentation and quantitative backscattered electron microscopy to characterize the elastic modulus, contact hardness, plastic deformation resistance, and tissue mineralization of the biopsies at site-matched locations within each biopsy. The linear mineralization–mechanical property relationships were different among the groups with respect to the intercepts for only cortical bone tissue but not the slopes for cortical and trabecular bone tissues. For a given mineral density, there was a trend of greater plastic deformation resistance in SSBT cortical bone compared to young normal bone. Similarly, there was a trend of greater plastic deformation resistance in osteoporotic trabecular bone compared to young normal bone for a given mineral density. The age-matched normal group had higher elastic modulus and a trend of higher contact hardness compared to the young normal group for a given mineral density. However, the mechanical property–mineralization relationships within an individual were weak, and only 21 of 53 biopsies that were analyzed had at least one significant association between mineralization and a mechanical property measurement for either cortical or trabecular bone tissues. The average properties of microstructural regions (deep and superficial remodeling packets in trabecular bone; osteonal and interstitial regions in cortical bone) were consistent with mineral accumulation with tissue age, with the exception of the SSBT group. SSBT trabecular bone deep packets had higher hardness and plastic deformation resistance than superficial packets, but mineralization levels and tissue modulus were not different between packet types. We conclude that relationships between mineral and mechanical properties were different between fracture and normal groups and between young and old normal groups, and that atypical fracture may be associated with changed microstructural material properties and tissue level mineralization compared to osteoporotic patients with vertebral fracture and normal subjects. We hypothesize that tissue level bone quality may be an important determinant in fracture risk, such that tissue mineral density may predict different material properties in different patient groups.