Rock brittleness is a key parameter to quantify and evaluate the brittle nature of the rock. A better estimating technique of rock brittleness is crucial for acquiring an efficient stimulation of unconventional shale gas reservoirs such as hydraulic fracturing. One way to predict rock brittleness index is by using rock elastic moduli. These physical properties highly depend on the complexity of the microstructure, fluid content, and mineral composition. The other way is by measuring the rock mineral composition itself. This complexity of the microstructure can be accurately characterized by using imaging techniques such as micro-CT scans. This study used the finite element method to estimate rock brittleness index based on elastic properties on synthetic and digital rock images. We then evaluate the effect of physical and geometrical properties (pore aspect ratio, water saturation, and mineral composition) in determining the rock brittleness characteristic. The results indicate that there is an increase in Young’s modulus along with an increasing pore aspect ratio to 1, which in turn raises the rock brittleness. Fluid saturation, in this case, water saturation, causes brittleness to be increased. The rock mineral composition, such as abundant quartz and carbonate content, yields high brittleness values, while high clay content and porosity lower the rock brittleness. Overall, the results imply that pore geometry, fluid saturation, and mineral composition significantly alter the rock strength parameters.