Whether the strong coupling to thermal baths can improve the performance of quantum thermal machines remains an open issue under active debate. Here we revisit quantum thermal machines operating with the quasistatic Carnot cycle and aim to unveil the role of strong coupling in maximum efficiency. Our analysis builds upon definitions of excess work and heat derived from an exact formulation of the first law of thermodynamics for the working substance, which captures the non-Gibbsian thermal equilibrium state that emerges at strong couplings during quasistatic isothermal processes. These excess definitions differ from conventional ones by an energetic cost for maintaining the non-Gibbsian characteristics. With this distinction, we point out that one can introduce two different yet thermodynamically allowed definitions for efficiency of both the heat engine and refrigerator modes. We dub them excess and hybrid definitions, which differ in the way of defining the gain for the thermal machines at strong couplings by either just analyzing the energetics of the working substance or instead evaluating the performance from an external system upon which the thermal machine acts, respectively. We analytically demonstrate that the excess definition predicts that the Carnot limit remains the upper bound for both operation modes at strong couplings, whereas the hybrid one reveals that strong coupling can suppress the maximum efficiency rendering the Carnot limit unattainable. These seemingly incompatible predictions thus indicate that it is imperative to first gauge the definition for efficiency before elucidating the exact role of strong coupling, thereby shedding light on the ongoing investigation on strong-coupling quantum thermal machines.