Both bone and cartilage microenvironments play a crucial role in the regeneration of osteochondral defects caused by osteoarthritis (OA). A major challenge is how to simulate gradient changing mechanical properties and inducing abilities of regenerative microenvironments on the integrated scaffold to achieve simultaneous regeneration. In this work, a concept of biphasic ECM assembled graphene oxide-collagen (GO-COL)/ Nano-hydroxyapatite (nHap) composite is proposed. GO-COL/nHap bilayer scaffold with gradient concentration was formed by crosslinking and freeze-drying in stages to mimic the gradient distribution of mechanical properties of articular cartilage and bone. Then we prepared chondrogenic/osteogenic ECM membranes (CgECM/OgECM) with chondrocytes from rat knee respectively, and assembled them onto corresponding layers. The morphology, physical properties, biocompatibility, and osteochondrogenic capability of the scaffold were evaluated in vitro and in vivo. Mechanically, gene expression and protein level assessments showed greater osteochondrogenic activity in the biphasic ECM scaffold group compared to the GO-COL bilayer scaffold group. In vivo studies using a rat knee osteochondral defect model further confirmed the superior repair effect of the biphasic ECM-scaffold group compared to the blank group. Taken together, the proposed ECM assembled GO-COL/nHap strategy open a window to realize different microenvironment mimicking in a whole scaffold, making it a potential off-the-shelf method for osteochondral tissue engineering.