While benthic characteristics of coral reef habitats are a major driver of the structure of coral reef fish assemblages, non-reef habitats adjacent to coral reefs (e.g., mangroves, seagrass beds, and macroalgal beds) can affect reef fish assemblages. Here, we investigate how reef fish assemblages respond to local-scale benthic habitats within a coral reef and larger-scale adjacent seascape features (habitats within 500 m of coral reefs) on Siquijor Island in the Philippines. We examined an abundance of species for the entire reef fish assemblage and within the assemblages of parrotfishes (subfamily Scarinae) and wrasses (family Labridae). Five distinct habitat types were identified in a cluster analysis, which incorporated benthic characteristics within coral reefs and habitats adjacent to coral reefs. We found that the diversity and structure of coral reef fish assemblages were affected by benthic characteristics within coral reefs and also by benthic habitat types adjacent to coral reefs. Individual species responses and juveniles of certain species demonstrated uniquely high abundances in habitat clusters characterized by the non-reef habitats surrounding coral reefs. Considering coral reef habitats and adjacent non-reef habitats as a holistic, interconnected seascape will provide better estimations of the drivers of the structures of coral reef fish assemblages.