Workers tend to make inferences about one another's commitment and dedication to work depending on what cues are available to them, affecting worker relationships and collaboration outcomes. In this work, we investigate how remote work affects workers' perceptions of their colleagues with different levels of social connectivity, commonly referred to as strong ties and weak ties. When working remotely, workers' perceptions of weak ties may suffer due to the lack of in-person interaction. On the other hand, workers' inferences about their strong ties may also be impacted by losing richer communication cues, even though they had more connections with their strong ties than weak ties. This study explores how remote workers make inferences about engagement levels of and willingness to collaborate with weak ties compared to strong ties. We used a mixed-methods approach involving survey data, experience sampling, and in-depth interviews with 20 workers from different companies in Taiwan. Results showed that workers depended on one-on-one synchronous tools to infer the engagement level of strong ties but used group-based communication tools to infer the engagement level of weak ties. Interestingly, the absence of cues in remote workplaces exacerbated prior impressions formed in the physical office. Furthermore, remote work led workers to develop polarized perceptions of their respective ties. We discuss how characteristics of computer-mediated communication tools and interaction types interplay to affect workers' perceptions of remote colleagues and identify design opportunities for helping remote workers maintain awareness of weak ties.