Sarcoidosis is a multisystem granulomatous syndrome that arises from a persistent immune response to a triggering antigen(s). There is no “gold standard” test or algorithm for the diagnosis of sarcoidosis, making the diagnosis one of exclusion. The presentation of the disease varies substantially between individuals, in both the number of organs involved, and the manifestations seen in individual organs. These qualities dictate that health care providers diagnosing sarcoidosis must consider a wide range of possible alternative diagnoses, from across a range of presentations and medical specialties (infectious, inflammatory, cardiac, neurologic). Current guideline-based diagnosis of sarcoidosis recommends fulfillment of three criteria: 1) compatible clinical presentation and/or imaging 2) demonstration of granulomatous inflammation by biopsy (when possible) and, 3) exclusion of alternative causes, but do not provide guidance on standardized strategies for exclusion of alternative diagnoses. In this review, we provide a summary of the most common differential diagnoses for sarcoidosis involvement of lung, eye, skin, central nervous system, heart, liver, and kidney. We then propose a framework for testing to exclude alternative diagnoses based on pretest probability of sarcoidosis, defined as high (typical findings with sarcoidosis involvement confirmed in another organ), moderate (typical findings in a single organ), or low (atypical/findings suggesting of an alternative diagnosis). This work highlights the need for informed and careful exclusion of alternative diagnoses in sarcoidosis.