Primary angiosarcoma of the spleen (PAS), an exceptionally rare and aggressive neoplasm with high metastatic risk (70%-85%), is frequently diagnosed in an advanced or metastatic stage. It presents diagnostic challenges due to its nonspecific symptomatology and resemblance to benign vascular lesions in various imaging modalities. This case series aims to clarify the diagnostic difficulties by comparing imaging characteristics (CT-scan, MRI, and [18F]FDG-PET/CT) as well as pathological findings of three PAS cases diagnosed in different stages of the diseases (localized, metastatic, and metastatic with organ failure). Furthermore, a brief review on diagnostic and therapeutic features is included. We suggest [18F]FDG-PET/CT as a differentiating tool between benign and malignant splenic lesions and propose a flowchart of a diagnostic algorithm for PAS. For treatment, we advocate for early splenectomy and when systemic therapy is warranted, paclitaxel emerges as a viable first-line option. While it is crucial to acknowledge that further trial data is required to evaluate the efficacy of emerging treatment regimens, designing and conducting trials for PAS is challenging given its scarcity and aggressive behavior. Therefore case reporting remains important.