When an academic paper is published in a journal that assigns a digital object identifier (DOI) to papers, this is a de facto fait accompli. Corrections or retractions are supposed to follow a specific protocol, especially in journals that claim to follow the Committee on Publication Ethics (COPE) guidelines. In this paper, we highlight a case of a new, fully open access neuroscience journal that claims to be COPE-compliant, yet has silently retracted two papers since all records, bibliometrics, and PDF files related to their existence have been deleted from the journal's website. Although this phenomenon does not seem to be common in the neurosciences, we consider that any opaque corrective measures in journals whose papers could be cited may negatively impact the wider neuroscience literature and community. Instead, we encourage transparency in retraction to promote truthfulness and trustworthiness.