Time-of-flight (TOF) is now a standard technology for positron emission tomography (PET), but its effective use for small diameter PET systems has not been studied well. In this paper, we simulated a brain-dedicated TOF-PET system with a hemispherical detector arrangement. We modeled a Hamamatsu TOF-PET module (C13500-4075LC-12) with 280 ps coincidence resolving time (CRT), in which a 12 × 12 array of multi pixel photon counters (MPPCs) is connected to a lutetium fine silicate (LFS) crystal array of 4.1 × 4.1 mm2 cross section each, based on one-to-one coupling. On the other hand, spatial resolution degradation due to the parallax error should be carefully addressed for the small diameter PET systems. The ideal PET detector would have both depth-of-interaction (DOI) and TOF capabilities, but typical DOI detectors that are based on light sharing tend to degrade TOF performance. Therefore, in this work, we investigated non-DOI detectors with an appropriate crystal length, which was a compromise between suppressed parallax error and decreased sensitivity. Using GEANT4, we compared two TOF detectors, a 20 mm long non-DOI and a 10 mm long non-DOI, with a non-TOF, 4-layer DOI detector with a total length of 20 mm (i.e. 5 × 4 mm). We simulated a contrast phantom and evaluated the relationship between the contrast recovery coefficient (CRC) and the noise level (the coefficient of variation, COV) for reconstructed images. The 10 mm long non-DOI, which reduces the parallax error at the cost of sensitivity loss, showed better imaging quality than the 20 mm long non-DOI. For example, the CRC value of a 10 mm hot sphere at COV = 20% was 72% for the 10 mm long non-DOI, which was 1.2 times higher than that of the 20 mm long non-DOI. The converged CRC values for the 10 mm long non-DOI were almost equivalent to those of the non-TOF 4-layer DOI, and the 10 mm long non-DOI converged faster than the non-TOF 4-layer DOI did. Based on the simulation results, we evaluated a one-pair prototype system of the TOF-PET detectors with 10 mm crystal length, which yielded the CRT of 250 ± 8 ps. In summary, we demonstrated support for feasibility of the brain-dedicated TOF-PET system with the hemispherical detector arrangement.