Viral and cellular particles too large to freely diffuse have two different types of mobility in the eukaryotic cell cytoplasm: directed motion mediated by motor proteins moving along cytoskeletal elements with the particle as its load, and motion in random directions mediated by motor proteins interconnecting cytoskeletal elements. The latter motion is referred to as "active diffusion." Mechanisms of directed motion have been extensively studied compared to mechanisms of active diffusion, despite the observation that active diffusion is more common for many viral and cellular particles. Our previous research showed that active diffusion of vesicular stomatitis virus (VSV) ribonucleoproteins (RNPs) in the cytoplasm consists of hopping between traps and that actin filaments and myosin II motors are components of the hop-trap mechanism. This raises the question whether similar mechanisms mediate random motion of larger particles with different physical and biological properties. Live-cell fluorescence imaging and a variational Bayesian analysis used in pattern recognition and machine learning were used to determine the molecular mechanisms of random motion of VSV inclusion bodies and cellular early endosomes. VSV inclusion bodies are membraneless cellular compartments that are the major sites of viral RNA synthesis, and early endosomes are representative of cellular membrane-bound organelles. Like VSV RNPs, inclusion bodies and early endosomes moved from one trapped state to another, but the distance between states was inconsistent with hopping between traps, indicating that the apparent state-to-state movement is mediated by trap movement. Like VSV RNPs, treatment with the actin filament depolymerizing inhibitor latrunculin A increased VSV inclusion body mobility by increasing the size of the traps. In contrast neither treatment with latrunculin A nor depolymerization of microtubules by nocodazole treatment affected the size of traps that confine early endosome mobility, indicating that intermediate filaments are likely major trap components for these cellular organelles.