Promotion of research and development in advanced technology must be implemented in agriculture to increase production in the current challenging environment where the demand for manual farming is decreasing due to the unavailability of skilled labor, high cost, and shortage of labor. In the last two decades, the demand for fruit harvester technologies, i.e., mechanized harvesting, manned and unmanned aerial systems, and robotics, has increased. However, several industries are working on the development of industrial-scale production of advanced harvesting technologies at low cost, but to date, no commercial robotic arm has been developed for selective harvesting of valuable fruits and vegetables, especially within controlled strictures, i.e., greenhouse and hydroponic contexts. This research article focused on all the parameters that are responsible for the development of automated robotic arms. A broad review of the related research works from the past two decades (2000 to 2022) is discussed, including their limitations and performance. In this study, data are obtained from various sources depending on the topic and scope of the review. Some common sources of data for writing this review paper are peer-reviewed journals, book chapters, and conference proceedings from Google Scholar. The entire requirement for a fruit harvester contains a manipulator for mechanical movement, a vision system for localizing and recognizing fruit, and an end-effector for detachment purposes. Performance, in terms of harvesting time, harvesting accuracy, and detection efficiency of several developments, has been summarized in this work. It is observed that improvement in harvesting efficiency and custom design of end-effectors is the main area of interest for researchers. The harvesting efficiency of the system is increased by the implementation of optimal techniques in its vision system that can acquire low recognition error rates.