Adoption of Collaborative Robotics in Fruit Harvesting

  • TL;DR
  • Abstract
  • Literature Map
  • Similar Papers
TL;DR

This study develops models and algorithms for collaborative multi-agent robots in fruit harvesting, employing game theory, machine learning, and risk-aware control, resulting in improved task coordination, safety, and adaptability, with simulation showing enhanced performance and reduced conflicts in dynamic agricultural environments.

Abstract
Translate article icon Translate Article Star icon

Collaborative robotics in agriculture is designed to automate labor-intensive processes. In contrast to traditional autonomous systems, collaborative multi-agent robotic systems require active interaction between robots and human operators. This interaction creates the need for new methods for coordination, adaptation, and safety assurance in uncertain and dynamically changing environments. ( Research purpose ) The study aims to develop both theoretical and practical approaches to modeling the behavior and control of collaborative multi-agent robotic systems. The primary objective is to ensure efficient task allocation, coordinated agent behavior, and safe human-robot interaction during fruit harvesting operations. ( Materials and methods ) To achieve these objectives, the study employed methods from game theory, machine learning, and risk-aware control. A mathematical model was developed to describe the interactions among agents, incorporating the probabilistic nature of the environment and the involvement of a human operator. The proposed solutions were validated through a combination of numerical simulations and experimental data collected from a testbed replicating real-world agricultural scenarios. ( Results and discussion ) Algorithms were developed to enable coordination, adaptation, and dynamic task redistribution within the collaborative multi-agent robotic system. These algorithms demonstrated robustness against sensor inaccuracies, communication delays, and external disturbances typical of agricultural settings. Special attention was given to the system’s ability to adapt to human operator inputs, including task prioritization and context-sensitive interaction strategies. Simulation results showed enhanced system performance, characterized by more balanced task distribution among robots, reduced conflict during joint operations, and minimized idle time. Safety metrics also improved, including a reduction in collision risks and fewer incorrect responses to the presence of human operators in the work area. ( Conclusions ) The developed models and algorithms provide a foundation for the design of intelligent collaborative multi-agent robotic systems capable of adaptive and safe interaction in agricultural production. Their application can enhance the efficiency of automated harvesting processes while reducing reliance on manual labor.

Similar Papers
  • Research Article
  • Cite Count Icon 4
  • 10.17587/mau.21.404-411
Collaborative Multiagent Systems — an Alternative to Full Automation of Production
  • Jul 7, 2020
  • Mekhatronika, Avtomatizatsiya, Upravlenie
  • V V Serebrenny

The paper proposes a new approach as an alternative to full automation of processes that meets current economic trends — collaborative multi-agent systems. In this concept, people and robots are considered as agents in a single sensory-information field, who perform tasks to achieve the goals of the collaborative multi-agent system. The urgency of collaborative multi-agent systems results from the fact that the industrial use of fully automated multi-component systems is limited by the financial and infrastructural unavailability of various industries to switch to completely unmanned technologies. The proposed approach combines the latest, but remaining quite recouped, technological advances along with highly skilled human labor. The use of collaborative multi-agent systems will be economically justified in the manufacture of products in small batches, in the conditions of rapid change of product lines, as well as the presence of staff shortages. The article shows that such an approach can significantly reduce automation costs, while ensuring that the specified production indicators are met. This approach allows taking a fresh look at a human, considering him and a robot as equal partners within a collaborative system. The basic concepts and distinctive characteristics of collaborative multi-agent systems are formulated and presented in the work, justifications for their use are given. Creating a new class of collaborative multi-agent systems requires solving a number of problems associated with the interaction of man and robot. The article considers issues related to the work of a person within a collaborative system, with a rational separation of human functions and an automated production system, in accordance with the necessary level of collaboration. The inclusion of a person with his psychoemotional and physical characteristics as an equivalent agent of a multi-agent system causes difficulties in formalizing collaborative multi-agent systems associated with the need to take these features into account and create a sensory-information system. The inclusion of a person with his psychoemotional and physical characteristics as an equivalent agent of a multi-agent system causes difficulties in formalizing collaborative multi-agent systems associated with the need to take these features into account and create a sensory-information system. The paper discusses ways to formalize a collaborative multi-agent system and management approaches.

  • Research Article
  • Cite Count Icon 3
  • 10.1016/j.procs.2021.04.201
Multicriterial analyses of Pareto-efficiency for collaborative multi-agent systems using genetic algorithm with variations
  • Jan 1, 2021
  • Procedia Computer Science
  • Vladimir Serebrenny + 1 more

Multicriterial analyses of Pareto-efficiency for collaborative multi-agent systems using genetic algorithm with variations

  • Research Article
  • Cite Count Icon 27
  • 10.1016/j.rcim.2022.102358
On the perception and handling of deformable objects – A robotic cell for white goods industry
  • Oct 1, 2022
  • Robotics and Computer-Integrated Manufacturing
  • D Andronas + 6 more

On the perception and handling of deformable objects – A robotic cell for white goods industry

  • Book Chapter
  • 10.1007/978-3-319-33509-4_6
Graph Patterns, Reinforcement Learning and Models of Reputation for Improving Coalition Formation in Collaborative Multi-agent Systems
  • Jan 1, 2016
  • Predrag T Tošić

We outline a new model of multi-agent coalition formation which focuses on how collaborative agents can improve their coalition formation skills over time, learning from their prior interactions. The proposed research direction builds on our prior work on distributed coalition formation in collaborative multi-agent systems (MAS), centered at partitioning the underlying network of agents into non-overlapping cliques. At the core of that prior research is the MCDCF algorithm which provides a semantically simple, fully decentralized, local and (for sufficiently sparse networks) scalable mechanism for multi-agent coalition formation [1, 2, 3]. Our goal is to extend the MCDCF-based coalition formation along several new dimensions. First, we want to consider candidate coalitions that (i) no longer have to be cliques but can be more general types of (connected) subgraphs, and (ii) that also satisfy additional, more complex “compatibility” properties stemming from individual agents’ capabilities and preferences. Second, we begin exploration of semantically more rich and versatile ways of capturing this inter-agent compatibility than what’s found in the existing literature. In particular, we propose applying graph pattern techniques to capture a variety of qualitative “compatibility relationships” among agents. Next, we revisit approaches to and benefits of reinforcement learning (RL) in the context of autonomous agents repeatedly engaging in coalition formation. Last but not least, we discuss benefits of each agent maintaining other agents’ reputations that quantify those agents’ coalition formation effectiveness in the past. With these extensions, we argue that the resulting modeling framework adequately captures core aspects of a much richer class of multi-agent coalition formation scenarios, as well as, more broadly, of a variety of distributed consensus reaching problems in collaborative MAS.

  • Research Article
  • Cite Count Icon 24
  • 10.1016/j.procs.2010.04.248
A unified framework for reinforcement learning, co-learning and meta-learning how to coordinate in collaborative multi-agent systems
  • May 1, 2010
  • Procedia Computer Science
  • Predrag T Tošić + 1 more

A unified framework for reinforcement learning, co-learning and meta-learning how to coordinate in collaborative multi-agent systems

  • Conference Article
  • Cite Count Icon 4
  • 10.1109/robio54168.2021.9739448
Passive Instrument Holder for Collaborative Robotic Nursing Applications - Automatically Designed and 3D-printed
  • Dec 27, 2021
  • Christoph A W Parhofer + 2 more

In the medical field - especially in nursing - collaborative robotic systems are rarely used as they are not yet a real facilitator in practical application. However, the increased use of such systems would be particularly valuable due to the shortage of skilled workers in this field. The systems must become easier to use and more flexible in application for the mostly non-technical users. A simple and safe interaction with the robotic end effectors is especially important, because in collaborative systems the caregiver or patient are in direct contact with them.To advance collaborative robotics for nursing, an instrument holder was developed as end effector, under consultation of the target group. It was indicated by them that less complex systems are preferred. In addition, solutions that give the user direct visual and haptic feedback and promise simple correction options for the alignment of the instrument were selected. The outcome is based on a passive (no actuators) bistable clamping principle. It is activated by pressing the instrument onto two flexible belts through which they wrap around the handle. The design process was automated essentially by setting the handle geometry in relation to a cubic Bezier curve.In a first application "hair blow-drying with severely limited shoulder mobility" it was shown, that this passive bistable instrument holder can be a facilitator for nontechnical users. The instrument is pressed into the holder and then held in the desired position. Together with a robot, it can additionally be moved. In operation the holder was intuitive to users and saved time and physical effort. It would also be able to assist in similar tasks. For more complicated tasks or people in need of more intensive care, it is worthwhile to further research this collaborative system and expand it with sensors and independent grasping techniques.

  • Research Article
  • Cite Count Icon 123
  • 10.1016/j.cie.2021.107189
An experimental human-robot collaborative disassembly cell
  • Mar 2, 2021
  • Computers & Industrial Engineering
  • Jun Huang + 13 more

An experimental human-robot collaborative disassembly cell

  • Research Article
  • Cite Count Icon 3
  • 10.1088/1742-6596/1547/1/012016
Acquisition and evaluation of depth data from humans, in robotized industrial environments
  • May 1, 2020
  • Journal of Physics: Conference Series
  • W Nieto + 2 more

Industry 4.0 places great importance on collaborative robotics in industrial production and, therefore, on the safe interaction between humans and robots. In previous decades, robots that were part of flexible manufacturing systems remained isolated from human operators through physical enclosures, but current human-robot collaboration activities require a simultaneous concurrent workspace for both actors. Collaborative robotics security systems have used (among others) artificial vision systems based on red, green and blue additive color model images, as proven solutions in detecting humans within the work area of robots. In recent work, the combination of red, green, and blue additive color model imaging with depth imaging systems has demonstrated low sensitivity to lighting changes and a high positional match between distance data and color pixels in both types of acquired images. However, a detailed review resulted in the absence of databases of industrial robotic environments in this type of images. In this paper, an extensive database is delivered in the format already explained that contains people in robotic industrial settings. Furthermore, evaluating the database using machine learning techniques enables computer vision researchers to gain a better understanding of human detection using a Kinect sensor and convolutional neural networks.

  • Book Chapter
  • Cite Count Icon 7
  • 10.1007/3-540-47772-1_6
An Architecture for Modeling Internet-based Collaborative Agent Systems
  • Jan 1, 2001
  • Roberto A Flores + 2 more

This paper describes an architecture for modeling cooperating systems of communicating agents. The authors' goal is not that of providing a framework to implement multi-agents systems (there are tools--such as CORBA, Java and DCOM--that do an excellent job on that), but rather to provide an architectural metaphor upon which collaborative multi-agent systems could be modeled. The approach is based on requirements defined with a practical view of the communicational and resource-oriented nature of distributed collaborative multi-agent systems.

  • Research Article
  • Cite Count Icon 27
  • 10.3390/agriculture13010018
Agricultural Robot under Solar Panels for Sowing, Pruning, and Harvesting in a Synecoculture Environment
  • Dec 21, 2022
  • Agriculture
  • Takuya Otani + 10 more

Currently, an agricultural method called SynecocultureTM has been receiving attention as a means for multiple crop production and recovering from environmental degradation; it helps in regreening the environment and establishing an augmented ecosystem with high biodiversity. In this method, several types of plants are grown densely, and their management relies mainly on manual labor, since conventional agricultural machines and robots cannot be applied in complex vegetation. To improve work efficiency and boost regreening by scaling-up Synecoculture, we developed a robot that can sow, prune, and harvest in dense and diverse vegetation that grows under solar panels, towards the achievement of compatibility between food and energy production on a large scale. We adopted a four-wheel mechanism with sufficient ability to move on uneven terrain, and a two orthogonal axes mechanism with adjusted tool positioning while performing management tasks. In the field experiment, the robot could move straight on shelving slopes and overcome obstacles, such as small steps and weeds, and succeeded in harvesting and weeding with human operation, using the tool maneuver mechanism based on the recognition of the field situation through camera image.

  • Book Chapter
  • Cite Count Icon 1
  • 10.1007/978-3-540-69995-8_65
A Framework for Truth Maintenance in Multi-Agent Systems
  • Jan 1, 2007
  • Brett Bojduj + 2 more

Maintaining logical consistency in a knowledge base that receives asynchronous events from collaborative agents poses a challenge, due to multiple agent perspectives of the knowledge base. Facades and filters further complicate this problem by distorting the definition of consistent knowledge. Therefore, maintaining logical consistency of the knowledge base requires an infrastructure for handling truth maintenance. This paper presents a generic, object-oriented framework for truth maintenance in collaborative multi-agent systems. The core of the framework is an agent that autonomously reasons on system events, thus guaranteeing the integrity of the knowledge base independent of external agents. Specialization to a particular domain is achieved through the description of tests that verify the consistency of the knowledge base. This paper shows an example of this approach in a real-world, multi-agent system and discusses performance and maintainability in such a system.

  • Research Article
  • 10.5555/1622673.1622676
Graphical model inference in optimal control of stochastic multi-agent systems
  • May 1, 2008
  • Journal of Artificial Intelligence Research
  • Van Den Broekbart + 2 more

In this article we consider the issue of optimal control in collaborative multi-agent systems with stochastic dynamics. The agents have a joint task in which they have to reach a number of target s...

  • Research Article
  • Cite Count Icon 93
  • 10.1613/jair.2473
Graphical Model Inference in Optimal Control of Stochastic Multi-Agent Systems
  • May 16, 2008
  • Journal of Artificial Intelligence Research
  • B Van Den Broek + 2 more

In this article we consider the issue of optimal control in collaborative multi-agent systems with stochastic dynamics. The agents have a joint task in which they have to reach a number of target states. The dynamics of the agents contains additive control and additive noise, and the autonomous part factorizes over the agents. Full observation of the global state is assumed. The goal is to minimize the accumulated joint cost, which consists of integrated instantaneous costs and a joint end cost. The joint end cost expresses the joint task of the agents. The instantaneous costs are quadratic in the control and factorize over the agents. The optimal control is given as a weighted linear combination of single-agent to single-target controls. The single-agent to single-target controls are expressed in terms of diffusion processes. These controls, when not closed form expressions, are formulated in terms of path integrals, which are calculated approximately by Metropolis-Hastings sampling. The weights in the control are interpreted as marginals of a joint distribution over agent to target assignments. The structure of the latter is represented by a graphical model, and the marginals are obtained by graphical model inference. Exact inference of the graphical model will break down in large systems, and so approximate inference methods are needed. We use naive mean field approximation and belief propagation to approximate the optimal control in systems with linear dynamics. We compare the approximate inference methods with the exact solution, and we show that they can accurately compute the optimal control. Finally, we demonstrate the control method in multi-agent systems with nonlinear dynamics consisting of up to 80 agents that have to reach an equal number of target states.

  • Book Chapter
  • Cite Count Icon 6
  • 10.1007/978-3-642-35236-2_10
Distributed Protocols for Multi-Agent Coalition Formation: A Negotiation Perspective
  • Jan 1, 2012
  • Predrag T Tošić + 1 more

We investigate collaborative multi-agent systems and how they can use simple, scalable negotiation protocols to coordinate in a fully decentralized manner. Specifically, we study multi-agent distributed coalition formation. We summarize our past and ongoing research on collaborative coalition formation and describe our original distributed coalition formation algorithm. The present paper focuses on negotiation-based view of coalition formation in collaborative Multi-Agent Systems (MAS). While negotiation protocols have been extensively studied in the context of competitive, self-interested agents, we argue that negotiation-based approach may be potentially very useful in the context of collaborative agents, as well – as long as those agents, due to limitations of their sensing and communication abilities, have different views of and preferences over the states of the world. In particular, we show that our coalition formation algorithm has several important, highly desirable properties when viewed as a negotiation protocol.Keywordscollaborative multi-agent systemsmulti-agent coordinationnegotiation protocolscoalition formationdistributed consensus

  • Conference Article
  • Cite Count Icon 2
  • 10.1109/milcom.2008.4753583
A study of Multiagent System operation within dynamic ad hoc networks
  • Nov 1, 2008
  • Justin W Dean + 2 more

Two enabling technologies for envisioned tactical network systems are mobile ad hoc network (MANET) routing and collaborative multiagent systems (MAS). Despite their respective technical value in enabling more distributed, autonomous networking, open research and engineering questions remain regarding robust interoperation, standardization, and design of these two technologies. Little work has been done to date to examine the interaction and performance of distributed agent designs within MANET environments. This paper examines the interactions and effects of running a team of belief-desire-intention (BDI) agents within a wireless network using emerging MANET protocol frameworks. The focus of the interagent communication model applied in this study is a form of MANET multicast routing and is aimed at improving group-based agent collaboration. The developed simulation testing environment is specified and results from various experiments are discussed. We present recent results examining overall MAS task performance vs. related knowledge loss induced by the underlying MANET network disruptions. We conclude by outlining several open issues and areas of further work.

Save Icon
Up Arrow
Open/Close