A development cycle for automated self-exploration of robot behaviors

  • Abstract
  • Highlights & Summary
  • References
  • Citations
  • Similar Papers
Abstract
Translate article icon Translate Article Star icon
Take notes icon Take Notes

In this paper we introduce Q-Rock, a development cycle for the automated self-exploration and qualification of robot behaviors. With Q-Rock, we suggest a novel, integrative approach to automate robot development processes. Q-Rock combines several machine learning and reasoning techniques to deal with the increasing complexity in the design of robotic systems. The Q-Rock development cycle consists of three complementary processes: (1) automated exploration of capabilities that a given robotic hardware provides, (2) classification and semantic annotation of these capabilities to generate more complex behaviors, and (3) mapping between application requirements and available behaviors. These processes are based on a graph-based representation of a robot’s structure, including hardware and software components. A central, scalable knowledge base enables collaboration of robot designers including mechanical, electrical and systems engineers, software developers and machine learning experts. In this paper we formalize Q-Rock’s integrative development cycle and highlight its benefits with a proof-of-concept implementation and a use case demonstration.

Highlights

  • Modern robotics has evolved into a collaborative endeavor, where various scientific and engineering disciplines are combined to create impressive synergies

  • Q-ROCK focuses on this integration to set up a new way of designing complex robots with the help of AI and with the knowledge that previous designers contributed to the knowledge base

  • With the use cases presented in this paper, we already demonstrated the functional coupling of all steps in Q-ROCK

Read more Highlights Expand/Collapse icon

Summary

IntroductionExpand/Collapse icon

Modern robotics has evolved into a collaborative endeavor, where various scientific and engineering disciplines are combined to create impressive synergies. Due to this increasingly interdisciplinary nature and the progress in sensor and actuator technologies, as well as computing hardware and AI methods, the capabilities and possible behaviors of robotic systems improved significantly in recent years. Engineers do have to deal with technical peculiarities of a rich variety of different components when constructing a robot They have to develop advanced control strategies and integrate knowledge from a range of disciplines in order to unlock the full potential regarding a robot’s capabilities

ObjectivesExpand/Collapse icon
FindingsExpand/Collapse icon
DiscussionExpand/Collapse icon
ConclusionExpand/Collapse icon
ReferencesShowing 10 of 27 papers
  • Open Access Icon
  • Cite Count Icon 47
  • 10.1609/aaai.v34i06.6542
HDDL: An Extension to PDDL for Expressing Hierarchical Planning Problems
  • Apr 3, 2020
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Daniel Höller + 6 more

  • Cite Count Icon 55
  • 10.1109/humanoids.2016.7803340
Dynamic movement primitives in latent space of time-dependent variational autoencoders
  • Nov 1, 2016
  • Nutan Chen + 2 more

  • Open Access Icon
  • Cite Count Icon 113
  • 10.1016/0885-2308(87)90026-x
Learning sets of filters using back-propagation
  • Mar 1, 1987
  • Computer Speech & Language
  • David C Plaut + 1 more

  • Cite Count Icon 8
  • 10.1109/biorob.2016.7523790
Model-based and experimental analysis of the symmetry in human walking in different device carrying modes
  • Jun 1, 2016
  • Shivesh Kumar + 4 more

  • Open Access Icon
  • Cite Count Icon 13457
  • 10.1109/tit.1982.1056489
Least squares quantization in PCM
  • Mar 1, 1982
  • IEEE Transactions on Information Theory
  • S Lloyd

  • Cite Count Icon 62
  • 10.1109/tro.2018.2830419
Computational Design of Robotic Devices From High-Level Motion Specifications
  • Oct 1, 2018
  • IEEE Transactions on Robotics
  • Sehoon Ha + 5 more

  • Open Access Icon
  • Cite Count Icon 58
  • 10.1109/icra.2018.8463154
Using a Memory of Motion to Efficiently Warm-Start a Nonlinear Predictive Controller
  • Sep 21, 2017
  • N Mansard + 4 more

  • Open Access Icon
  • Cite Count Icon 94
  • 10.1007/978-3-642-25116-0_9
Semantic Attachments for Domain-Independent Planning Systems
  • Jan 1, 2012
  • Christian Dornhege + 5 more

  • Cite Count Icon 7
  • 10.1007/978-3-030-30179-8_14
Automated Robot Skill Learning from Demonstration for Various Robot Systems
  • Jan 1, 2019
  • Lisa Gutzeit + 4 more

  • Open Access Icon
  • Cite Count Icon 29
  • 10.1609/socs.v5i1.18323
Hybrid Planning Heuristics Based on Task Decomposition Graphs
  • Sep 1, 2021
  • Proceedings of the International Symposium on Combinatorial Search
  • Pascal Bercher + 2 more

Similar Papers
  • Research Article
  • Cite Count Icon 1
  • 10.1115/1.3099350
JMD Editorial Board
  • Mar 24, 2009
  • Journal of Mechanical Design
  • Panos Y Papalambros

JMD Editorial Board

  • Book Chapter
  • Cite Count Icon 10
  • 10.1007/11786160_7
Unifying Hardware and Software Components for Embedded System Development
  • Jan 1, 2006
  • Christian Bunse + 1 more

Model-driven and component-based software development, using the UML, has become one of the dominant development paradigms, particularly in business and web application engineering. Unfortunately, model-driven and UML-based development methods are still inferior to conventional software development approaches when it comes to component-based embedded system development. One important aspect is the heterogeneity of embedded systems: they contain both, hardware and software components. Although, component-based development in embedded systems (with hardware components) has a long tradition, there is still a problem of combining it with component-based software development. One reason is the inability of contemporary component technologies to cope with the specific non-functional requirements of embedded systems (e.g., timing, resource consumption). Thus, the major question is how both approaches can be successfully combined.The goal of this chapter is to discuss the problems of embedded systems engineering in the context of a component-based development approach, and to identify specific requirements for a development process under this paradigm. In addition, the chapter proposes an approach to specify software and hardware components in a uniform way, concerning their functional and non-functional properties, so that they can be applied in embedded system development. The method proposed is not yet solving all the problems associated with component-based embedded systems development, but it addresses important issues like hardware/software integration, and how timing and resource issues can be dealt with.KeywordsUnify Modeling LanguageEmbed SystemHardware ComponentDevice DriverUnify Modeling Language DiagramThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 26
  • 10.3390/app12189156
Machine Learning Applications in Surface Transportation Systems: A Literature Review
  • Sep 13, 2022
  • Applied Sciences
  • Hojat Behrooz + 1 more

Surface transportation has evolved through technology advancements using parallel knowledge areas such as machine learning (ML). However, the transportation industry has not yet taken full advantage of ML. To evaluate this gap, we utilized a literature review approach to locate, categorize, and synthesize the principal concepts of research papers regarding surface transportation systems using ML algorithms, and we then decomposed them into their fundamental elements. We explored more than 100 articles, literature review papers, and books. The results show that 74% of the papers concentrate on forecasting, while multilayer perceptions, long short-term memory, random forest, supporting vector machine, XGBoost, and deep convolutional neural networks are the most preferred ML algorithms. However, sophisticated ML algorithms have been minimally used. The root-cause analysis revealed a lack of effective collaboration between the ML and transportation experts, resulting in the most accessible transportation applications being used as a case study to test or enhance a given ML algorithm and not necessarily to enhance a mobility or safety issue. Additionally, the transportation community does not define transportation issues clearly and does not provide publicly available transportation datasets. The transportation sector must offer an open-source platform to showcase the sector’s concerns and build spatiotemporal datasets for ML experts to accelerate technology advancements.

  • Research Article
  • 10.1287/inte.1110.0603
Contributors
  • Oct 1, 2011
  • Interfaces

Contributors

  • Research Article
  • 10.1177/03063127251364509
It's not a bug, it's a feature: How AI experts and data scientists account for the opacity of algorithms.
  • Sep 14, 2025
  • Social studies of science
  • Netta Avnoon + 1 more

The opacity of machine learning (ML) algorithms is a significant concern in academic and regulatory circles. An emergent sociology of algorithms, however, argues that far from opacity being an inherent quality of algorithms, it is socially constructed and contingent upon certain choices and decisions. In this article, we show that a valorization of opacity is a key component of the epistemic culture of ML experts. While earlier campaigns for mechanical objectivity contrasted the inconsistency of human experts with the reliability of procedures and machines, we found that ML experts valorize precisely those moments when complex algorithms 'surprised' them with unexpected outcomes. They thereby endowed machines with a mysterious capacity to make predictions based on calculations and factors that humans cannot grasp. In this way, they turned opacity from a problem into an epistemic virtue. We trace this valorization of opacity to the jurisdictional struggles through which ML expertise emerged and differentiated itself from its two competitors: the 'expert systems' type of the 'artificial intelligence' sub-field of computer science on the one hand and inferential statistics on the other. In the course of these struggles, ML experts absorbed a theory of human expertise as tacit and inarticulable, extended it to include algorithms, and then leveraged this newly acquired version of opacity to dramatize the differences that separated them from statisticians. The analysis is based on sixty in-depth, semi-structured, and open-ended interviews with ML experts and data scientists working today, as well as historical research on the origins of data science.

  • PDF Download Icon
  • Book Chapter
  • Cite Count Icon 17
  • 10.1007/978-3-030-29387-1_34
Using Expert Patterns in Assisted Interactive Machine Learning: A Study in Machine Teaching
  • Jan 1, 2019
  • Emily Wall + 2 more

Machine Teaching (MT) is an emerging practice where people, without Machine Learning (ML) expertise, provide rich information beyond labels in order to create ML models. MT promises to lower the barrier of entry to creating ML models by requiring a softer set of skills from users than having ML expertise. In this paper, we explore and show how end-users without MT experience successfully build ML models using the MT process, and achieve results not far behind those of MT experts. We do this by conducting two studies. We first investigated how MT experts build models, from which we extracted expert teaching patterns. In our second study, we observed end-users without MT experience create ML models with and without guidance from expert patterns. We found that all users built models comparable to those built by MT experts. Further, we observed that users who received guidance perceived the task to require less effort and felt less mental demand than those who did not receive guidance.

  • Research Article
  • Cite Count Icon 32
  • 10.1016/j.rineng.2022.100803
Anomaly detection in laser powder bed fusion using machine learning: A review
  • Nov 28, 2022
  • Results in Engineering
  • Tayyaba Sahar + 6 more

Anomaly detection in laser powder bed fusion using machine learning: A review

  • PDF Download Icon
  • Research Article
  • 10.4236/jsea.2016.910031
Development of a Wireless Environmental Data Acquisition Prototype Adopting Agile Practices: An Experience Report
  • Jan 1, 2016
  • Journal of Software Engineering and Applications
  • Paul Celicourt + 2 more

The traditional software development model commonly named “waterfall” is unable to cope with the increasing functionality and complexity of modern embedded systems. In addition, it is unable to support the ability for businesses to quickly respond to new market opportunities due to changing requirements. As a response, the software development community developed the Agile Methodologies (e.g., extreme Programming, Scrum) which were also adopted by the Embedded System community. However, failures and bad experiences in applying Agile Methodologies to the development of embedded systems have not been reported in the literature. Therefore, this paper contributes a detailed account of our first-time experiences adopting an agile approach in the prototype development of a wireless environment data acquisition system in an academic environment. We successfully applied a subset of the extreme Programming (XP) methodology to our software development using the Python programming language, an experience that demonstrated its benefits in shaping the design of the software and also increasing productivity. We used an incremental development approach for the hardware components and adopted a “cumulative testing” approach. For the overall development process management, however, we concluded that the Promise/Commitment-Based Project Management (PB-PM/CBPM) was better suited. We discovered that software and hardware components of embedded systems are best developed in parallel or near-parallel. We learned that software components that pass automated tests may not survive in the tests against the hardware. Throughout this rapid prototyping effort, factors like team size and our availability as graduate students were major obstacles to fully apply the XP methodology.

  • Research Article
  • Cite Count Icon 13
  • 10.1109/tie.2013.2254095
Context Generator and Behavior Translator in a Multilayer Architecture for a Modular Development Process of Cyber-Physical Robot Systems
  • Feb 1, 2014
  • IEEE Transactions on Industrial Electronics
  • Seung-Hwan Choi + 3 more

Robot systems are developed using various hardware and software components. In conventional design methodology, each hardware component and its software are strongly coupled such that it is not easy to replace or expand them separately. For the independent development and replacement of hardware and software components, this paper proposes a novel robot development methodology based on the abstractions of software and hardware components in a multilayer architecture for cyber-physical robot systems which conjoin computational and physical resources. We introduce a context generator and a behavior translator for the abstractions in the multilayer architecture. The context generator converts sensory value data into contexts using context scripts. The behavior translator converts a behavior, selected by a software agent that is a computer program deciding an action of a robot, into a sequence of actuator commands for robots using behavior scripts. These together enable two levels of abstraction in which software and hardware components can be developed independently of each other. As a result, software agents can work flawlessly even if hardware components are replaced and vice versa. The effectiveness and applicability of the proposed methodology are demonstrated through experiments, and the related applications are provided.

  • Conference Article
  • Cite Count Icon 1
  • 10.1117/12.287642
<title>Symmetry breaking as a model for emergent structure of heterogeneous networked robotic agents</title>
  • Sep 22, 1997
  • Gerard T Mckee + 1 more

This paper explores the design of robot systems to take advantage of non-linear dynamic systems models, specifically symmetry breaking phenomena, to self-organize in response to task and environment demands. Recent research in the design of robotics systems has stressed modular, adaptable systems operating under decentralized and distributed control architectures. Cooperative and emergent behavioral structures can be built on these modules by exploiting various forms of communication and negotiation strategies. We focus on the design of individual modules and their cooperative interaction. We draw on nonlinear dynamic system models of human and animal behavior to motivate issues in the design of robot modules and systems. Sonar sensing systems comprising a ring of sonar sensors are used to illustrate the ideas within a networked robotics context, where distributed sensing modules located on multiple robots can interact cooperatively to scan an environment.© (1997) COPYRIGHT SPIE--The International Society for Optical Engineering. Downloading of the abstract is permitted for personal use only.

  • Conference Article
  • Cite Count Icon 24
  • 10.1145/3472749.3474734
Marcelle: Composing Interactive Machine Learning Workflows and Interfaces
  • Oct 10, 2021
  • Jules Françoise + 2 more

Human-centered approaches to machine learning have established theoretical foundations, design principles and interaction techniques to facilitate end-user interaction with machine learning systems. Yet, general-purpose toolkits supporting the design of interactive machine learning systems are still missing, despite their potential to foster reuse, appropriation and collaboration between different stakeholders including developers, machine learning experts, designers and end users. In this paper, we present an architectural model for toolkits dedicated to the design of human interactions with machine learning. The architecture is built upon a modular collection of interactive components that can be composed to build interactive machine learning workflows, using reactive pipelines and composable user interfaces. We introduce Marcelle, a toolkit for the design of human interactions with machine learning that implements this model. We illustrate Marcelle with two implemented case studies: (1) a HCI researcher conducts user studies to understand novice interaction with machine learning, and (2) a machine learning expert and a clinician collaborate to develop a skin cancer diagnosis system. Finally, we discuss our experience with the toolkit, along with its limitation and perspectives.

  • Research Article
  • Cite Count Icon 1
  • 10.3390/machines12090625
On the Integration of Complex Systems Engineering and Industry 4.0 Technologies for the Conceptual Design of Robotic Systems
  • Sep 6, 2024
  • Machines
  • Jaime Alonso Restrepo-Carmona + 5 more

This paper presents a novel integration of Systems Engineering (SE) methodologies and Industry 4.0 (I4.0) technologies in the design of robotic systems, focusing on enhancing underwater robotic missions. Using the conceptual design of an underwater exploration vehicle as a case study, we demonstrate how SE can systematically incorporate I4.0 tools to improve mission performance and meet stakeholder expectations. The study begins with an overview of the SE approach, emphasizing the conceptual design stage and aligning it with the application and case study of design theories. We then explore various I4.0 technologies, highlighting their functional benefits rather than technical specifics and addressing design methods for I4.0. Remotely Operated Vehicles (ROVs) are examined in terms of classification, components, and tasks, showcasing their evolution driven by technological advancements, thus tackling the complexity and design of complex systems. The core of our study involves defining stakeholder expectations, using quality function deployment for requirements definition, and performing a functional and logical decomposition of the ROV system. To deal with design fixation within the design team, we developed a tool to help integrate new technologies by also empathizing with their functional capabilities rather than the technology itself. Our approach underscores the importance of understanding and incorporating new technologies functionally, aligning with the transition towards Industry/Society 5.0. This work not only illustrates the synergy between SE and I4.0, but also offers a structured methodology for advancing the design and functionality of complex systems, setting a blueprint for future developments in this field.

  • Conference Article
  • Cite Count Icon 54
  • 10.1109/esem.2019.8870187
Why is Developing Machine Learning Applications Challenging? A Study on Stack Overflow Posts
  • Sep 1, 2019
  • Moayad Alshangiti + 4 more

As smart and automated applications pervade our lives, an increasing number of software developers are required to incorporate machine learning (ML) techniques into application development. However, acquiring the ML skill set can be nontrivial for software developers owing to both the breadth and depth of the ML domain. Aims: We seek to understand the challenges developers face in the process of ML application development and offer insights to simplify the process. Despite its importance, there has been little research on this topic. A few existing studies on development challenges with ML are outdated, small scale, or they do no involve a representative set of developers. Method: We conduct an empirical study of ML-related developer posts on Stack Overflow. We perform in-depth quantitative and qualitative analyses focusing on a series of research questions related to the challenges of developing ML applications and the directions to address them. Results: Our findings include: (1) ML questions suffer from a much higher percentage of unanswered questions on Stack Overflow than other domains; (2) there is a lack of ML experts in the Stack Overflow QA community; (3) the data preprocessing and model deployment phases are where most of the challenges lay; and (4) addressing most of these challenges require more ML implementation knowledge than ML conceptual knowledge. Conclusions: Our findings suggest that most challenges are under the data preparation and model deployment phases, i.e., early and late stages. Also, the implementation aspect of ML shows much higher difficulty level among developers than the conceptual aspect.

  • Research Article
  • Cite Count Icon 1
  • 10.13182/nt89-a27707
Authors
  • Nov 1, 1989
  • Nuclear Technology
  • Michael J Kelley + 25 more

Authors

  • Research Article
  • 10.1162/dint_x_00187
About The Author
  • Oct 1, 2022
  • Data Intelligence

About The Author

More from: AI Perspectives
  • Open Access Icon
  • Research Article
  • Cite Count Icon 21
  • 10.1186/s42467-021-00014-x
Human-centered AI and robotics
  • Jan 28, 2022
  • AI Perspectives
  • Stephane Doncieux + 3 more

  • Open Access Icon
  • PDF Download Icon
  • Research Article
  • Cite Count Icon 39
  • 10.1186/s42467-021-00012-z
Object detection for automotive radar point clouds \u2013 a comparison
  • Nov 16, 2021
  • AI Perspectives
  • Nicolas Scheiner + 4 more

  • Research Article
  • Cite Count Icon 4
  • 10.1186/s42467-021-00013-y
Study of environmental data from vehicle\u2019s sensors and its aplicability to complement climate mapping from automatic meteorological stations and assess covid-19 impact
  • Oct 15, 2021
  • AI Perspectives
  • Philippe Cedraz Lopes + 3 more

  • Open Access Icon
  • Research Article
  • Cite Count Icon 16
  • 10.1186/s42467-021-00010-1
Supply chain resilience and industry 4.0: a evaluation of the Brazilian northeast automotive OEM scenario post COVID-19
  • Aug 2, 2021
  • AI Perspectives
  • Milton C Soares + 2 more

  • Open Access Icon
  • PDF Download Icon
  • Research Article
  • Cite Count Icon 25
  • 10.1186/s42467-021-00009-8
CLeaR: An adaptive continual learning framework for regression tasks
  • Jul 16, 2021
  • AI Perspectives
  • Yujiang He + 1 more

  • Open Access Icon
  • Research Article
  • Cite Count Icon 1
  • 10.1186/s42467-021-00008-9
A development cycle for automated self-exploration of robot behaviors
  • Jul 5, 2021
  • AI Perspectives
  • Thomas M Roehr + 9 more

  • Open Access Icon
  • Research Article
  • 10.1186/s42467-021-00011-0
Feasibility analysis on the construction of a web solution for hydrometeorological forecasting considering water body management and indicators for the SARS-COV-2 pandemic
  • Jan 1, 2021
  • AI Perspectives
  • José Roberto Dantas Da Silva Júnior + 8 more

  • Open Access Icon
  • PDF Download Icon
  • Discussion
  • Cite Count Icon 1
  • 10.1186/s42467-020-00007-2
Can an AI learn political theory?
  • Oct 7, 2020
  • AI Perspectives
  • Stephen J Decanio

  • Open Access Icon
  • PDF Download Icon
  • Research Article
  • Cite Count Icon 8
  • 10.1186/s42467-020-00006-3
AI-perspectives: the Turing option
  • Sep 4, 2020
  • AI Perspectives
  • Frank Kirchner

  • Open Access Icon
  • PDF Download Icon
  • Research Article
  • Cite Count Icon 64
  • 10.1186/s42467-020-00005-4
Applications of AI in classical software engineering
  • Jul 26, 2020
  • AI Perspectives
  • Marco Barenkamp + 2 more

Save Icon
Up Arrow
Open/Close
  • Ask R Discovery Star icon
  • Chat PDF Star icon

AI summaries and top papers from 250M+ research sources.

Search IconWhat is the difference between bacteria and viruses?
Open In New Tab Icon
Search IconWhat is the function of the immune system?
Open In New Tab Icon
Search IconCan diabetes be passed down from one generation to the next?
Open In New Tab Icon