ASME

Journal of Computing and Information Science in Engineering

August 2022 Spotlight: Knowledge Acquisition of Self-Organizing Systems With Deep Multiagent Reinforcement Learning

Share This Post

On August 16, 2022, during IDETC-CIE 2022, JCISE presented the journal spotlight by Yan Jin (University of Southern California) based on his paper: Ji, Hao, and Jin, Yan, “Knowledge Acquisition of Self-Organizing Systems With Deep Multiagent Reinforcement Learning,” ASME. J. Comput. Inf. Sci. Eng. April 2022; 22(2): 021010. https://doi.org/10.1115/1.4052800

Abstract: Self-organizing systems (SOS) can perform complex tasks in unforeseen situations with adaptability. Previous work has introduced field-based approaches and rule-based social structuring for individual agents to not only comprehend the task situations but also take advantage of the social rule-based agent relations to accomplish their tasks without a centralized controller. Although the task fields and social rules can be predefined for relatively simple task situations, when the task complexity increases and the task environment changes, having a priori knowledge about these fields and the rules may not be feasible. In this paper, a multiagent reinforcement learning (RL) based model is proposed as a design approach to solving the rule generation problem with complex SOS tasks. A deep multiagent reinforcement learning algorithm was devised as a mechanism to train SOS agents for knowledge acquisition of the task field and social rules. Learning stability, functional differentiation, and robustness properties of this learning approach were investigated with respect to the changing team sizes and task variations. Through computer simulation studies of a box-pushing problem, the results have shown that there is an optimal range of the number of agents that achieves good learning stability; agents in a team learn to differentiate from other agents with changing team sizes and box dimensions; the robustness of the learned knowledge shows to be stronger to the external noises than with changing task constraints.

GO TO ASME DIGITAL COLLECTION

Visit the ASME Digital Collection archives for JCISE

More To Explore

Announcements

Special Issue on Geometric Data Processing and Analysis for Advanced Manufacturing

Geometric information, such as three-dimensional (3D) shapes and network topologies, has been increasingly explored in manufacturing research. For example, characterizing geometric information in 3D-printed parts, in-situ or ex-situ, opens opportunities for defect detection, quality improvement, and product customization. However, geometric data mining remains critically challenging. Geometric information is embedded in complex data structures, such as 3D point clouds, graphs, meshes, voxels, high-dimensional images, and tensors, which possess challenges for analysis due to their high-dimensionality, high-volume, unstructured, multimodality characteristics. Additional challenges stem from compromised data quality (e.g., noisy and incomplete data), the need for registration, etc.

Announcements

2023 Reviewer’s Recognition

The Editor and Editorial Board of the Journal of Computing and Information Science in Engineering would like to thank all of the reviewers for volunteering their expertise and time reviewing manuscripts in 2023. Serving as reviewers for the journal is a critical service necessary to maintain the quality of our publication and to provide the authors with a valuable peer review of their work.

JCISE VIDEOS