Cooperative Intelligent Control of Multi-Agent Systems (MAS) Through Communication, Trust, and Reliability

Stefalo Acha, Sun Yi

Abstract


The field of Multi-Agent Systems (MAS) has achieved significant advancements in modern research and development. This study focuses on enhancing trust evaluation, communication efficiency, and adaptive navigation in scenarios where agents have limited prior knowledge. Key contributions include the development of a high-intelligence MAS system that integrates key input data, such as real-time parameters regarding agents’ distances from one another, their distances to target locations, weather conditions, visibility, machine learning capabilities, positions relative to safe or unsafe environments for trust evaluation, delays in communication, and potential cyber threats. These factors trigger a dynamic topology-switching mechanism to secure agents or minimize communication delays in high-security operations. The MAS implements these strategies based on an adaptive communication model, enabling agents to execute various steps during data pooling effectively. Agents utilize real-time data to coordinate flock movements, ensuring dynamic and robust control through data pooling. For example, in a topology requiring a lead agent, the lead agent provides navigation instructions based on pooled data collected during mission execution. This data may involve repositioning proper area coverage, considering agents’ visibility, distance, or environmental disturbances. Four main topologies are implemented in this experiment: directed mesh with two lead agents (type A), directed mesh with one lead agent (type B), star topology (type C), and ring topology (type D). Type B and C topologies are well-suited for communication without delays or disturbances but perform poorly when the system experiences delays (e.g., noise disturbances exceeding a threshold frequency of 5 Hz). In contrast, type A and D topologies are more effective in handling communication delays. By implementing a topology-switching mechanism, this research streamlines the application of two or more topologies in real-life scenarios. It utilizes type B or C topologies in undisturbed conditions and switches to type A or D when perturbations occur. This optimization minimizes communication delays during mission execution and flight time. The research demonstrates significant improvements in trust evaluation, communication efficiency, and overall MAS performance, with implications across various domains, including image and video mining. In these areas, the integration of domain-specific agents enhances processes such as preprocessing, feature extraction, and interpretation. Results show improved accuracy and reliability in data analysis and decision-making across diverse applications, particularly in scenarios involving complex spatial objects and varying environmental conditions.

Keywords


Communication, Delay, Data Pooling, Delay, Optimization, Perturbation, Worldview

Full Text:

PDF

References


J. Hu, P. Bhowmick, I. Jang, F. Arvin and A. Lanzon, "A Decentralized Cluster Formation Containment Framework for Multirobot Systems," IEEE Transactions on Robotics, vol. 37, no. 6, pp. 1936-1955, 2021, https://doi.org/10.1109/TRO.2021.3071615.

J. Sumpter, C. Thomas, S. Yi and A. Kruger, "Analysis of the Effects of Communication Trust and Delay on Consensus of Multi-Agent Systems," 2019 IEEE 2nd Connected and Automated Vehicles Symposium (CAVS), pp. 1-6, 2019, https://doi.org/10.1109/CAVS.2019.8887827.

N. C. A. de Freitas and M. P. dos Santos Silva, "Multiagent system for image mining," InTech, 2017, https://doi.org/10.5772/intechopen.69353.

N. Nguyen, D. Nguyen, J. Kim, G. Rizzo and H. Nguyen, "Multi-Agent Data Collection in Non-Stationary Environments," 2022 IEEE 23rd International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), pp. 120-129, 2022, https://doi.org/10.1109/WoWMoM54355.2022.00023.

Y. Liu, J. Li, F. Fang and J. H. Park, "Further Studies on Sampled-Data Consensus of Multi-Agent Systems With Communication Delays," IEEE Transactions on Signal and Information Processing over Networks, vol. 8, pp. 920-931, 2022, https://doi.org/10.1109/TSIPN.2022.3220153.

G. Wen, Z. Duan, W. Yu, G. Chen, "Consensus in multi‐agent systems with communication constraints," International Journal of Robust and Nonlinear Control, vol. 22, no. 2, pp. 170-182, 2012, https://doi.org/10.1002/rnc.1687.

A. Amirkhani, A. H. Barshooi, “Consensus in multi-agent systems: a review,” Artificial Intelligence Review, vol. 55, no. 5, pp. 3897-3935, 2022, https://doi.org/10.1007/s10462-021-10097-x.

G. Papoudakis, F. Christianos, A. Rahman, S. V. Albrecht, "Dealing with non-stationarity in multi-agent deep reinforcement learning," arXiv, 2019, https://doi.org/10.48550/arXiv.1906.04737.

J. Liu and Y. Tang, "Conflict data fusion in a multi-agent system premised on the base basic probability assignment and evidence distance," Entropy, vol. 23, no. 7, pp. 820, 2021, https://doi.org/10.3390/e23070820.

A. Stephen, R. Karthikeyan, C. Sowmiya, R. Raja, R. P. Agarwal, "Sampled-data controller scheme for multi-agent systems and its Application to circuit network," Neural Networks, vol. 170, pp. 506-520, 2024, https://doi.org/10.1016/j.neunet.2023.11.059.

J. Zhan and X. Li, "Consensus of sampled-data multi-agent networking systems via model predictive control," Automatica, vol. 49, no. 8, pp. 2502-2507, 2013, https://doi.org/10.1016/j.automatica.2013.04.037.

S. Huang, J. Layer, D. Smith, G. P. Bingham, Q. Zhu, "The effect of movement frequency on perceptual-motor learning of a novel bimanual coordination pattern," Human Movement Science, vol. 83, pp. 102958, 2022, https://doi.org/10.1016/j.humov.2022.102958.

M. A. Goodale, G. Króliczak and D. A. Westwood, "Dual routes to action: contributions of the dorsal and ventral streams to adaptive behavior," Progress in Brain Research, vol. 149, pp. 269-283, 2005, https://doi.org/10.1016/S0079-6123(05)49019-6.

P. R. DeLucia, "Time-to-contact judgments of an approaching object that is partially concealed by an occluder," Journal of Experimental Psychology: Human Perception and Performance, vol. 30, no. 2, pp. 287, 2004, https://psycnet.apa.org/doi/10.1037/0096-1523.30.2.287.

C. Best, “The Influence of Ship Deck-Edge Lighting on Perception of Position and Movement during Helicopter Recovery,” Australian Government, 2006, https://apps.dtic.mil/sti/citations/ADA462950.

M. Jang, A. Ahmed and G. Agha, "Efficient agent communication in multi-agent systems," Software Engineering for Multi-Agent Systems III, pp. 236-253, 2005, https://doi.org/10.1007/978-3-540-31846-0_14.

N. Borselius, “Multi-Agent System Security for Mobile Communication,” Computer Science, Engineering, 2003, https://www.semanticscholar.org/paper/Multi-agent-system-security-for-mobile-Borselius/cff632354c26393e86fd3ac16e5e0474464bf4c1.

K. You and L. Xie, "Network Topology and Communication Data Rate for Consensusability of Discrete-Time Multi-Agent Systems," IEEE Transactions on Automatic Control, vol. 56, no. 10, pp. 2262-2275, 2011, https://doi.org/10.1109/TAC.2011.2164017.

J. Yu and L. Wang, "Group consensus in multi-agent systems with switching topologies and communication delays," Systems & Control Letters, vol. 59, no. 6, pp. 340-348, 2010, https://doi.org/10.1016/j.sysconle.2010.03.009.

S. Yi and A. G. Ulsoy, "Time-delayed vision-based DC motor control via rightmost eigenvalue assignment," 2014 American Control Conference, pp. 5564-5569, 2014, https://doi.org/10.1109/ACC.2014.6858677.

S. Yi, S. Yu and J. H. Kim, "Analysis of neural networks with time-delays using the Lambert W function," Proceedings of the 2011 American Control Conference, pp. 3221-3226, 2011, https://doi.org/10.1109/ACC.2011.5991085.

K. F. Firoz, Y. Seong, S. Yi and Y. Chang, "A Preliminary Study on Human Trust in Pseudo-Real-Time Scenario through Electroencephalography and Machine Learning based Data Classification,” 1st International Conference on Smart Mobility and Vehicle Electrification, 2023, https://doi.org/10.46254/EV01.20230061.

D. Chilukuri, S. Yi and Y. Seong, "Development of Mobile Application for VRUs Using Computer Vision," SoutheastCon 2018, pp. 1-6, 2018, https://doi.org/10.1109/SECON.2018.8479138.

P. Shi and B. Yan, "A Survey on Intelligent Control for Multiagent Systems," IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 51, no. 1, pp. 161-175, 2021, https://doi.org/10.1109/TSMC.2020.3042823.

P. Akangah and M. A. Muktadir, "A study of elliptical delamination of a Sub laminate in a Quasi-Isotropic Composite Laminate: A fresh look at the solution method," International Association of Journals and Conferences, 2022, https://2022.iajc.org/wp-content/uploads/simple-file-list/uploaded-papers/proceeding-papers/014-M-22___A-study-of-Elliptical-Delamination-of-a-Sub-Laminate-in-a-Quasi-Isotropic-Composite___Akangah-Muktadir___CONFERENCE-PROCEEDINGS2.docx.

A. A. Tereda and S. Yi, "Predictive control of the KINOVA Gen3 robotic manipulator using a nonlinear model," ASME International Mechanical Engineering Congress and Exposition, 2024, https://doi.org/10.1115/IMECE2023-112777.

A. A. Tereda, “Path Planning and Sensing for Autonomous Control of Robot Manipulators,” North Carolina Agricultural and Technical State University, 2021, https://www.proquest.com/openview/3feb689bab3761b0c3f02d3fced6ece9/1?cbl=18750&diss=y&pq-origsite=gscholar.

S. Acha, S. Yi, F. Ferguson, “Control of Leading-Edge Shock Train Using Deep Neural Network to Prevent Unstart,” Control Systems and Optimization Letters, vol. 2, no. 3, pp. 285- 294, 2022, http://dx.doi.org/10.59247/csol.v2i3.160.

B. Wang, S. Li, G. Battistelli, L. Chisci, W. Yi, “Principled information fusion for multi-view multi-agent surveillance systems," ArXiv, 2021, https://doi.org/10.48550/arXiv.2105.10935.

C. D. Schultz, "A trust framework model for situational contexts," Proceedings of the 2006 International Conference on Privacy, Security and Trust: Bridge the Gap between PST Technologies and Business Services, 2006, https://doi.org/10.1145/1501434.1501494.

P. S. P. Wong and S. O. Cheung, "Structural equation model of trust and partnering success," Journal of Management in Engineering, vol. 21, no. 2, pp. 70-80, 2005, https://doi.org/10.1061/(ASCE)0742-597X(2005)21:2(70).

J. Dearmon and K. Grier, "Trust and development," Journal of Economic Behavior & Organization, vol. 71, no. 2, pp. 210-220, 2009, https://doi.org/10.1016/j.jebo.2009.02.011.

D. J. Essin, "Patterns of trust and policy," Proceedings of the 1997 Workshop on New Security Paradigms, 1998, https://doi.org/10.1145/283699.283738.

P. R. DeLucia, "Critical roles for distance, task, and motion in space perception: Initial conceptual framework and practical implications," Human Factors, vol. 50, no. 5, pp. 811-820, 2008, https://doi.org/10.1518/001872008X312297.

M. Taddeo, "Modelling trust in artificial agents, a first step toward the analysis of e-trust," Minds and Machines, vol. 20, pp. 243-257, 2010, https://doi.org/10.1007/s11023-010-9201-3.

D. Asher, M. Garber-Barron, S. Rodriguez, E. Zaroukian and N. Waytowich, "Multi-Agent Coordination Profiles through State Space Perturbations," 2019 International Conference on Computational Science and Computational Intelligence (CSCI), pp. 249-252, 2019, https://doi.org/10.1109/CSCI49370.2019.00051.

S. Armah and S. Yi, "Altitude regulation of quadrotor types of UAVs considering communication delays," IFAC-PapersOnLine, vol. 48, no. 12, pp. 263-268, 2015, https://doi.org/10.1016/j.ifacol.2015.09.388.

S. Yi, S. Duan, P. W. Nelson, A. G. Ulsoy, "The Lambert W function approach to time delay systems and the LambertW_DDE toolbox," IFAC Proceedings Volumes, vol. 45, no. 14, pp. 114-119, 2012, https://doi.org/10.3182/20120622-3-US-4021.00008.

M. T. Matthews and S. Yi, "Neural Network Based Adaptive Flight Control of UAVs," SoutheastCon 2021, pp. 1-7, 2021, https://doi.org/10.1109/SoutheastCon45413.2021.9401817.

Y. Ito, M. A. S. Kamal, T. Yoshimura, S. Azuma, "Pseudo-perturbation-based broadcast control of multi-agent systems," Automatica, vol. 113, pp. 108769, 2020, https://doi.org/10.1016/j.automatica.2019.108769.

H. Zhu and M. Kirley, "Deep Multi-agent Reinforcement Learning in a Common-Pool Resource System," 2019 IEEE Congress on Evolutionary Computation (CEC), pp. 142-149, 2019, https://doi.org/10.1109/CEC.2019.8790001.

K. Garg and S. K. Nayar, "Detection and removal of rain from videos," Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., pp. I-I, 2004, https://doi.org/10.1109/CVPR.2004.1315077.

K. Garg and S. K. Nayar, "Vision and rain," International Journal of Computer Vision, vol. 75, pp. 3-27, 2007, https://doi.org/10.1007/s11263-006-0028-6.

S. Loussaief and A. Abdelkrim, "Machine learning framework for image classification," 2016 7th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT), pp. 58-61, 2016, https://doi.org/10.1109/SETIT.2016.7939841.

A. Nahid and Y. Kong, "Involvement of machine learning for breast cancer image classification: a survey," Computational and Mathematical Methods in Medicine, vol. 2017, no. 1, 2017, https://doi.org/10.1155/2017/3781951.

A. J. Edney and M. J. Wood, "Applications of digital imaging and analysis in seabird monitoring and research," Ibis, vol. 163, no. 2, pp. 317-337, 2021, https://doi.org/10.1111/ibi.12871.

H. Friedrich, M. Kaiser, O. Rogalla, and R. Dillmann, "Learning and communication in multi-agent systems," Workshop on Learning in Distributed Artificial Intelligence Systems, pp. 259-275, 1996, https://doi.org/10.1007/3-540-62934-3_53.

S. Li, W. Song, L. Fang, Y. Chen, P. Ghamisi and J. A. Benediktsson, "Deep Learning for Hyperspectral Image Classification: An Overview," IEEE Transactions on Geoscience and Remote Sensing, vol. 57, no. 9, pp. 6690-6709, 2019, https://doi.org/10.1109/TGRS.2019.2907932.

P. Xuan, V. Lesser and S. Zilberstein, "Communication decisions in multi-agent cooperation: Model and experiments," Proceedings of the Fifth International Conference on Autonomous Agents, 2001, https://doi.org/10.1145/375735.376469.

R. M. V. Eijk, F. S. D. Boer, W. V. D. Hoek and J. C. Meyer, "Open multi-agent systems: Agent communication and integration," Intelligent Agents VI. Agent Theories, Architectures, and Languages, pp. 218–232, 2000, https://doi.org/10.1007/10719619_16.

A. Singh and P. Singh, "Image classification: a survey," Journal of Informatics Electrical and Electronics Engineering, vol. 1, no. 2, pp. 1-9, 2020, http://dx.doi.org/10.54060/JIEEE/001.02.002.

V. A. Demin, D. B. Efimenko, D. V. Blinov, D. A. Komkova and V. R. Rogov, "Multi-Agent Approach to Freight Transportation Using Pooling Technology," 2021 Systems of Signals Generating and Processing in the Field of on Board Communications, pp. 1-5, 2021, https://doi.org/10.1109/IEEECONF51389.2021.9416077.

Z. Ren and C. J. Anumba, "Multi-agent systems in construction–state of the art and prospects," Automation in Construction, vol. 13, no. 3, pp. 421-434, 2004, https://doi.org/10.1016/j.autcon.2003.12.002.

Y. Peng et al, "A multi-agent system for enterprise integration," International Journal of Agile Manufacturing, vol. 1, no. 2, pp. 213-229, 1998, https://ebiquity.umbc.edu/paper/html/id/322.

A. Dorri, S. S. Kanhere and R. Jurdak, "Multi-Agent Systems: A Survey," IEEE Access, vol. 6, pp. 28573-28593, 2018, https://doi.org/10.1109/ACCESS.2018.2831228.

P. Dollar, Z. Tu, H. Tao and S. Belongie, "Feature Mining for Image Classification," 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8, 2007, https://doi.org/10.1109/CVPR.2007.383046.

J. De La Calleja and O. Fuentes, "Machine learning and image analysis for morphological galaxy classification," Monthly Notices of the Royal Astronomical Society, vol. 349, no. 1, pp. 87-93, 2004, https://doi.org/10.1111/j.1365-2966.2004.07442.x.

C. Lee, J. Lawry and A. Winfield, "Combining opinion pooling and evidential updating for multi-agent consensus," Proceedings of the 27th International Joint Conference on Artificial Intelligence, pp. 347-353, 2018, https://doi.org/10.24963/ijcai.2018/48.

J. Xie and C. Liu, "Multi-agent systems and their applications," Journal of International Council on Electrical Engineering, vol. 7, no. 1, pp. 188-197, 2017, https://doi.org/10.1080/22348972.2017.1348890.

F. Wu, S. Zilberstein and X. Chen, "Online planning for multi-agent systems with bounded communication," Artificial Intelligence, vol. 175, no. 2, pp. 487-511, 2011, https://doi.org/10.1016/j.artint.2010.09.008.

C. Burnett, T. J. Norman and K. Sycara, "Trust decision-making in multi-agent systems," Twenty-Second International Joint Conference on Artificial Intelligence, 2011, https://www.ijcai.org/Proceedings/11/Papers/031.pdf.

M. Cheng et al, "A general trust framework for multi-agent systems," Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, 2021, https://www.ifaamas.org/Proceedings/aamas2021/pdfs/p332.pdf.

K. Chhogyal, A. Nayak, A. Ghose, H. K. Dam, "A value-based trust assessment model for multi-agent systems," Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, pp. 194-200, 2019, https://doi.org/10.24963/ijcai.2019/28.

H. Huang, G. Zhu and S. Jin, "Revisiting Trust and Reputation in Multi-agent Systems," 2008 ISECS International Colloquium on Computing, Communication, Control, and Management, pp. 424-429, 2008, https://doi.org/10.1109/CCCM.2008.122.

K. S. Barber, K. Fullam and J. Kim, "Challenges for trust, fraud and deception research in multi-agent systems," Trust, Reputation, and Security: Theories and Practice, pp. 8-14, 2003, https://doi.org/10.1007/3-540-36609-1_2.

N. Drawel, J. Bentahar, A. Laarej and G. Rjoub, "Formal verification of group and propagated trust in multi-agent systems," Autonomous Agents and Multi-Agent Systems, vol. 36, no. 1, p. 19, 2022, https://doi.org/10.1007/s10458-021-09542-6.

G. Lu et al, "A review on computational trust models for multi-agent systems," The Open Information Science Journal, vol. 2, pp. 18-25, 2009, https://eprints.hud.ac.uk/id/eprint/4102/1/18TOISCIJ[1]lu2.pdf.




DOI: https://doi.org/10.59247/csol.v3i1.171

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Stefalo N.N Acha

 
Control Systems and Optimization Letters
ISSN: 2985-6116
Website: https://ejournal.csol.or.id/index.php/csol
Email: alfian_maarif@ieee.org
Publisher: Peneliti Teknologi Teknik Indonesia
Address: Jl. Empu Sedah No. 12, Pringwulung, Condongcatur, Kec. Depok, Kabupaten Sleman, Daerah Istimewa Yogyakarta 55281, Indonesia