NDLI: A Self-Organizing Distributed Reinforcement Learning Algorithm to Achieve Fair Bandwidth Allocation for Priority-Based Bus Communication

Content Provider	IEEE Xplore Digital Library
Author	Ziermann, T. Mühleis, N. Wildermann, S. Teich, J.
Copyright Year	2010
Abstract	Due to the raising complexity in distributed embedded systems, a single designer will not be able to plan and organize the communication for such systems. Therefore, it will get more and more important to relieve the designer in that task. Our idea is a communication system that is capable to organize itself to satisfy predefined properties. In this paper, we want to solve the problem of establishing fair bandwidth sharing on priority-based buses by using simple local rules on the distributed system to avoid a single point of failure and cope with online system changes. Based on a game theoretical analysis, a multi-agent reinforcement learning algorithm is proposed that establishes fair bandwidth distribution. The main idea is to penalize nodes that claim too much bandwidth by the other nodes. We experimentally evaluated the algorithm with different parameter settings. The algorithm showed to converge to a fair solution in any experiment. This means the system is able to completely self-organize without global information for our assumptions. In addition, we could figure out that we can configure a trade-off between convergence speed and computation effort. We hope this is a small first step towards totally self-organizing real-time systems.
Starting Page	11
Ending Page	20
File Size	759943
Page Count	10
File Format	PDF
ISBN	9781424472185
e-ISBN	9781424472192
DOI	10.1109/ISORCW.2010.18
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-05-04
Publisher Place	Spain
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Real time systems Algorithm design and analysis Communication systems Self-organizing Conferences Multi-agent reinforcement learning Game theory Distributed computing Learning Embedded system Bandwidth Channel allocation Bus-based communication
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Mr. Siddhartha Mukherjee siddhartha@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	ndl-support@iitkgp.ac.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Libarray of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Self-organizing Distributed Reinforcement Learning Algorithm to Achieve Fair Bandwidth Allocation for Priority-based Bus Communication

Self-organizing Bandwidth Sharing in Priority-Based Medium Access

Human Upper Body Pose Recognition Using Adaboost Template for Natural Human Robot Interaction

Consistency Challenges in Self-Organizing Distributed Hard Real-Time Systems

An adaptive real-time bandwidth allocation strategy for IEEE802.15.4

A window-based object allocation and replication algorithm for real-time distributed database systems in mobile computing environment

Integrating self-organizing neural network and Motivated Learning for coordinated multi-agent reinforcement learning in multi-stage stochastic game

Scheduling algorithm for hard real-time communication in demand priority network

Toward Effective Multi-Capacity Resource Allocation in Distributed Real-Time and Embedded Systems

A Self-Organizing Distributed Reinforcement Learning Algorithm to Achieve Fair Bandwidth Allocation for Priority-Based Bus Communication

Similar Documents

A Self-organizing Distributed Reinforcement Learning Algorithm to Achieve Fair Bandwidth Allocation for Priority-based Bus Communication

Self-organizing Bandwidth Sharing in Priority-Based Medium Access

Human Upper Body Pose Recognition Using Adaboost Template for Natural Human Robot Interaction

Consistency Challenges in Self-Organizing Distributed Hard Real-Time Systems

An adaptive real-time bandwidth allocation strategy for IEEE802.15.4

A window-based object allocation and replication algorithm for real-time distributed database systems in mobile computing environment

Integrating self-organizing neural network and Motivated Learning for coordinated multi-agent reinforcement learning in multi-stage stochastic game

Scheduling algorithm for hard real-time communication in demand priority network

Toward Effective Multi-Capacity Resource Allocation in Distributed Real-Time and Embedded Systems

A Self-Organizing Distributed Reinforcement Learning Algorithm to Achieve Fair Bandwidth Allocation for Priority-Based Bus Communication