- Research Article
- Open Access
- Published:
An Optimal Medium Access Control with Partial Observations for Sensor Networks
EURASIP Journal on Wireless Communications and Networking volume 2005, Article number: 487028 (2005)
Abstract
We consider medium access control (MAC) in multihop sensor networks, where only partial information about the shared medium is available to the transmitter. We model our setting as a queuing problem in which the service rate of a queue is a function of a partially observed Markov chain representing the available bandwidth, and in which the arrivals are controlled based on the partial observations so as to keep the system in a desirable mildly unstable regime. The optimal controller for this problem satisfies a separation property: we first compute a probability measure on the state space of the chain, namely the information state, then use this measure as the new state on which the control decisions are based. We give a formal description of the system considered and of its dynamics, we formalize and solve an optimal control problem, and we show numerical simulations to illustrate with concrete examples properties of the optimal control law. We show how the ergodic behavior of our queuing model is characterized by an invariant measure over all possible information states, and we construct that measure. Our results can be specifically applied for designing efficient and stable algorithms for medium access control in multiple-accessed systems, in particular for sensor networks.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Cristescu, R., Servetto, S.D. An Optimal Medium Access Control with Partial Observations for Sensor Networks. J Wireless Com Network 2005, 487028 (2005). https://doi.org/10.1155/WCN.2005.505
Received:
Revised:
Published:
DOI: https://doi.org/10.1155/WCN.2005.505
Keywords
- MAC
- feedback control
- controlled Markov chains
- Markov decision processes
- dynamic programming
- stochastic stability