Publications Conference paper · Delay-tolerant networks · 2025

POMDP-Based Routing for DTNs with Partial Knowledge and Dependent Failures

Gregory F. Stock, Alexander Haberl, Juan A. Fraire, and Holger Hermanns

IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), pp. 1–6, 2025

Abstract

Routing in Delay-Tolerant Networks (DTNs) is inherently challenging due to sparse connectivity, long delays, and frequent disruptions. While Markov Decision Processes (MDPs) have been used to model uncertainty, they assume full state observability—an assumption that breaks down in partitioned DTNs, where each node operates with inherently partial knowledge of the network state. In this work, we investigate the role of Partially Observable Markov Decision Processes (POMDPs) for DTN routing under uncertainty. We introduce and evaluate a novel model: Dependent Node Failures (DNF), which captures correlated node failures via repairable node states modeled as Continuous- Time Markov Chains (CTMCs). We implement the model using JuliaPOMDP and integrate it with DTN simulations via DtnSim. Our evaluation demonstrates that POMDP-based routing yields improved delivery ratios and delay performance under uncertain conditions while maintaining scalability. These results highlight the potential of POMDPs as a principled foundation for decision-making in future DTN deployments.

Cite

DOI 10.1109/wisee57913.2025.11229850

BibTeX

@inproceedings{DBLP:conf/wisee/StockHFH25,
  author    = {Gregory F. Stock and Alexander Haberl and Juan A. Fraire and Holger Hermanns},
  title     = {POMDP-Based Routing for DTNs with Partial Knowledge and Dependent Failures},
  booktitle = {IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE)},
  pages     = {1--6},
  publisher = {{IEEE}},
  year      = {2025},
  doi       = {10.1109/wisee57913.2025.11229850}
}

More on delay-tolerant networks

Comparing Statistical, Analytical, and Learning-Based Routing Approaches for Delay-Tolerant Networks Pedro R. D'Argenio, Juan A. Fraire, Arnd Hartmanns, and Fernando D. Raverta ACM Transactions on Modeling and Computer Simulation, 2025
Abstract
In delay-tolerant networks (DTNs) with uncertain contact plans, the communication episodes and their reliabilities are known a priori . To maximise the end-to-end delivery probability, a bounded network-wide number of message copies are allowed. The resulting multi-copy routing optimization problem is naturally modelled as a Markov decision process with distributed information. In this paper, we provide an in-depth comparison of three solution approaches: statistical model checking with scheduler sampling, the analytical RUCoP algorithm based on probabilistic model checking, and an implementation of concurrent Q-learning. We use an extensive benchmark set comprising random networks, scalable binomial topologies, and realistic ring-road low Earth orbit satellite networks. We evaluate the obtained message delivery probabilities as well as the computational effort. Our results show that all three approaches are suitable tools for obtaining reliable routes in DTN, and expose a tradeoff between scalability and solution quality.

HAL Publisher
Autonomous Max-Flow Interplanetary Laser Link Scheduling for Martian Exploration Jason Gerard, Andre Ibrahim, Juan A. Fraire, and Sandra Céspedes IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), 2024
Abstract
New communication technologies like delay and disruption-tolerant networking (DTN) and free-space laser communications are being developed to handle massive planetary telemetry data. However, existing infrastructure cannot meet the scalability and autonomy demands of future space missions, resulting in 95% of data left on the mission planet. Manual scheduling of deep-space laser transmissions by operators is inefficient and error-prone, limiting mission parallelization, while autonomous scheduling, though promising, may limit optimal network routes reducing the network capacity. We hypothesize that autonomously scheduling contact opportunities will enable acquisition, tracking, and pointing (ATP) for free-space lasers and increase the capacity of interplanetary backhaul networks. In this work, we propose the Laser Link Scheduler (LLS), which combines a novel max-flow network capacity model and a decision-making algorithm for contact selection. We define a series of deep-space communication scenarios where data is collected from orbiters around Mars and backhauled to Earth. LLS is evaluated in simulations using contact plans generated based on realistic conditions and orbital dynamics. Our results confirm that autonomous contact scheduling increases network capacity by 1.5-2x, reducing operational costs and enabling highly parallel space exploration missions.

HAL Publisher
Ring Road Networks: Access for Anyone Marius Feldmann, Juan A. Fraire, Felix Walter, and Scott C. Burleigh IEEE Communications Magazine, 2022
Abstract
Several billion people currently lack reliable access to the Internet and thus to a tremendous source of knowledge. In this article, we describe a field-tested communication approach combining CubeSat platforms and delay-tolerant networking (DTN) solutions to provide asynchronous connectivity to populations and regions that are underserved by the Internet. The resulting class of networks is known as ring road networks (RRNs), a networking approach that is built on technology developed for the construction of a solar system Internet. The necessary self-sufficiency of DTN nodes enables network access to be deployed incrementally at low cost, supporting communities that cannot be profitably served by Internet satellite constellations. We present the RRN architecture and evaluate the expected performance by means of simulations. Based on the latter, we discuss µD3TN: a lightweight and open source DTN protocol stack for RRNs and other DTN classes. µD3TN has been flight-tested in ESA's OPS-SAT in low Earth orbit during December 2020 and May 2021. This work discusses the experiment results as we validated the RRN approach in concrete application use cases. The reported outcomes motivate a new application domain.

HAL Publisher

Delay-tolerant networks: the topic page All 84 papers on this topic