I am a PhD candidate at the Department of Software Science at Radboud University Nijmegen, working on the project Provably Correct Policies for Uncertain Partially Observable Markov Decision Processes under the supervision of dr. Nils Jansen and prof. dr. Frits Vaandrager.

My research is at the intersection of formal methods and AI. Specific interests are planning and learning in Markov decision processes (MDPs) and variations that extend these models with uncertainty, such as robust MDPs and partially observable MDPs (POMDPs).

You can reach me at marnix.suilen {AT} ru.nl.

Publications

See also my DBLP or Google scholar profiles.

arXiv Patrick Wienhöft, Marnix Suilen, Thiago D. Simão, Clemens Dubslaff, Christel Baier, and Nils Jansen.
More for Less: Safe Policy Improvement with Stronger Performance Guarantees.
In IJCAI 2023.
arXiv Thom Badings, Thiago D. Simão, Marnix Suilen, and Nils Jansen.
Decision-making under uncertainty: beyond probabilities. Challenges and Perspectives.
STTT 2023.
arXiv Thiago D. Simão, Marnix Suilen, and Nils Jansen.
Safe Policy Improvement for POMDPs via Finite-State Controllers.
In AAAI 2023.
arXiv Marnix Suilen, Thiago D. Simão, David Parker, and Nils Jansen.
Robust Anytime Learning of Markov Decision Processes.
In NeurIPS 2022.
arXiv Murat Cubuktepe, Nils Jansen, Sebastian Junges, Ahmadreza Marandi, Marnix Suilen, and Ufuk Topcu.
Robust Finite-State Controllers for Uncertain POMDPs.
In AAAI 2021.
arXiv Thom S. Badings, Arnd Hartmanns, Nils Jansen, and Marnix Suilen.
Balancing Wind and Batteries: Towards Predictive Verification of Smart Grids.
In NFM 2021.
arXiv Marnix Suilen, Nils Jansen, Murat Cubuktepe, and Ufuk Topcu.
Robust Policy Synthesis for Uncertain POMDPs via Convex Optimization.
In IJCAI 2020.

Professional Activities

Talks and Presentations

Paper presentations at conferences where the paper was accepted are omitted.

  • Dependable Decision-Making Under Uncertainty: Beyond Probabilities. University of Oxford, UK, 2023.
  • Safe Policy Improvement for POMDPs. LiVe 2023.
  • Decision-Making and Learning under Uncertainty. Lorentz Center workshop on Rigorous Automated Planning, 2022.
  • Decision-Making and Learning under Uncertainty. ROCKS 2022.
  • Anytime Learning and Verification of Uncertain Markov Decision Processes. LiVe 2022.
  • Unraveling Uncertainty in POMDPs. RWTH Aachen, Germany, 2021.
  • Robust Policies for Uncertain POMDPs. R4P 2021.
  • Robust Policies for Uncertain POMDPs. FUNCTION 2021.

Teaching

As a lecturer:

  • Model Checking. Master course, spring 2023, lectures on bisimulations, robust MDPs, and POMDPs.
  • Model Checking. Master course, spring 2022, lectures on bisimulations and POMDPs.

As a teaching assistant:

  • Mathematical Foundations of Computer Science Seminar. Master course, fall 2023.
  • Algorithms and Data Structures. Bachelor course, fall 2022, practical assignment.
  • Mathematical Foundations of Computer Science Seminar. Master course, fall 2022.
  • Model Checking. Master course, spring 2022.
  • Mathematical Foundations of Computer Science Seminar, Master course, fall 2021.
  • Model Checking. Master course, spring 2021.
  • Model Checking. Master course, spring 2020.
  • Algorithms and Data Structures. Bachelor course, fall 2019.
  • Algorithms and Data Structures. Bachelor course, fall 2018.

Academic service

PC membership:
AAMAS.

I have been a (sub)reviewer for:
AAAI, AAMAS, EUMAS, FASE, FM, ICML, ICSE, NeurIPS, QEST.

Other

  • Representative for the Department of Software Science in the iCIS Graduate School Council.
  • Student volunteer at IJCAI 2023.
  • Student volunteer for FORMATS 2020, part of QONFEST 2020.

Travels

I have been lucky enough to travel to the following places: Macao, SAR, China; Oxford, UK; Paris, France; Delft, The Netherlands; Washington DC, USA; Leiden, The Netherlands; Munich, Germany; Aachen, Germany; Schloss Dagstuhl, Germany.