sequential-decision-making

(ICML 2024) Pursuing Overall Welfare in Federated Learning through Sequential Decision Making (https://arxiv.org/abs/2402.14650)

StarCraft II high-level feature extractor and replay visualizer

Machine-checked Lean 4 / Mathlib formalization of Ismail's Primitives — six structural primitives proven necessary, mutually independent, and sequentially linked for sequential decision-making under uncertainty. 0 sorry · 0 axiom · ~12,700 lines.

code for published paper titled "Optimal CO2 storage management considering safety constraints in multi-stakeholder multi-site GCS projects: a Markov game perspective  "

A project to classification.

LLM benchmark for long-horizon sequential decision-making — language models play the turn-based strategy game LGeneral against the CPU over a REST API, scored on a graded victory scale.

A personal website made using Jekyll's Ed theme

Explainable action ranking from historical sequences — a Rust library and CLI, not a contextual bandit or online-learning library.

Implementation of a Decision Transformer for power-grid control in L2RPN. The model learns from offline Tutor/Junior demonstrations and continues training online, serving as a drop-in replacement for PPO in the original pipeline proposed by aspirin96.

Autonomous Blue Team agent. Using Deep Reinforcement Learning for sequential intrusion detection and active incident response in simulated enterprise networks (CybORG / CAGE). Moving beyond static classification, this agent learns an interactive, explainable policy to continuously mitigate cyber threats.

Four policy classes (PFA/CFA/VFA/DLA) on the energy-storage problem, scored against a verified exact optimum, with a model-misspecification study

Sequential finite-population certification on GB1 and AAV2 with complete paired-trial audit artifacts.

Do humans adapt their planning horizon? - An analysis of sequential decision-making in the videogame Frogger

A reproducible falsification harness for resource-bounded AI-agent scheduling under correlated failures, noisy verification, costs, deadlines, and false-acceptance constraints.

Researching policy-induced observability in recommender systems: when serving policies create self-confirming preference models, and when exploration is worth the cost.

PyTorch implementation of REACT: longitudinal active feature acquisition with Gumbel-Sigmoid relaxation for cost-aware sequential feature selection with context. ACM BCB 2026.

Multi-agent drone search simulation for oil-spill detection under uncertainty.

Risk-based sequential stopping: when to invoke an LLM in streaming systems. Code for ECML PKDD 2026 (Research Track). arXiv:2607.13048 · Zenodo DOI 10.5281/zenodo.20783549

砂場

Multi-stage Stochastic Programming for Integrated Network Optimization in Hurricane Relief Logistics and Evacuation Planning