Tootfinder

On the Curses of Future and History in Future-dependent Value Functions for Off-policy Evaluation
Yuheng Zhang, Nan Jiang
https://arxiv.org/abs/2402.14703 …

On the Curses of Future and History in Future-dependent Value Functions for Off-policy Evaluation
We study off-policy evaluation (OPE) in partially observable environments with complex observations, with the goal of developing estimators whose guarantee avoids exponential dependence on the horizon. While such estimators exist for MDPs and POMDPs can be converted to history-based MDPs, their estimation errors depend on the state-density ratio for MDPs which becomes history ratios after conversion, an exponential object. Recently, Uehara et al. (2022) proposed future-dependent value functions…

Synergy of Large Language Model and Model Driven Engineering for Automated Development of Centralized Vehicular Systems
Nenad Petrovic, Fengjunjie Pan, Krzysztof Lebioda, Vahid Zolfaghari, Sven Kirchner, Nils Purschke, Muhammad Aqib Khan, Viktor Vorobev, Alois Knoll
https://arxiv.org/abs/2404.05508…

Synergy of Large Language Model and Model Driven Engineering for Automated Development of Centralized Vehicular Systems
We present a prototype of a tool leveraging the synergy of model driven engineering (MDE) and Large Language Models (LLM) for the purpose of software development process automation in the automotive industry. In this approach, the user-provided input is free form textual requirements, which are first translated to Ecore model instance representation using an LLM, which is afterwards checked for consistency using Object Constraint Language (OCL) rules. After successful consistency check, the mod…