Feb 5 – 7, 2024
Universität Salzburg (Paris-Lodron-Universität)
Europe/Berlin timezone
Registration and call for abstracts extended to 5 January

Explainability in Reinforcement Learning: An Application for Powertrain Control

Feb 7, 2024, 2:00 PM
30m
Blue lecture hall (Universität Salzburg (Paris-Lodron-Universität))

Blue lecture hall

Universität Salzburg (Paris-Lodron-Universität)

Hellbrunnerstrasse 34 5020 Salzburg
Contributed Talk Contributed Talks

Speaker

Catherine Laflamme (Fraunhofer Austria Research GmbH)

Description

Reinforcement learning (RL), a subgroup of machine learning, has gained recognition for its astonishing success in complex games, however it has yet to show similar success in more real-world scenarios. In principle, the ability for RL to generalise past experience, act in real time, and its resilience to new states makes it particularly attractive as a robust decision-making support for real-world scenarios. However, such scenarios bring unique challenges that aren't present in the game-like domains, such as complex and contradictory reward functions and a necessity for explainability. In this presentation we will discuss some of these challenges in the context of using RL for automotive powertrain control. We will discuss the problem setup, including reward definition, as well as one approach to explainability. This approach is to first learn a neural network based policy (which can learn effectively and efficiently) and then extrace a rule-based policy (which is easier to interpret and can be directly implemented in current control software). The results are benchmarked with an optimised MATLAB policy, using a simulink simulation.

Possible contributed talk Yes
Are you a student? No

Primary author

Catherine Laflamme (Fraunhofer Austria Research GmbH)

Co-authors

Jörg Doppler (Bosch Engineering GmbH) Sven Domnika (Bosch Engineering GmbH) Leonhard Czarnetzki (Fraunhofer Austria Research GmbH) Bence Palvolgyi (SZTAKI: Institute for Computer Science and Control) Zsolt Viharos (SZTAKI: Institute for Computer Science and Control)

Presentation materials