This work was done over the course of many friendly virtual calls Akhil Bagaria and @ray-luo.bsky.social , and under the thoughtful guidance of researchers that have spent decades working on these problems, namely George Konidaris, Doina Precup and
@marloscmachado.bsky.social
We hope this work provides a good introduction to the field.
Finding temporal structure is challenging. As such, we carefully laid down some of the most pressing questions in the field.
We also identified domains that are particularly promising, e.g. open-ended systems.