Answering to myself in case somebody searches for this issue later: it is indeed buggy. It fixed itself after a couple of days and usually works now. However, some days it doesn’t want to work. Sometimes a force quit from the app resolves this, other times I have to wait for it to come back to the intended behavior by itself.

Voyager 2.14.0 on iOS 17.6