I'm experiencing this too.
While it works once turned on while already in full-screen, if you quit the app and re-open it, the toolbar will not show up in full-screen and you have to re-enable it yourself again.
Strangely I only see this happening on my 2012 MacBook Pro instead of my 2020 M1. Both set to the same resolution (1440x900)