By the way, it may be worth to mention that after renaming the window (so it's just named Window in the toolbar instead of the name I gave it), if I toggle the windows sidebar or the vertical tabs sidebar the name is the one I gave.
So the bug seems to be located only in the toolbar item.