In order to move the zoomed area, the cursor has to touch the edge of the screen, in the screen recording you can see that if I'm reading some text and I want to move to a new line (go all the way to the left) it happens frequently (and depending on the website) that the cursor will touch the left edge of the browser and stay there) which will show the side bar. luckily the side bar in Orion is currently narrow so it's not as annoying as Safari's but it's stirred frustrating 🙁
Note: the recording was me trying to simulate the situation so maybe it looked a bit less natural than when it actually happens throughout the day.