The New Tab button cannot be removed from the toolbar when using the Compact tab layout. This is inconsistent with the behavior when using the Standard tab layout.
The workflow to hide/show the New Tab button should be the same as the current method when using Standard tab layout.
- Right click toolbar > Customize Toolbar…
- Drag the New Tab button in/out of the toolbar, as preferred.
- Click Done.