Click this button to show options.
Find this icon and drag it to the end of the tabs
And it should look like this
Then click Exit Customise and your button should be back.
If it doesn't work you can always press Ctrl + T, or click the blank area beyond the last tab should open a new tab.