Unfortunately the browser view has a habit of coming back - when you connect to a new network drive, or insert a USB stick, or just randomly. If there were a defaults bool I could set to turn it off forever, that'd be wonderful.
It makes sense to me that the sidebar is incompatible with spatial browsing. It changes the size/shape of the window, and the items there are a list of aliases that don't exist in that space.