Tap this "change" button before PLAY and you can switch your initial spaceship. The use of ships that you have already unlocked is infinite.

The starting ship can't be changed in Boss mode. But you could get drop of other ships during the fight.