What are the advantages of using a Continue?

If you weren't able to meet a stage's objective, this option lets you spend some Gold and try again.
If you clear the stage after the Continue, your win streak will remain.
When you use a Continue, you can play that stage with a higher initial voltage.
Any boosters you were using before the continue will stay active.