Tea Tree Oil topically, and Oil of Oregano orally morning and night for at least 10 days. You'll also want to up the amount of probiotics you're taking. You could try Oil of Oregano topically, but that could sting. If it doesn't go away after 10 days, you may need to see a Dr and get antibiotics.
I read an article somewhere that there's this special honey that helps with it. But you'd have to order that off the internet.