I use to suffer from this most of my adult and while I was a kid. I had a dentist who had an ointment that he would give to me and while he wouldn't tell me what the medicine was it worked in 2 days. I would usually suffer with them for at least 2 weeks before getting relief. Subsequently I had an Internal Medicine Doctor give me tetracycline pills that I would mix with water until it became a paste and spread it on the affected area and that really helped as well and healed them within a few days.