Are you getting anything out of it? If so, and hes not charging you an arm and a leg, stick with him for now. Besides, you as the student may help him become a better teacher. Plus, if this teacher doesn't have a tired old way of teaching (after doing it for so many years), then maybe they might have a fresher approach.
mm that depends. I'll share with you my case... I just got invited to give lessons at a music academy a month ago (no prior experience). This kinda creeped me out since I am 85% self-taught (so I basically had no idea on how to teach), nevertheless, I decided to go for it. Right now I only have two students and so far both of them are really happy with me. One of em is an experienced 13 year-old kid who told me- 'this is exactly what I was looking for' and the other one is an 8 year-old boy who's been progressing really fast.
So, bottom line, experience does count in a teacher, but don't base your judgment entirely on that... give him some time and see if you're still uncomfortable.