The teleconverters cut your aperture. More importantly - I would imagine (excepting the highest end lenses/teleconverters) i could see it affecting focus speed/ability.

I like primes in theory - but in practice, in the situations that i've been wanting a longer lens, i've also been having things shift enough that if I were shooting primes i'd be spending half my time switching lenses : )