Part of the problem is what people are putting TC's on. They are not designed for anything less than a 100mm lens. Off brands like, Tamron, Kenko, Tokina and Sigma will fit virtually any lens where as Canon's TC's will only fit on certain Canon Bodies. I don't know about Nikon TC's as to what lenses they will or will not fit. Putting a 2X TC on a 50mm provides a poor substitue for a 100mm lens. Even a consumer grade 100mm lens in most cases.
Along with all the other things mentioned above, keep in mind that a TC whether it is a 1.4, 1.5, 1.7, 2.0 or 3.0 will multiply the Image Quality defect by that amount. If you are using a consumer grade lens that is not razor sharp then that lack of sharpness is going to be enhanced by the TC resulting in softer photos. Most shooters don't have a 300 f2.8, 400 f2.8 500 f4.5 600 f4.5 or 800 f5.6 to use with the TC When you put a top quality TC on a top quality piece of glass like that you can get very good results.
I only use my Canon 2.0 TX on my 300 f2.8L and 400 f2.8L. For my 70-200 f2.8L I never use anything but my Canon 1.4. The 2.0 just doesn't provide the results that I expect.