The Canon EF 50/1.4 is known to be a little bit 'weird' in terms of AF. I owned mine from 2006 until January of this year. It "usually" focuses relatively quickly, but was occassionallty a bit lethargic, and sometimes did not want to initiate AF on either my 20D or my 5D...other 50/1.4 users have reported the same thing. I'm not quite sure, exactly, why the 50/1.4 was slower and less-responsive; my 85/1.8 EF and 135/2-L were ALWAYS, always, always much faster and more-responsive.
I think some of the issue might have to do with the relatively short focal length, combined with the "basic" class of USM motor used in the 50/1.4, The short focal length means that the "in-focus" signal data and the "out of focus" signal data that the AF system uses in its phase detection process is not as discretely IN or OUT of focus as it is on a longer lens, like an 85, or 135mm lens. With those lenses, a very SMALL movement of the focusing system makes a MAJOR difference in the degree of "in" or "out" of focus, so those lenses respond super-fast, and the system focuses with amazing ease. Shorter lenses, like 20,24,28,35,50mm have a much more-challenging set of focusing data coming in, and it's pretty common for something like a 24mm f/2.8 lens to "saw" back and forth...dtttzzz.dtzzzz.dtzzz....dtzzz, as it tries to determine exactly where "IN" focus starts and where "OUT" of focus is....there's so much depth of field that the in/out distinction is not all that concrete.
I DO think that the 50/1.4 EF has lovely bokeh, and is a must-have lens for a Canon shooter. But it's also rather outdated in terms of the "level" of the focusing motor, and it could stand to be brought up a notch, it's true. It's been made basically the same exact way since 1987, I think....it's NOT a "modern" lens. By the same token--Nikon's new 50/1.4-G focuses very slowly....but their 50/1.8 G focuses like a Ferrari....so...I dunno...