So in all servo I could focus and recompose as long as I continuously hold it down? While if I'm in one shot if anything changes i must refocus?
If you are in AI Servo mode and want the camera to continuously focus (something you should only do when you know you the focus distance to your subject is continuously changing.. e.g. action shots) then you need to keep the active focus sensor on your target. If you "focus and recompose" then it'll just switch focus to whatever target works best for your new composition... possibly not the subject you had in mind.
Some camera bodies are very good about following focus and transitioning a focus target to a new focus point if the target is moving around in the viewfinder... but even then there's a bias in the computer that says "how long should I let the target go missing from the focus point before I give up and assume the target is never coming back?" At some point, the camera WILL eventually give up looking for the old focus target and start looking for a new focus target. The major point of back-button focus is that it lets YOU decide when the camera should start or stop focusing. If you've locked focus on a subject and you notice that at the edge of your field of view, someone else is about to get into the way, you can let go of the focus button while continuing to shoot. Since the last thing the camera locked focus on was your subject, they'll still be in focus as long as they haven't moved too much. When the obstacle moves out of the way, you can resume pressing the back-button again and it'll re-tweak the focus if needed.
Watch the 3 part Canon videos. They are VERY good. Each of the three parts is about 30 minutes, but WELL worth it. It will hopefully lift the veil of mystery regarding how and why the camera decides what to do when autofocusing. Once you know how the camera's focus system "thinks", you'll know what it'll plan to do in any situation and you'll know what YOU need to do to get the results you actually want.
Lastly... just in case anyone else is reading this thread, if you own the new EOS 1D X or 5D III then some of this information has changed. The focus system on those cameras is extremely advanced and can be tuned or customized. For those cameras, Canon has a whole 47 page guide *just* for the focus system alone and it's a "must read" guide if you have one of those cameras. That link is here:
Canon DLC: Article: Master the EOS-1D X's AF System (PDF is near the bottom of this page). But this ONLY applies to the 1D X and 5D III. If you own any other model, this information doesn't apply to your camera.