Though your comment relating to his health suggests that you made the right choice and let him die without suffering a prolonged period of pain from illness.
My deep condolences on your loss. Very hard, especially when we love them and they know us better than we sometimes know ourselves. I've had to put down many pets over the years, and it never gets easier or less painful. And yet, each lives in our hearts, having enriched our lives.