I voted that I take my camera bag with me only when I go out to shoot.
It's not that I don't want a camera with me at all times; but that if one is going on foot or is doing other things I find that a big DSLR bag with camera and lenses tends to get in the way. You end up not taking it out (because you'r travelling or doing other things) or if you do its a heavy necklace that doesn't do much because you're doing those other things.
It also depends what you like to shoot - macro and wildlife my bag and setup can be quite big and heavy so I don't want the super telephoto when I've got books or other things to carry.
Now if I had a point and shoot that I lked I'd probably take that; indeed mirrorless is fast becoming a good support choice for "well featured like a DSLR, but much smaller" desires by many. IT's not as big, bulky nor imposing and a modest setup is smaller than a DSLR. Yeah it costs the same (if not more) but it at least means that you've got something capable that isn't vast in size.