Help a newbie. TZ30 P'n'S or EPM2 mirrorless?

[easyeasy]

Dear forum, my first post!

I learned the basics with a basic Nikon D50 camera long ago - and I have ever since used my iPhone 4S for everyday use and holidays. It is time to go back to something more than my iPhone, primarily to get some good holiday shots of the family and just as importantly my hobby: nature shots while traveling.

It is my impression it all comes down to the Panasonic Lumix TZ30 P'n'S or the more sophisticated Olympus EPM2 mirrorless with interchangeable lenses.

What is your suggestion based on your experiences if I mainly use it for holidays 4-5 times a year. I have been very happy with my iPhone 4S quality when stitching to panoramas - so is the freedom and major prices bump of the Olympus worth it for me you reckon? What should I know about the differences that are the usual dealbreakers?

Thanks in advance!