When I was in high school (or our equivalent) I chose three course: maths, physics and chemistry. With good grades in those, as well as all the obligatory course, I could pretty much do whatever I wanted. And, boy did it pay off! As a chem student I was supposed to have a basic understanding of physics, and was signed up for a physics course at uni. However, my high school physics was enough, and I didn't have to take physics again. I lost some study points, but I could choose something else I wanted to take.
I wouldn't give up on the possibilities that you might come to like the natural sciences, all of which require basic understanding of maths, especially calculus (which, honestly, isn't all that hard).
If you have really set your mind on something, then go for it. If you're still in doubt of your future career, then I'd suggest to take courses which allows you to pursue anything you want. At least, get good grades in the course you're taking.