do you feel beautiful and sexy in them? if so, then who cares about height its perfectly ok to be taller than the man. it doesn't tell anyone that you wear the pants and it certainly doesn't make your realtionship bad..
you feel good you look good your man loves it, why not?
but if he's a midget, then that's just not fair... jk
Unless it is him feeling uncomfortable about it, then don't be too self concious. You got to look good!
but if it really worries you that much, just wear them out to dates where you'll be at a resturant or movie or something. When you can sit down. Then you can save ur cute flats for the dances and things like that AND still look hot in ur heels :)