I wouldn't be bothered by his voice, there are other elements that can over look that flaw, like is he a good person? Does he respect women? Is he loyal? Does he value the relationship? If so I wouldn't consider it to be a major flaw then.
There was this one girl I knew I could not talk to. She had a very high pitched voice and I just wanted to slap her when she talked. Yet, everything she did was a porn pose.