If he's being physically abusive to you, leave him. Make sure you contact the authorities or your family to ensure you do not become a victim of domestic abuse. If he truly loves you, he should not be abusive towards you.
That aside, religion should not be an issue. As with any relationship people will always have differences, whether it's politics, religion or lifestyle... many couples do get along with their differences.
It all depends how seriously and literally you take your religious background into account. If you have very strict parents who may despise you as a result of having a relation with someone of another religion or non-religion, then you may want to think about it, but your family should not hold you back in deciding who you want to be with. It is your own choice.
If you truly love him, and you can recognize that he loves you, it is your own decision to distance yourself from your family if they disapprove of it. You are the one in control of your own life.
Personally, i despise religion, but if i met a girl who was very religious and she liked me knowing i did not care much for religion, i personally would not be bothered about it. If there's a charm between you and him, and he has no problem with you practising your worship at the mosque or attending seasonal events -- as long as he is okay with it what can go wrong?
Sometimes arguing (in a kind way) can be good for both parties in a relationship, such as debating each others views on the world and origins of life. If you can live with that, questioning other peoples ideas and taking them into account, then you can happily live with them in a relationship. Many people have opposing views who end up in a relationship.
The most important thing is to find how seriously you take your religion. If you take your scripture as word for word, then you probably won't have much luck with the guy, but if you can keep open minded and respect an opposing view, you should be fine.
We all have different opinions and can still get along, whether it's politics, religion or even something less argumentative like tastes in music.