Should I stop talking to her because I'm catching feelings for her?

There's a girl at work who doesn't get along with anyone except for me and another female worker from her church. Everyone talks bad about her except for me. She invited me to her house twice but cancelled both times. People are already speculating something is going even though that is not the truth. I do like her and wouldn't mind being in a relationship with her. So I texted her yesterday that we should stop talking to each other. How should I tell her it is because I'm catching feelings for her and she might not like me back?
Should I stop talking to her because I'm catching feelings for her?
Post Opinion