My coworker ghosted me and I need help on how to handle the situation?

I had a short fling with my coworker. I slept over his house twice but couldn't have sex. He initiated but I said no. I still really liked him though but then he ghosted me. He went from talking to me everyday/texting to radio silence. I see him in the office and I get awkward. I texted him like 2 weeks ago and he responded but he didn't really care to keep the convo going. I still have to see him cause he works with me. But I don't know what I did wrong I feel like I’m bothering him but I can't completely go ghost on him only because we work together. He even sometimes goes to lunch with my coworkers and I and I don't know what to do cause I really like him but its clear to me that he love bombed me and doesn't care. Should I no longer go to lunch if he comes? How do I move forward because I get the vibe he is annoyed by me and I’m not trying to annoy him or get in his way. I just liked him and thought he liked me but I think he was using me for sex he didn't get? How should I act towards him in the office?

My coworker ghosted me and I need help on how to handle the situation?
Post Opinion