Search Results: too loved by family

For a little background:

I was raised in a religious Asian family. I have 3 siblings total, the sibling I'll be talking about is my eldest brother. Growing up we were completely the opposite to each other. He was very family oriented and extremely gifted academically whilst I was a bit of a rebel and didn't care too much about school. I fell in love with an atheist white man and when my family found out, they were extremely unsupportive to say the least. I didn't care and at the age of 18 I dropped out of school and married him. After I had my first child, I realized I wanted my family in my children's lives. I organized a baby shower and invited them all, only my eldest brother came. He was very active in my son's life, at times more so than his own father and when my daughter was born he was very active in her life too. By then he had accumulated a lot of wealth through various means so could afford to spoil them by buying them gifts and taking them to Disneyworld etc. He doesn't want any kids so treats mine like his own. About a year ago I got a divorce from my children's father and since have been struggling even more financially than before the divorce (my ex was a deadbeat). None of my friends are willing to loan me anymore money as I am already indebted to them and I have no way to turn. Although my brother loves my kids, he still resents and hates that I ruined our family's reputation by marrying a white atheist so I know that if I asked him for help financially, he more than likely would refuse.

Would I be wrong in withholding my children from seeing him if he refuses to help me?