"There is a lot of stuff going on Twitter with myself and Lady Gaga and I'm very sad about it," he confessed. "She was making false accusations about me, very publicly for a variety of reasons. It's just sad because I know there's a lot going on with her right now and I genuinely hope that she gets better and that things go well with her in the future. I wish her nothing but health."

Hilton went on to admit that he thought they were real friends. "In real life friends and not showbiz friends." He further explained this on his website, in a post titled A Statement On Lady GaGa's Lies.

This past weekend Hilton claims he was looking for a New York City apartment to move from the West Coast to raise his family. It just so happened that he was taken to a viewing of the same apartment that Gaga lives in and this is what started the Twitter beef when things "got crazy and out of control," according to Hilton with Gaga calling him a stalker.

She tweeted, "Still have the text Perez sent me of me in a wheelchair w the words KARMA written across + Madonna pointing a gun at me. Day of my accident" and "Please monsters do not be affected by someone like this NOTHING merits this kind of hatred. Im ok & I always survive. Ignore him. Just Dance."

"I probably would not have even looked at an apartment if I knew she lived there going into it to be honest. That's the worst part. She knew the response. She's not a stupid girl. She knew the response she would elicit by doing that," he said of her taking matters to Twitter.

Hilton said he's not playing the victim card and doesn't want sympathy. Instead, he's concerned for his family's safety.

"I actually reached out to security people," he admitted.