Jordan Strauss/Invision for Walgreens/AP
09/25/2013 at 07:00 AM EDT
Lamar Odom has broken his silence.
After weeks of being shadowed by reports of infidelity, drug abuse and marital woes
, the husband of reality star Khloé Kardashian took to Twitter on Tuesday to speak out against his father, Joe Odom, who blamed his daughter-in-law and her family for his son's troubles in an interview.
"He wasn't there 2 raise me," Odom, 33, wrote on his Twitter page
. "That man wasn't even invited to my wedding. He has never met my mother in law and some of my other family. How can a man who has NOT once called me to check on my well being have the nerve to talk so recklessly about his own 'son.' "
The athlete, who is not currently signed to a team, admits he has been going through a "dark time," but slams reports his wife and her family have been anything but supportive.
"He disrespecting the ONLY FAMILY that has loved me without expecting anything in return," he wrote. "They are the ONLY ones that have been here consistently 4 me … Say what you want about me but leave the ones who have done nothing but protect and love me out of this!"
Before news broke of Odom's troubles, a source told PEOPLE the couple – who will mark their fourth wedding anniversary this Friday – had planned to renew their vows.
Instead, Kardashian, 29, and Odom have been living separately
since he was charged earlier this month with a misdemeanor count of driving under the influence and checked in and out of rehab after a day
The free agent was spotted entering his downtown residence Tuesday afternoon looking thin in a black shirt while his wife partied at Tru Hollywood with friends Monday night after a weekend appearance in Las Vegas
for the iHeartRadio music festival.
Reporting by MARIAH HAAS and AILI NAHAS