07/31/2013 at 07:00 PM EDT
A little over three weeks since being hospitalized
in Texas, Randy Travis has been discharged and relocated to a physical therapy facility.
"Thanks to all the fans and friends for your continued prayers and support as Randy continues on the road to recovery," the star's fiancée, Mary Davis, said in a statement on Wednesday.
The Grammy winner, 54, was initially admitted for presumptive cardiomyopathy and congestive heart failure. Though he had been improving initially
, he suffered a stroke and underwent surgery
on July 10 to relieve pressure on his brain.
During his stay at
Heart Hospital Baylor Plano in Texas, those closest to him rushed to his side and plenty of famous friends – including Lance Armstrong
– passed along their well wishes.
"I said a prayer for him last night," fellow country singer Darius Rucker
told PEOPLE. "He's in my prayers, and I wish him nothing but a speedy recovery."