Randy Travis Discharged from Hospital

Randy Travis

Gary Miller/Filmmagic

Randy Travis Discharged from Hospital

Wednesday July 31, 2013 07:45 PM EDT

A little over three weeks since being hospitalized in Texas, Randy Travis has been discharged and relocated to a physical therapy facility.

"Thanks to all the fans and friends for your continued prayers and support as Randy continues on the road to recovery," the star's fiancée, Mary Davis, said in a statement on Wednesday.

The Grammy winner, 54, was initially admitted for presumptive cardiomyopathy and congestive heart failure. Though he had been improving initially, he suffered a stroke and underwent surgery on July 10 to relieve pressure on his brain.

During his stay at Heart Hospital Baylor Plano in Texas, those closest to him rushed to his side and plenty of famous friends – including Lance Armstrong – passed along their well wishes.

"I said a prayer for him last night," fellow country singer Darius Rucker told PEOPLE. "He's in my prayers, and I wish him nothing but a speedy recovery."