The former 19 Kids and Counting star has left rehab, PEOPLE has learned.
"If nothing else, this is a happy time for their kids," a source tells PEOPLE.
His family confirmed the news on their website.
"Josh has completed his residential rehabilitation program. We are so thankful for everyone who worked with Josh in this program," the statement reads. "It was a crucial first step in recovery and healing for Josh. Josh has now returned to Arkansas, where he will continue professional counseling and focus on rebuilding relationships with his family. We look to God for help and guidance and place all of our trust in Him. We are forever grateful for the love and prayers offered by so many and hope you will continue to pray in the days ahead."
Duggar, 28, checked into a faith-based rehab facility in Rockford, Illinois, in August following a series of scandals, including his public confession to being addicted to pornography and to being unfaithful to his wife Anna.
Ahead of his exit from rehab, Josh's family spoke out about forgiving the star.
"I definitely have forgiven Josh. It is a process, though, that you have to work through in your heart," Josh's sister Jessa (Duggar) Seewald told PEOPLE exclusively. "And trust is not quickly rebuilt. It is something that takes a while. We love him very much, though, and we are very hopeful for the future."
In January, Anna, 27, released a statement about her difficult year and revealed that she visited Josh in rehab, calling it "an important step on a long difficult road."
"Please continue to pray for me, Josh and our children," she said.
Anna also spoke out during the TLC special Jill & Jessa: Counting On, tearfully telling Josh's sister Jessa (Duggar) Seewald that the experience has "been a good opportunity to draw close to God and just trusting God for his wisdom to take the next step."
After the scandal broke, a source told PEOPLE that Anna, who also grew up in a religious and conservative household, would stand by her man.
"Anna will not leave him. As with her in-laws, she is turning more to her faith than ever," the source said in August. "She is fully and permanently committed to her marriage and her children. And she'll have the support of Jim Bob and Michelle and everyone else in their circle in terms of staying with him and making this work. Divorce is not even something that will be discussed."
The family's new show Counting On premieres Tuesday at 9 p.m. ET on TLC.
"The Duggar Family has confirmed to TLC that Josh has completed his residential treatment program," the network says in a statement. "Josh is not appearing in Jill & Jessa: Counting On. We wish the family continued healing."