Josh, 27, and his parents Jim Bob and Michelle Duggar broke their silence Thursday on the Duggar family website.
Introducing Josh's statement, Jim Bob and Michelle wrote, "When we learned of this late last night our hearts were broken. As we continue to place our trust in God we ask for your prayers for Josh, Anna, our grandchildren and our entire family."
Josh put forth this statement: "I have been the biggest hypocrite ever. While espousing faith and family values, I have secretly over the last several years been viewing pornography on the internet and this became a secret addiction and I became unfaithful to my wife.
I am so ashamed of the double life that I have been living and am grieved for the hurt, pain and disgrace my sin has caused my wife and family, and most of all Jesus and all those who profess faith in Him.
I brought hurt and a reproach to my family, close friends and the fans of our show with my actions that happened when I was 14-15 years old, and now I have re-broken their trust.
Courtesy Josh Duggar
As I am learning the hard way, we have the freedom to choose our actions, but we do not get to choose our consequences. I deeply regret all hurt I have caused so many by being such a bad example.
I humbly ask for your forgiveness. Please pray for my precious wife Anna and our family during this time."
RELATED VIDEO: Why the Duggars Are Shocked over How Much Josh's Scandal Has Cost Them
The admission comes just three months after a 2006 police report revealed that Josh had been accused of molesting five underage girls as a teen, and just one month after the birth of his and Anna's fourth child.
A rep for Josh and the Duggar family did not immediately respond to calls for comment about the future of the couple's marriage.
For much more on the Duggars, pick up this week's issue of PEOPLE, on newsstands Friday