Hemsley died at his home in El Paso, Texas, police say. A cause of death was not immediately known.
Introduced each week with the gospel Movin' On Up theme song, producer Norman Lear's show gave Hemsley a larger-than-life character who delivered a brand of comedy all his own.
Zingers like "If I paid you to think, you could cash your check at the penny arcade!" paired with over-the-top gestures left audiences across the country in stitches. The show has lived on for years in reruns on cable.
The actor, who first played the role in All in the Family – going head to bigoted head with Carroll O'Connor's Archie Bunker – went on to embody a softer character, Deacon Ernest Frye on TV's Amen.
Born in South Philadelphia, Hemsley dropped out of high school to join the Air Force. He returned to Philadelphia and worked for the U.S. Postal Service, while taking acting classes at night.
After performing with local groups in Philadelphia, Hemsley moved to New York to make his Broadway debut as Gitlow in Purlie.
While touring with the production, television writer and producer Lear contacted Hemsley to play the role of Jefferson on his new sitcom, All in the Family. Hemsley hesitated to accept but Lear held the role open for him and two years later, Hemsley joined the cast.
Less than two years after Hemsley made his television debut, he and All in the Family costar Isabel Sanford were given their own spin-off in The Jeffersons. The series earned Hemsley Emmy and Golden Globe nominations in 1984 and 1985 respectively.
Sanford died in 2004 at age 86.
In 1986, Hemsley was cast as Deacon Ernest Frye in the NBC series, Amen. The role would last five seasons, ending in 1991.
He was also a professional singer and released a single on Sutra Record called "Ain't That a Kick in the Head" in 1989. In 1992, he released Dance, an R&B album.
Although he retired from television acting, Hemsley joined Sanford through the late '90s and early 2000's to reprise their roles as George and Louise "Weezy" Jefferson on guest spots. The duo appeared on The Fresh Prince of Bel-Air and in commercials for Old Navy, Gap and Denny's.
Hemsley had no wife or children.