"She doesn't think I'm in shape," the former president, 63, said Wednesday at the Pete Peterson Foundation's Fiscal Summit in Washington, D.C.
In addition to walking Chelsea down the aisle for her summer wedding, Clinton was told by his daughter that he's also "gotta look good," he says. "I said, 'Well, what's your definition?' And she said, 'Oh, about 15 pounds.' "
His progress so far? "I'm halfway home," he says.
Clinton also said he doesn't know if he's prepared to give Chelsea, 30, away because, "I told her when she was a little girl that it would suit me if she didn’t move out until she was 25 and didn’t get married until she was 35." Still, the proud dad adds he's "really fortunate" Chelsea will be marrying her childhood friend Marc Mezvinsky.
"I really like my future son-in-law a lot and I admire him a great deal," he says. "He's a fine human being so Hillary and I are delighted."
Meet Sandra Bullock's baby! For the whole story – including photos of her son Louis, an emotional interview about her breakup with Jesse James and her life as a new mom – pick up the new issue of PEOPLE, on newsstands Friday