09/14/2013 AT 02:20 PM EDT
Like father, like son? Not so fast!
Rumors are flying Demi Moore
is dating Hard Rock mogul Peter Morton after being linked to his son Harry Morton
earlier this year, but sources tell PEOPLE they remain skeptical of the speculation.
Though Peter, 66, and Moore, 50, "have spent time together" recently, the actress is telling friends she's "not dating Peter" and insists the chatter is all "nonsense," a Moore insider tells PEOPLE.
The last time the duo were spotted out publicly was on Father's Day in June, when they joined Harry for dinner at Giorgio Baldi in Beverly Hills.
Moore has been close to the Morton family for many years, and she and Peter hang out "because they're friends," says a Morton source.
The actress was first linked to Harry, 31, in January, and though the two appeared to split after six months of dating, they have remained close.
"They have been hanging out off and on for nearly a year now," says another source who has seen the pair in Miami.
The younger Morton is the owner of the Pink Taco restaurant chain and reportedly dated Lindsay Lohan
in the past.
As for whether Moore and Ashton Kutcher
, 35, are nearing a divorce settlement after being spotted at a tech conference together earlier this week, an entertainment source says the two are still fighting over money.
"Things have dragged out over large amounts of money," says the source. "But it should be winding down."
Reporting by LINDA MARX