The pair, who are currently spending time together at Sean "Diddy" Combs's house on Miami Beach's Star Island, are staying indoors as they hash things out.
"They are definitely together and care a great deal about each other," says a Miami source. "They feel like staying in and working through their issues. So far they have not wanted to go out."
Brown, however, did venture out earlier on his own. On Thursday he hit the water to Jet Ski with pals.
Rihanna and Brown's reconciliation comes nearly three weeks after Brown, 19, allegedly battered the "Umbrella" singer on Feb. 8.
Chris gets star tattoos to match Rihanna's
2007: Chris spills the secrets behind his smooth moves
Rihanna tops PEOPLE's Best Dressed list!
Revisit Rihanna & Chris' summer lovin' in Barbados