Palm Beach is abuzz over a woman's allegations that she was raped at the Kennedy family compound.

"I think it's kind of unfair, all of this innuendo, without any facts as to what happened," George Preston, who lives down the street from the walled Kennedy estate, said Tuesday. "We don't even know that this is true."Police have filed no charges and have refused to say whether anyone associated with the Kennedy family is a suspect in the alleged rape Saturday.

A spokesman for U.S. Sen. Edward Kennedy issued a statement Monday saying the Massachusetts Democrat spent the Easter weekend with his family at the Palm Beach estate but was not involved in the incident.