New details are emerging in the Simon Cowell/Lauren Silverman scandal. According to Us Weekly, a source close to Lauren revealed that they “started having an affair four years ago.” Last week, the news of Simon knocking up his best friend’s wife blindsided everyone, because Lauren, 36, is still married to Andrew Silverman. The August 19 issue of Us Weekly reveals that Simon, 53, befriended Andrew and Lauren in 2004 at the Barbados’ Sandy Lane resort. Andrew, 37, a co-owner of Panama’s Veneto Hotel & Casino, filed for divorce in July, citing adultery and naming Simon as a co-respondent. However, Simon’s lawyers are working to get his name off the divorce papers, according to a report in the New York Daily News. “The lawyers are working out an agreement to drop the adultery claims,” a source close to Lauren told the paper. For his part, Simon, who’s currently on vacation, has not said anything about the situation to the media. The source confided, “Every year he goes to either St. Tropez of St. Barth’s. Last year Andrew and Lauren went with him.” Lauren, who posted the above photo to her Instagram, is reportedly hiding out in the Hamptons with her seven-year-0ld son, Adam. ~ Marriska Fernandes