Gisele Bundchen and husband Tom Brady make headlines pretty consistently, between her modeling career and his high-status NFL job. Usually, having an A-list celeb name is a good thing, but the couple might find it detrimental to their social life if a certain country club has its way.

According to the Boston Globe, The Country Club is pretty guarded when it comes to privacy and the privacy of its members, and Bundchen and Brady might be a bit too famous to be allowed entry.

“I don’t know what they’ll do about Brady. The Country Club believes your name should appear in the newspaper just two times: When you’re born and when you die,” a source said.

One member who spoke with the Boston Globe says it’s not about fame and fortune, but rather who a person is and what sort of values they have. However, the club has been called “exclusionary” in the past and was accused of “blackballing” former governor Deval Patrick in his memoir. The main issue, according to more than one source, is that the high-profile couple are often tailed by the media and have been tabloid fodder on more than one occasion; him for “Deflategate” after the Patriots allegedly used deflated balls to help them win this year’s AFC game against the Colts; her for the photos she posts on social media, including one of her breastfeeding while having her hair and makeup done, and another showing her riding on an ATV with her young children with no helmets.

Rumors have flown online that Tom Brady will file a defamation suit if he’s cleared of any wrongdoing in the “Deflategate” case, but nothing has been confirmed.

“Brady would need to show that not only were public statements made about him false and damaging to his reputation, but he’d have to show those statements were made with actual malice, which means knowingly or intentionally,” said legal analyst Michael McCann.