Josh Duggar may be in for some big-time disappointment when he finally leaves the rehab center where he’s been getting therapy for his “sexual sins.” In a clip for Sunday’s premiere episode of Jill & Jessa: Counting On, two of his brothers make it unequivocally clear they no longer look up to him.

“You look at your brother and you want to think the best about him. I always wanted to be like him. But one of the toughest things I ever had to tell my older brother was, ‘I don’t want to be like you anymore,’” John-David Duggar, 25, says, adding that he feels it’s now his job to be the new role model for the former 19 Kids and Counting family as the second eldest Duggar brother.

“It’s a big load. It’s a big weight upon me now,” he adds. “I’ve got a whole bunch of younger siblings looking up to me, and I’ve got to be an example to them. Because whatever I am, that’s what they want to be. I know that’s what it was for me and Josh.”

John-David also shares that just as “everything started to settle down” from Josh’s first scandal–in which he admitted in May to molesting five minor girls, including four of his sisters, when he was a teenager–the family “got word of a second thing that we had no clue about.”

“That was a little more of a shock probably than the first stuff coming out,” he says about learning Josh Duggar had cheated on his wife, Anna Duggar, during the Ashley Madison hack. He also admitted to a pornography addiction in August.

“Whenever somebody you respect the most is willing to get up and proclaim what we believe as Christians, about being true to your wife, you’d never expect that person to be the one that’s involved in it,” John-David Duggar says. “It broke my heart.”

“Even after the first thing that came out when he was younger, I never had quite as close of a relationship as I did whenever I was really young,” Joseph Duggar, 20, says of Josh Duggar reveals. “But over time, it’s built back up. But then whenever this next situation came up, it blew my mind. I had no idea.”

Josh Duggar's younger brother John-David tells him, "I don't want to be like you anymore." https://t.co/YPIJAiD33o pic.twitter.com/RU75Z5RO5P

— EntertainmentTonight (@etnow) December 11, 2015

Josh Duggar and his sex scandals are the reason behind TLC canceling 19 Kids and Counting. His actions have had a very negative impact on his entire family.

Will you tune in on Sunday night to watch Jill & Jessa: Counting On, to see even more of how the Duggar family is recovering after Josh Duggar’s sex scandals? The show airs on TLC at 8 p.m. ET.