The part in the beginning with Roxy and Rudeus was framed very differently in the LN. While Roxy did come into the room with the intention to do what happened, she actually didn't initiate it. She actually ends up in his lap, and goes on a whole 2 paragraph tangent talking him into maybe doing it with her, and Rudeus caves and in his own narration pretty much admits that he took his frustration out on her. When he wakes up the morning after, he thinks to himself that he really fucked up, and also about how he was too rough with Roxy (granted he hadn't been really eating much at all for 1-2 weeks, so it wasn't as if he could've put too much strength into it, but still). Also 8:36 glad to see that we finally have Jirou/Dillo making an appearance.

Spoiler since you were talking about Sylphy having another guy she likes to join their group love... The next lover in the group will be Rudy's, not Slyphy's, husband.

I think what they did in episode 23 was increase the drama, instead of toning it down like they do in the novel, and spread the blame to both sides. I think the author knows that no matter what Mushoku does, it won't be as popular as (Jujutsu Kaisen, My Hero Academia, Naruto), which is a shame because in my opinion, Mushoku's story is a better story than those animes.