Yes, he's worse than Hendrickson. Yes, he's worse than Love. He's worse than Paco's abusive stepfather. He's worse than his own abusive parents.
Joe is without a doubt the most horrible person on the entire show. Any act of kindness is from a place of psychopathic narcissism. If the straight up murder isn't enough, it's how carelessly he ruined Ellie's life and Nadia's life. He is a stalker and a liar and a manipulator and calling him "not a rapist" is just toeing a fine line because not one of his girlfriends would have slept with him had they known the truth (except Love who did know the truth and matched his freak). He's a terrible father who does not care about his son at all, he just cares about what "being a good father" means for his own self image.
If Joe weren't played so charismatically or if we didn't get his inner monologue and instead sat in his long awkward silences this wouldn't be an unpopular opinion. Joe is a monster and the fact that there is any argument about that is the point of the show. Team Peach 🍑