If that person starts being an annoying asshole, I should be able to walk away from the harassment while still maintaining my conversation
Except for the notification part, that is how blocking works currently.
If someone is harassing you, just block that person, you won't see any content created by that person, while you can maintain communication with the rest