Anthropic is making changes to its usage policy for the first time in over a year to reflect new and high-risk cases of misuse — including election interference, weapons development, surveillance, and health and financial uses. But one of the most significant changes prohibits “sustained and needless abusive or cruel behavior” toward Claude.
Last August, the company announced it would allow Claude to end conversations with “persistently harmful or abusive” users as part of its research into “model welfare.”
This “restriction” probably has more to do with the fact that these models are also “trained” on User/Human messages, so the more swearing/obscenities/vulgarity/profanity there are, in the trained material, the higher the chance these same models will include that same profanity in the output generated back to the Human.
But, even with the checkbox disabled, I reckon nothing guarantees privacy.
In case of the “privacy”, of course, systems like these that operate under a umbrella of liability are monitored 24/7 by dedicated teams, which is expected/normal for any reasonably popular service.
From a viewpoint of the algorithm’s creator, this may seem awful, when your algorithm is getting much vulgar attitude, but let’s be real here. You try making that algorithm talk to the human mimicking another human, and now limit the human within your own environment? A human who also pay you for an access, too? This feels unfair, or borderline near fashism, sorry…
Such algorithms are art under-the-hood, mathematically speaking, and are/should be respected, sure. But, it’s ridiculous/dystopian to prohibit profanity against an algorithm, a bot with banish risks against alive human… It’s simply inhumane to ban a Human for it, I believe. This is an algorithm that must support a Human - not judge it. Only a Human is supposed to judge another Human in person - this is live, fair, and humane.