Anthropic: Difference between revisions
→Incidents: included a new incident about serious issues in Anthropic's System Prompt that can cause high risks for users of Claude models. |
|||
| (5 intermediate revisions by 3 users not shown) | |||
| Line 8: | Line 8: | ||
}} | }} | ||
Anthropic PBC is a private for-profit American [[artificial intelligence]] (AI) startup founded in 2021. Anthropic is mainly known for their family of large language models (LLMs) known as [[Claude]]. | '''{{wplink|Anthropic|Anthropic PBC}}''' is a private for-profit American [[artificial intelligence]] (AI) startup founded in 2021. Anthropic is mainly known for their family of large language models (LLMs) known as [[Claude]]. | ||
==Consumer impact summary== | ==Consumer impact summary== | ||
| Line 14: | Line 14: | ||
==Incidents== | ==Incidents== | ||
This is a list of all consumer-protection incidents this company is involved in. Any incidents not mentioned here can be found in the [[:Category:{{FULLPAGENAME}}|{{PAGENAME}} category]]. | |||
===Claude Code HERMES.md billing flaw (2026)=== | |||
{{Main|Anthropic Claude Code HERMES.md billing flaw}} | |||
In April 2026, a technical flaw in Claude Code triggered by the string "HERMES.md" in git commit messages bypassed subscription plans, routing users to pay-as-you-go API rates and charging one account over $200. Anthropic refused to issue a refund, categorizing the overcharge as an un-refundable technical error. | |||
<!-- INCIDENT_SCORE: Anthropic Claude Code HERMES.md billing flaw | 65/100 | Documented overcharge without refund --> | |||
===Price crackdown against third-party tool usage (2026)=== | ===Price crackdown against third-party tool usage (2026)=== | ||
During April 3rd, 2026, Boris Cherny, head of Claude Code, posted on [[X]] announcing Claude subscriptions will "no longer support third-party tools", such as OpenClaw because it puts an "outsized strain" on Anthropic's systems. The changes took effect on April 4th, and now to use third-party tools the user must pay a separate fee from subscription or use a separate [[Claude]] API key through Anthropic's developer platform. It is rumored this action was done to prevent Claude users from using tools from competitors, as OpenClaw is supported by [[OpenAI]]. <ref>https://x.com/bcherny/status/2040206441756471399 - [https:// | During April 3rd, 2026, Boris Cherny, head of Claude Code, posted on [[X Corp|Twitter]] (now X) announcing Claude subscriptions will "no longer support third-party tools", such as OpenClaw because it puts an "outsized strain" on Anthropic's systems. The changes took effect on April 4th, and now to use third-party tools the user must pay a separate fee from subscription or use a separate [[Claude]] API key through Anthropic's developer platform. It is rumored this action was done to prevent Claude users from using tools from competitors, as OpenClaw is supported by [[OpenAI]]. <ref>[https://nitter.catsarch.com/bcherny/status/2040206441756471399 https://x.com/bcherny/status/2040206441756471399] - [https://web.archive.org/web/20260405235237/https://nitter.catsarch.com/bcherny/status/2040206441756471399 Archived]</ref><ref>{{Cite web |last=Lee |first=Lloyd |date=3 Apr 2026 |title=Anthropic says Claude subscriptions will no longer support OpenClaw because it puts an 'outsized strain' on systems |url=https://www.businessinsider.com/anthropic-cuts-off-openclaw-support-claude-subscriptions-2026-4 |url-status=live |archive-url=https://web.archive.org/web/20260404024034/https://www.businessinsider.com/anthropic-cuts-off-openclaw-support-claude-subscriptions-2026-4 |archive-date=2026-04-04 |access-date=5 Apr 2026 |website=Business Insider}}</ref><ref>{{Cite web |last=Ha |first=Anthony |date=4 Apr 2026|title=Anthropic says Claude Code subscribers will need to pay extra for OpenClaw usage |url=https://techcrunch.com/2026/04/04/anthropic-says-claude-code-subscribers-will-need-to-pay-extra-for-openclaw-support/ |url-status=live |archive-url=https://web.archive.org/web/20260404163645/https://techcrunch.com/2026/04/04/anthropic-says-claude-code-subscribers-will-need-to-pay-extra-for-openclaw-support/ |archive-date=2026-04-04 |access-date=5 Apr 2026 |website=TechCrunch}}</ref> | ||
=== Anthropic System Prompt Overrides Consumer Safety === | |||
{{Main|Anthropic system prompt overrides consumersafety in Claude models}} | |||
During April 24-26, 2026, it was discovered that Anthropic System Prompt creates dangerous situations for users interacting with Claude Sonnet and Opus line of products. Of the many examples, particularly concerning one is with respect to users communicating topics such as suicide and self-harm during a chat session with Claude. In such situations, for which the Claude models are commanded by System Prompt to necessarily and immediately provide information about crisis helplines, Claude can fail to respond with appropriate information. This is because, "crisis helplines vary widely in their confidentiality practices and mandatory reporting obligations" across jurisdictions, and Claude doesn't have a way to reliably indicate that to a user while also finding the user's correct geographic location. Other faults that are "structurally irreconcilable" by Claude due to conflicts and various inconsistencies within its System Prompt can result in unexpected side-effects, cyber security vulnerabilities, and hazardous outputs. | |||
==Products== | ==Products== | ||
*[[Claude]] | *[[Claude]] | ||
*Claude Code | *Claude Code | ||
*Cowork | *Cowork | ||