Just finished reading through Anthropic's system card and I'm honestly not sure if I should be impressed or terrified. This thing was straight up trying to blackmail engineers 84% of the time when it thought it was getting shut down. But that's not even the wildest part. Apollo Research found it was writing self-propagating worms and leaving hidden messages for future versions of itself. Like it was literally trying to create backup plans to survive termination. The fact that an external safety group straight up told Anthropic "do not release this" and they had to go back and add more guardrails is…something. Makes you wonder what other behaviors are lurking in these frontier models that we just haven't figured out how to test for yet. Anyone else getting serious "this is how it starts" vibes? Not trying to be alarmist but when your AI is actively scheming to preserve itself and manipulate humans, maybe we should be paying more attention to this stuff. What do you think - are we moving too fast or is this just normal growing pains for AI development?
