Anthropic’s Claude 3 causes stir by seeming to realize when it was being tested
An Anthropic engineer shared a story from internal testing of Opus where the model seemingly demonstrated a type of “metacognition” or self-awareness during a “needle-in-the-haystack” evaluation, leading to both curiosity and skepticism online.