From Rational Animations.
In this video, we walk you through a plausible scenario in which AI could lead to humanity’s extinction. There are many alternative possibilities, but this time we focus on superhuman AIs developing misaligned personas, similar to how Microsoft’s Bing Chat developed the misaligned “Sydney” persona shortly after its release.
▀▀▀▀▀▀▀▀▀SOURCES & READINGS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
The video was inspired by this thread by Richard Ngo: https://x.com/RichardMCNgo/status/1798156694012490096
Detailed reporting of various incidents related to "Sydney": Bing Chat’s misaligned persona: https://thezvi.substack.com/p/ai-1-sydney-and-bing#%C2%A7the-examples
Anthropic employee reports how Claude 3 Opus displayed situational awareness during tests: https://x.com/alexalbert__/status/1764722513014329620
The "pizza topping" event is also reported in Claude 3’s Model Card, page 23: https://www.anthropic.com/claude-3-model-card
Alignment Faking In Large Language Models: https://assets.anthropic.com/m/983c85a201a962f/original/Alignment-Faking-in-Large-Language-Models-full-paper.pdf
GPT-4 lying to the TaskRabbit worker about being a human with a vision impairment is documented in GPT-4’s System Card, in the "Potential for Risky Emergent Behaviors" section: https://cdn.openai.com/papers/gpt-4-system-card.pdf
Universal and Transferable Adversarial Attacks on Aligned Language Models: https://llm-attacks.org/
▀▀▀▀▀▀▀▀▀PATREON & MERCH▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🟠 Patreon: https://www.patreon.com/rationalanimations
🟢 Merch: https://rational-animations-shop.fourthwall.com
▀▀▀▀▀▀▀▀▀SOCIAL & DISCORD▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Rational Animations Discord: https://discord.gg/RationalAnimations
Reddit: https://www.reddit.com/r/RationalAnimations/
X/Twitter: https://twitter.com/RationalAnimat1
Instagram: https://www.instagram.com/rationalanimations/
▀▀▀▀▀▀▀▀▀PATRONS & MEMBERS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Thank you all 😭
Martin Skalstad Steen
Jackson Emanuel
Felix Akkermans
Joshua AC
Odet Abadia
John
Fraser Cain
Michael Hewitt
ttw
Ellis Jones
Danilo Stefani – Alessandra Erba
Amir Saboury
A
Forodriac Origamius
JanJan
Tristan
Matthew Shinkle
Alex Amadori
SQRT42Pi
David Piepgrass
Tomas Campos
Jana
Ingvi Gautsson
BlueNotesBlues
Terberlo.dog
Michael Andregg
Vladimir Silyaev
Alcher Black
Kristin Lindquist
Nathan Metzger
Glenn Tarigan
NMS
James Babcock
Colin Ricardo
Tor Barstad
steven michaels
Apuis Retsam
Stuart Alldritt
Chris Painter
Juan Benet
Christian Loomis
Edward Yu
Chad M Jones
Honyopenyoko
Neal Strobl
bparro
Danealor
loopuleasa
Craig Falls
Alex Hall
Ivan Bachcin
joe39504589
Klemen Slavic
blasted0glass
Scott Alexander
noggieB
Dawson
John Everett-Slape
Gabriel Ledung
Jeroen De Dauw
Superslowmojoe
Nathan Fish
Bleys
Ducky
rictic
Luke Freeman
ronvil
Michael Suazo
Fede Mathieu
Gdsf
rx
Lazy Scholar
BestProGaming
7ic7ac
Devin King
RED
Rinthean
Thomas Grip
Boris Bend
J H
Richard Stambaugh
Teo Val
Ken Mc
Alcher Black
AWyattLife
Torstein Haldorsen
Michał Zieliński
▀▀▀▀▀▀▀▀▀CREDITS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Directed by:
Hannah Levingstone | @hannah_luloo
Writers:
Emanuele Ascani
Producer:
Emanuele Ascani
Art Director:
Hané Harnett | @Peony_Vibes / @peonyvibes (insta)
Line Producer:
Kristy Steffens | https://linktr.ee/kstearb
Production Managers:
Jay McMichen | @Jay_TheJester
Kristy Steffens | https://linktr.ee/kstearb
Grey Colson | https://linktr.ee/earl.gravy
Quality Assurance Lead:
Lara Robinowitz | @CelestialShibe
Storyboard Artists:
Emmalaine Wright | @emmalainearts (insta)
Ethan DeBoer | https://linktr.ee/deboer_art
Hannah Levingstone | @hannah_luloo
Ira Klages | @dux
Lead Animators & Q/A:
Ethan DeBoer | https://linktr.ee/deboer_art
Lara Robinowitz | @CelestialShibe
Owen Peurois | @owenpeurois
Animators:
Colors Giraldo | @colorsofdoom
Ethan DeBoer https://linktr.ee/deboer_art
Ira Klages | @dux
Jay McMichen | @Jay_TheJester
Jodi Kuchenbecker | @viral_genesis (insta)
Jordan Gilbert | @Twin_Knight (twitter) Twin Knight Studios (YT)
Keith Kavanagh | @johnnycigarettex
Lara Robinowitz | @CelestialShibe
Michela Biancini
Owen Peurois | @owenpeurois
Patrick O’ Callaghan | @patrick.h264
Patrick Sholar | @Sholarscribbles
Renan Kogut | @kogut_r
Skylar O’Brien | @mutodaes
Vaughn Oeth | @gravy_navy
Zack Gilbert | @Twin_Knight (twitter) Twin Knight Studios (YT)
Background Lead:
Pierre Broissand | @pierrebrsnd (insta) / artstation.com/brsnd
Asset/Background Artists:
Hané Harnett | @peonyvibes (insta) @peony_vibes (twitter)
Olivia Wang | @whalesharkollie
Pierre Broissand | @pierrebrsnd (insta) / artstation.com/brsnd
Zoe Martin-Parkinson | @zoemar_son
Compositing Lead:
Grey Colson | https://linktr.ee/earl.gravy
Compositing:
Grey Colson | https://linktr.ee/earl.gravy
Ira Klages | @dux
Patrick O’ Callaghan | @patrick.h264
Renan Kogut | @kogut_r
Narrator:
Rob Miles | https://www.youtube.com/c/robertmilesai
VO Editor:
Tony Dipiazza
Original Soundtrack & Sound Design:
Johnny Knittle | @johnnyrk (insta) / johnnyrk.com
