Early Access Video: We Were Right! Real Inner Misalignment (Patreon)

We Were Right: Real Inner Misalignment

Some people ran real versions of the thought experiments from the 'Mesa-Optimisers' videos! What they found won't shock you (if you've been paying attention) Previous videos on the subject: The OTHER AI Alignment Problem: Mesa-Optimizers and Inner Alignment: https://youtu.be/bJLcIBixGj8 Deceptive Misaligned Mesa-Optimisers? It's More Likely Than You Think...: https://youtu.be/IeWljQw3UgQ The Paper: https://arxiv.org/abs/2105.14111 The Interpretability Article: https://distill.pub/2020/understanding-rl-vision/ With thanks to my wonderful Patrons at http://patreon.com/robertskmiles: - Gladamas - Timothy Lillicrap - Kieryn - AxisAngles - James - Jake Fish - Scott Worley - James Kirkland - James E. Petts - Chad Jones - Shevis Johnson - JJ Hepboin - Pedro A Ortega - Clemens Arbesser - Said Polat - Chris Canal - Jake Ehrlich - Kellen lask - Francisco Tolmasky - Michael Andregg - David Reid - Peter Rolf - Teague Lasser - Andrew Blackledge - Brad Brookshire - Cam MacFarlane - Craig Mederios - Jon Wright - CaptObvious - Brian Lonergan - Girish Sastry - Jason Hise - Phil Moyer - Erik de Bruijn - Alec Johnson - Ludwig Schubert - Eric James - Matheson Bayley - Qeith Wreid - jugettje dutchking - James Hinchcliffe - Atzin Espino-Murnane - Carsten Milkau - Jacob Van Buren - Jonatan R - Ingvi Gautsson - Michael Greve - Tom O'Connor - Laura Olds - Jon Halliday - Paul Hobbs - Jeroen De Dauw - Cooper Lawton - Tim Neilson - Eric Scammell - Igor Keller - Ben Glanton - Tor Barstad - Duncan Orr - Will Glynn - Tyler Herrmann - Ian Munro - Jérôme Beaulieu - Nathan Fish - Peter Hozák - Taras Bobrovytsky - Jeremy - Vaskó Richárd - Benjamin Watkin - Andrew Harcourt - Luc Ritchie - Nicholas Guyett - 12tone - Oliver Habryka - Chris Beacham - Nikita Kiriy - Andrew Schreiber - Steve Trambert - Braden Tisdale - Abigail Novick - Serge Var - Mink - Chris Rimmer - Edmund Fokschaner - April Clark - J - Nate Gardner - John Aslanides - Mara - ErikBln - DragonSheep - Richard Newcombe - Joshua Michel - P - Alex Doroff - BlankProgram - Richard - David Morgan - Fionn - Dmitri Afanasjev - Marcel Ward - Andrew Weir - Kabs - Ammar Mousali - Miłosz Wierzbicki - Tendayi Mawushe - Wr4thon - Martin Ottosen - Andy K - Kees - Darko Sperac - Robert Valdimarsson - Marco Tiraboschi - Michael Kuhinica - Fraser Cain - Robin Scharf - Klemen Slavic - Patrick Henderson - Hendrik - Daniel Munter - Alex Knauth - Kasper - Ian Reyes - James Fowkes - Tom Sayer - Len - Alan Bandurka - Ben H - Simon Pilkington - Daniel Kokotajlo - Yuchong Li - Diagon - Andreas Blomqvist - Iras - Qwijibo (James) - Zubin Madon - Zannheim - Daniel Eickhardt - lyon549 - 14zRobot - Ivan - Jason Cherry - Igor (Kerogi) Kostenko - ib_ - Thomas Dingemanse - Stuart Alldritt - Alexander Brown - Devon Bernard - Ted Stokes - Jesper Andersson - DeepFriedJif - Chris Dinant - Raphaël Lévy - Johannes Walter - Matt Stanton - Garrett Maring - Anthony Chiu - Ghaith Tarawneh - Julian Schulz - Stellated Hexahedron - Caleb - Clay Upton - Conor Comiconor - Michael Roeschter - Georg Grass - Isak Renström - Matthias Hölzl - Jim Renney - Edison Franklin - Piers Calderwood - Mikhail Tikhomirov - Matt Brauer - Mateusz Krzaczek - Artem Honcharov - Tomasz Gliniecki - Mihaly Barasz - Mark Woodward - Ranzear - Neil Palmere - Rajeen Nabid - Clark Schaefer - Olivier Coutu - Iestyn bleasdale-shepherd - MojoExMachina - Marek Belski - Luke Peterson - Eric Rogstad - Eric Carlson - Caleb Larson - Max Chiswick - Aron - Sam Freedo - slindenau - Johannes Lindmark - Nicholas Turner - Intensifier - Valerio Galieni - FJannis - Grant Parks - Ryan W Ammons - This person's name is too hard to pronounce - contalloomlegs - Everardo González Ávalos - Knut Løklingholm - Andrew McKnight - Andrei Trifonov - Aleks D - Mutual Information - Tim - A Socialist Hobgoblin - Bren Ehnebuske - Martin Frassek - Sven Drebitz - Quabl - Valentin Mocanu - Philip Crawford - Matthew Shinkle - Robby Gottesman - Juanchi http://patreon.com/robertskmiles