Home Artists Posts Import Register

Content

AI systems can be trained using demonstrations from experts, but how do you train them to out-perform those experts? Can this still be done even without clear win/loss criteria? And how do you do it safely?

https://youtu.be/u8dg0jGfKdg

Also, The Road to AI Safety Excellence is kind of live now! http://aisafety.info
Check it out if you're interested in becoming an AI Safety researcher.

Files

How to Keep Improving When You're Better Than Any Teacher - Iterated Distillation and Amplification

AI systems can be trained using demonstrations from experts, but how do you train them to out-perform those experts? Can this still be done even without clear win/loss criteria? And how do you do it safely? The Road to AI Safety Excellence: http://aisafety.info With thanks to my wonderful Patrons (https://www.patreon.com/robertskmiles): Steef Jason Strack Jordan Medina Jason Hise Scott Worley JJ Hepboin Pedro A Ortega Said Polat Chris Canal Nicholas Kees Dupuis James Richárd Nagyfi Phil Moyer Alec Johnson Clemens Arbesser Bryce Daifuku Simon Strandgaard Jonatan R Michael Greve The Guru Of Vision Volodymyr David Tjäder Julius Brash Tom O'Connor Erik de Bruijn Robin Green Laura Olds Jon Halliday Paul Hobbs Jeroen De Dauw Tim Neilson Eric Scammell Igor Keller Ben Glanton Robert Sokolowski anul kumar sinha Jérôme Frossard Sean Gibat Sun Sun andrew Russell Cooper Lawton Gladamas Sylvain Chevalier DGJono robertvanduursen Dmitri Afanasjev Brian Sandberg Einar Ueland Marcel Ward Andrew Weir Taylor Smith Ben Archer Scott McCarthy Kabs Kabs Kabs Tendayi Mawushe Jannik Olbrich Anne Kohlbrenner Bjorn Nyblad Jussi Männistö Mr Fantastic Wr4thon Archy de Berker Marc Pauly Joshua Pratt Shevis Johnson Andy Kobre Brian Gillespie Martin Wind Peggy Youell Poker Chen Kees Darko Sperac Truls Paul Moffat Jelle Langen Anders Öhrt Marco Tiraboschi Michael Kuhinica Fraser Cain Robin Scharf Oren Milman John Rees Shawn Hartsock Seth Brothwell Brian Goodrich Clark Mitchell Kasper Schnack Michael Hunter Klemen Slavic Patrick Henderson Long Nguyen Oct todo22 Melisa Kostrzewski Hendrik Daniel Munter Graham Henry Duncan Orr

Comments

Gladamas

I'm excited for RAISE, hopefully it gets more people working on AI safety. I wonder how to best spread the word among the computer science/math community.

loopuleasa

Upped the patron to 15 bucks. I see you are scaling well, your RAISE lessons are great. Use my patreon image, and my name is Lupuleasa Ionuț It is pronounced in Romanian <a href="https://translate.google.com/" rel="nofollow noopener" target="_blank">https://translate.google.com/</a>#view=home&op=translate&sl=ro&tl=es&text=Lupuleasa%20Ionu%C8%9B