OpenAI’s chief scientist says no lab should keep scaling at maximum speed — from thenextweb.com by Ana Maria Constantin
OpenAI put out two posts on Sunday. Its research organisation now uses 3.1 agent-workdays for every human one, and its chief scientist says no lab has solved alignment well enough to keep scaling at full speed. The case for an OpenAI slowdown arrived with the numbers against it.
Chief scientist Jakub Pachocki wrote the second post, an essay called An Alien Mind. It closes on a line that reads oddly from the man who runs research at the company shipping fastest.
“Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer,” he wrote.
…
He is not gentle about the stakes either. “This is a time that calls for extreme caution. I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence,” Pachocki wrote.