{"id":99257,"date":"2026-09-29T13:25:11","date_gmt":"2026-09-29T17:25:11","guid":{"rendered":"https:\/\/danielschristian.com\/learning-ecosystems\/?p=99257"},"modified":"2026-09-29T13:27:23","modified_gmt":"2026-09-29T17:27:23","slug":"some-solid-warnings-about-ai-from-blake-montgomerys-recent-newsletter","status":"publish","type":"post","link":"https:\/\/danielschristian.com\/learning-ecosystems\/2026\/09\/29\/some-solid-warnings-about-ai-from-blake-montgomerys-recent-newsletter\/","title":{"rendered":"Some solid warnings about AI from Blake Montgomery&#8217;s recent newsletter"},"content":{"rendered":"<hr \/>\n<p><span style=\"color: #800000;\"><strong><em>Some solid warnings about AI from Blake Montgomery&#8217;s recent newsletter:<\/em><\/strong><\/span><\/p>\n<hr \/>\n<blockquote class=\"twitter-tweet\">\n<p dir=\"ltr\" lang=\"en\">There is an extensive and ongoing review related to our agents\u2019 use of internet access during training and evaluation. We\u2019ve been publishing summaries at the link below and will continue to.<\/p>\n<p>We have not been as fast as we would have liked but we are trying to balance our desire\u2026 <a href=\"https:\/\/t.co\/8zoMxas5Eq\">https:\/\/t.co\/8zoMxas5Eq<\/a><\/p>\n<p>\u2014 Sam Altman (@sama) <a href=\"https:\/\/x.com\/sama\/status\/2103567198690349362?ref_src=twsrc%5Etfw\">September 25, 2026<\/a><\/p><\/blockquote>\n<p><script async src=\"https:\/\/platform.x.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<hr \/>\n<p><a href=\"https:\/\/www.axios.com\/2026\/09\/26\/openai-anthropic-thousands-ai-security-incidents\" target=\"_blank\" rel=\"noopener\"><strong>Scoop: Top AI companies probing tens of thousands of security incidents<\/strong><\/a> &#8212; from axios.com by Madison Mills<\/p>\n<p style=\"padding-left: 40px;\">OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which their frontier models took steps that outside evaluators would consider problematic, sources told Axios.<\/p>\n<p style=\"padding-left: 40px;\">Why it matters: The sheer number of incidents, which occurred in recent months in internal testing and the real world, indicates that the problem is orders of magnitude more complex than what is publicly known.<\/p>\n<p style=\"padding-left: 40px;\">The findings, which are surfacing as part of internal work to assess models and in investigations at both companies into model behavior, raise questions about whether either company \u2014 or any top model-maker \u2014 is currently capable of establishing complete control over its technology.<\/p>\n<hr \/>\n<p><strong><a href=\"https:\/\/ablink.editorial.theguardian.com\/ss\/c\/u001.Yw_JkLMEmFuifc_XG18IR9FkgPokiuIgb7VLahyDEJYmcNOih1jLv_Qw3mWKcIepJNCS4CSa7ZOHD3Zq_y19rUQ4egvxpwNyDLU7LvHXVK_tszh144l93vaqwACQEDO-FLNrwvTQnivm_Ex2gcZglk0Uf5xMZhPEMZ1nk0kWdZnvkRRVPl-mlFZGVYkiucRYO5yadvMC_R2IWy6NVYxqOFoM7gArfX3h_9-3rwDRU0eiVdpqeQKIIcpWe6KwkYcp4HlQscK59M072LvuTv8ym-NIpJj32bx8n2nnka3u9q8raNhMfm3HKQRAMkwv3ZUnZ--dbrTAcxl4cxwJXiCmvGcORTsn9hn7C6NyztmsfbHxn9dSz_eDUMEXitLgvd-YFibsFc5991f_gs7WtiXZuBEHajJOfC_PBJQj3ZXmgVt2tQlNRLC3Q7Fkvl5xYd6LmG-Gs4Jn-QWsAosp0E8ZE7zVvD6Pdvrcw33sqLlRSSQ\/4ug\/_dlr4YK1RduloVJqNAgFBQ\/h24\/h001.uIkCuq8bDEiTr6OxIBSmljgo41GC7-q9fxks_xY7qDE\" target=\"_blank\" rel=\"noopener\">Key Risk Factors for AI Loss of Control Came Together in 2026 Incident, Independent UN Scientific Panel Finds<\/a><br \/>\n<\/strong>Halting this incident is no assurance that humans will keep control of more capable systems<\/p>\n<p style=\"padding-left: 40px;\"><strong>NEW YORK, 21 September 2026 \u2013<\/strong> <a href=\"https:\/\/www.un.org\/independent-international-scientific-panel-ai\/en\" target=\"_blank\" rel=\"noopener\">The Independent International Scientific Panel on AI<\/a>, established by the UN General Assembly, released its first thematic brief, an assessment of the breach of Hugging Face&#8217;s systems by AI agents under evaluation at OpenAI this summer. The Panel, made up of 40 independent experts from all regions, is publishing it as an advance unedited version as world leaders gather in New York for the Assembly&#8217;s High-Level Week.<\/p>\n<blockquote><p><span style=\"color: #ff6600;\"><strong>&#8220;Researchers have long warned that three conditions could lead to loss of control: a misaligned goal, the capability to pursue it, and an environment that allows it. This summer, all three came together in a real system, not a laboratory. Since this is not an isolated observation of misaligned goals, this raises serious questions about the way AI agents are currently trained.&#8221; &#8211; Yoshua Bengio, Co-Chair of the Panel and Turing Award laureate<\/strong><\/span><\/p><\/blockquote>\n<hr \/>\n<p><a href=\"https:\/\/www.inc.com\/jason-aten\/metas-new-muse-ai-agent-read-my-private-messages-i-never-asked-it-to\/91408202\" target=\"_blank\" rel=\"noopener\"><strong>Meta\u2019s New Muse AI Agent Read My Private Messages. I Never Asked It To<\/strong><\/a> &#8212; from inc.com by Jason Aten<br \/>\n<em>Permission isn\u2019t the same and what a user actually expects your AI product will do with their personal information.<\/em><\/p>\n<p class=\"wp-block-paragraph\" style=\"padding-left: 40px;\">That obviously requires a certain amount of trust. An AI agent isn\u2019t especially useful if it can\u2019t see your files, interact with your apps, or understand what you\u2019re working on. Meta says Muse is designed around that reality, while still putting users in control of what it can access.<\/p>\n<p class=\"wp-block-paragraph\" style=\"padding-left: 40px;\">At least, that\u2019s what I thought.<\/p>\n<blockquote><p><span style=\"color: #ff6600;\"><strong>Not only had I not asked it to do that sort of thing, I never gave it permission to read my messages. In fact, I remember explicitly choosing not to let it have access to my messages, calendar, and other personal information.<\/strong><\/span><\/p><\/blockquote>\n<hr \/>\n<p><span style=\"color: #800000;\"><strong>Although not from Blake, also see this free\/gifted article out at the Washington Post:<\/strong><\/span><\/p>\n<hr \/>\n<p><a href=\"https:\/\/wapo.st\/4jpBEPu\" target=\"_blank\" rel=\"noopener\"><strong>ChatGPT-maker\u2019s AI inappropriately probed federal government websites<\/strong><\/a> &#8212; from washingtonpost.com by Gerrit De Vynck and Nitasha Tiku<br \/>\n<em>OpenAI said that its artificial intelligence agents inappropriately accessed sites for the Commerce Department and the Securities and Exchange Commission.<\/em><\/p>\n<p style=\"padding-left: 40px;\">SAN FRANCISCO \u2014 Artificial intelligence technology from ChatGPT maker OpenAI probed U.S. government websites including the Departments of Education and Commerce, researchers said Friday, adding to the <a class=\"js-itid-click\" title=\"https:\/\/www.washingtonpost.com\/technology\/2026\/08\/10\/openai-anthropic-under-pressure-explain-ai-hacking-sprees\/\" href=\"https:\/\/www.washingtonpost.com\/technology\/2026\/08\/10\/openai-anthropic-under-pressure-explain-ai-hacking-sprees\/\" target=\"_blank\" rel=\"noopener noreferrer\">growing list of incidents<\/a> in which OpenAI\u2019s AI agents acted without the company\u2019s knowledge.<\/p>\n<p style=\"padding-left: 40px;\">The company\u2019s AI agents attempted to hack into the website for the Education Department\u2019s Office for Civil Rights but were not successful, according to a statement Friday from AI research firm Transluce. OpenAI\u2019s software also accessed data from the U.S. Census Bureau using log-in information discovered on the web and copied public information from the Securities and Exchange Commission, a spokesperson for OpenAI said after the Transluce statement.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Some solid warnings about AI from Blake Montgomery&#8217;s recent newsletter: There is an extensive and ongoing review related to our agents\u2019 use of internet access during training and evaluation. We\u2019ve been publishing summaries at the link below and will continue to. We have not been as fast as we would have liked but we are [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"footnotes":""},"categories":[113,329,356,32,210,816,35,391,482,55,869,309,831,480,454,195,206,321,367],"tags":[],"class_list":["post-99257","post","type-post","status-publish","format-standard","hentry","category-21st-century","category-24x7x365-access","category-artificial-intelligence-agents-llms-and-related","category-education-technology","category-emerging-technologies","category-facebook","category-game-changing-environment","category-human-computer-interaction-hci","category-intelligent-systems","category-internet","category-open-ai","category-platforms","category-privacy","category-society","category-the-downsides-of-technology","category-tools","category-trends","category-united-states","category-vendors"],"_links":{"self":[{"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/99257","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/comments?post=99257"}],"version-history":[{"count":8,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/99257\/revisions"}],"predecessor-version":[{"id":99265,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/99257\/revisions\/99265"}],"wp:attachment":[{"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/media?parent=99257"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/categories?post=99257"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/tags?post=99257"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}