{"id":554,"date":"2023-03-13T11:35:00","date_gmt":"2023-03-13T11:35:00","guid":{"rendered":"https:\/\/simoninstitute.ch\/?p=554"},"modified":"2025-07-18T06:10:10","modified_gmt":"2025-07-18T06:10:10","slug":"existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr","status":"publish","type":"post","link":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr","title":{"rendered":"Existential Risk and Rapid Technological Change – a Thematic Study for UNDRR"},"content":{"rendered":"\n

On 10th March 2022, UN Secretary-General, Ant\u00f3nio Guterres, stated that<\/a>:<\/p>\n\n\n\n

\n

\u201c(\u2026) there is renewed pressure to consider whether global governance systems are fit for purpose, and how they could be improved. Even as we reconsider traditional threats to peace and security, we need to update these concepts for our more complex world, in which local threats may quickly become global, existential, and intergenerational.\u201d<\/em><\/p>\n<\/blockquote>\n\n\n\n

The mid-term review of the Sendai Framework for Disaster Risk Reduction provides an opportunity to tackle this task. Thus, the UN Office for Disaster Risk Reduction commissioned the Simon Institute for Longterm Governance to synthesize the evidence<\/a> on the worst-case scenario at a global scale: an existential catastrophe, driven by rapid technological progress. Of particular concern are advances in biotechnology and artificial intelligence, as major drivers of accelerating change. Importantly, both existential risk and technological hazards are within the scope of the Sendai Framework yet highly neglected.<\/p>\n\n\n\n

\u2014 Read the full thematic study here<\/a> \u2014<\/strong><\/p>\n\n\n\n

Historically, the risks from emerging technologies have often been small compared to their benefits. That is no longer the case. Because of the increasing pace of technological change across the globe, it is becoming more difficult for risk governance to keep up. While new technologies can bring society enormous benefits and significantly contribute to achieving global goals such as the UN Sustainable Development Goals, they usually have unintended effects, often cause harm accidentally, and are sometimes misused.<\/p>\n\n\n\n

Biotechnology and artificial intelligence are two technologies that pose existential risk if their development and deployment are not properly governed. Biotechnology brings together science and engineering to (re)design, manufacture, and modify genetic materials, living organisms, and biological systems to, for example, treat genetic diseases, and create new biofuels or more nutritious crops. However, recent technological advances have greatly reduced the costs and provide access to actors who could, deliberately or accidentally, create and release a dangerous pathogen. What\u2019s more, as a reaction to the COVID-19 pandemic, many states have increased their investment in high-risk bioresearch facilities that can handle the most dangerous pathogens, thus further increasing the chances of their mishandling or accidental release. A lethal \u2018engineered pandemic\u2019 is therefore a real possibility.<\/p>\n\n\n\n

Artificial intelligence (AI) has experienced a similar rapid advancement and expansion, to the point that it is now widely deployed and has acquired many capabilities that experts predicted would take at least another 5-10 years to develop. While simple AI does things such as list sorting and pattern recognition, it is the development of \u2018transformative artificial intelligence\u2019 (TAI) that could lead to entirely new technological hazards. TAI, based on reinforcement learning, may enhance our ability to perceive, reason about, and act in the world, leading to radical changes in all areas of society. Fundamentally, the key problem with TAI is value misalignment: as objectives cannot be hard-coded, TAI is difficult to align with human values.<\/p>\n\n\n\n

Existing governance structures are not fit-for-purpose to address existential risk in general nor from technological development. Institutional incentives lead policymakers to focus on short-term, higher-probability events that are easier to predict and more definitively linked to their national territory. Individual countries take limited ownership of global risks as governance structures tend to be slow-moving, reactive rather than proactive, and have been set up with mandates that focus on specific kinds of risks, but neglect existential risk, more broadly.<\/p>\n\n\n\n

To make progress, it will be necessary to address four priorities for reform. First, the United Nations Office for Disaster Risk Reduction (UNDRR) should foster a concrete and common understanding of existential risk. Second, UNDRR, other international organizations, and member-states should strengthen existential risk governance. Third, the UN system and national governments should dedicate more resources to existential risk reduction. Fourth, UN agencies should foster fast response mechanisms to stop shock cascades.<\/p>\n\n\n\n

To ensure tangible progress toward these goals, we recommend <\/p>\n\n\n\n

    \n
  1. The creation of an international coordination and capacity-building mechanism on existential risk; and<\/li>\n\n\n\n
  2. The incorporation of lower-probability, high-impact risk in existing funding instruments.<\/li>\n<\/ol>\n\n\n\n

    This would constitute momentous progress towards global existential risk reduction, making the world a safer place for current and future generations.<\/p>\n\n\n\n

    \u2014 Read the full thematic study here<\/a> \u2014<\/strong><\/p>\n\n\n

    Maxime Stauffer Konrad Seifert Angela Aristiz\u00e1bal Hamza Tariq Chaudhry Kevin Kohler Sumaya Nur Hussein Claudette Salinas Leyva Arne Gebert Jacob Arbeid Malou Estier Sandra Matinyi Jason Hausenloy Jasmin Kaur Shrestha Rath Yung-Hsuan Wu <\/div>","protected":false},"excerpt":{"rendered":"On 10th March 2022, UN Secretary-General, Ant\u00f3nio Guterres, stated that: \u201c(\u2026) there is renewed pressure to consider whether global governance systems are fit for purpose, and how they could be improved. Even as we reconsider traditional threats to peace and security, we need to update these concepts for our more complex world, in which local threats […]","protected":false},"author":4,"featured_media":752,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[37,38,3,39,40],"tags":[80,79,92],"post_formats":[21],"post_types":[22],"class_list":["post-554","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-governance","category-biosecurity","category-risk-goverance","category-multilateralism","category-long-term-governance","tag-risk-governance","tag-tech-governance","tag-xrisk","post_formats-research","post_types-report"],"acf":[],"yoast_head":"Existential Risk and Rapid Technological Change - a Thematic Study for UNDRR – Simon Institute for Longterm Governance<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Existential Risk and Rapid Technological Change - a Thematic Study for UNDRR – Simon Institute for Longterm Governance\" \/>\n<meta property=\"og:description\" content=\"On 10th March 2022, UN Secretary-General, Ant\u00f3nio Guterres, stated that: \u201c(\u2026) there is renewed pressure to consider whether global governance systems are fit for purpose, and how they could be improved. Even as we reconsider traditional threats to peace and security, we need to update these concepts for our more complex world, in which local threats […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr\" \/>\n<meta property=\"og:site_name\" content=\"Simon Institute for Longterm Governance\" \/>\n<meta property=\"article:published_time\" content=\"2023-03-13T11:35:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-07-18T06:10:10+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/simoninstitute.ch\/wp-content\/uploads\/2023\/03\/20230313_xrisk-scaled.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1435\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr\"},\"author\":{\"name\":\"sofia mikton\",\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/#\\\/schema\\\/person\\\/ea8369a078364dda9f9ee8732a521b4e\"},\"headline\":\"Existential Risk and Rapid Technological Change – a Thematic Study for UNDRR\",\"datePublished\":\"2023-03-13T11:35:00+00:00\",\"dateModified\":\"2025-07-18T06:10:10+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr\"},\"wordCount\":735,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/simoninstitute.ch\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/20230313_xrisk-scaled.png\",\"keywords\":[\"risk governance\",\"tech governance\",\"xrisk\"],\"articleSection\":[\"AI Governance\",\"Biosecurity\",\"Risk Goverance\",\"Multilateralism\",\"Long-Term Governance\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr\",\"url\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr\",\"name\":\"Existential Risk and Rapid Technological Change - a Thematic Study for UNDRR – Simon Institute for Longterm Governance\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/simoninstitute.ch\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/20230313_xrisk-scaled.png\",\"datePublished\":\"2023-03-13T11:35:00+00:00\",\"dateModified\":\"2025-07-18T06:10:10+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/#\\\/schema\\\/person\\\/ea8369a078364dda9f9ee8732a521b4e\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#primaryimage\",\"url\":\"https:\\\/\\\/simoninstitute.ch\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/20230313_xrisk-scaled.png\",\"contentUrl\":\"https:\\\/\\\/simoninstitute.ch\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/20230313_xrisk-scaled.png\",\"width\":2560,\"height\":1435},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/blog\\\/post\\\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/simoninstitute.ch\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Existential Risk and Rapid Technological Change – a Thematic Study for UNDRR\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/#website\",\"url\":\"https:\\\/\\\/simoninstitute.ch\\\/\",\"name\":\"Simon Institute for Longterm Governance\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/simoninstitute.ch\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/simoninstitute.ch\\\/#\\\/schema\\\/person\\\/ea8369a078364dda9f9ee8732a521b4e\",\"name\":\"sofia mikton\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8da2245bb6cde0137cba4dc3bb8bfd3c1c4e2f4ac351dd962ce5183da32cc5db?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8da2245bb6cde0137cba4dc3bb8bfd3c1c4e2f4ac351dd962ce5183da32cc5db?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8da2245bb6cde0137cba4dc3bb8bfd3c1c4e2f4ac351dd962ce5183da32cc5db?s=96&d=mm&r=g\",\"caption\":\"sofia mikton\"}}]}<\/script>","yoast_head_json":{"title":"Existential Risk and Rapid Technological Change - a Thematic Study for UNDRR – Simon Institute for Longterm Governance","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr","og_locale":"en_US","og_type":"article","og_title":"Existential Risk and Rapid Technological Change - a Thematic Study for UNDRR – Simon Institute for Longterm Governance","og_description":"On 10th March 2022, UN Secretary-General, Ant\u00f3nio Guterres, stated that: \u201c(\u2026) there is renewed pressure to consider whether global governance systems are fit for purpose, and how they could be improved. Even as we reconsider traditional threats to peace and security, we need to update these concepts for our more complex world, in which local threats […]","og_url":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr","og_site_name":"Simon Institute for Longterm Governance","article_published_time":"2023-03-13T11:35:00+00:00","article_modified_time":"2025-07-18T06:10:10+00:00","og_image":[{"width":2560,"height":1435,"url":"https:\/\/simoninstitute.ch\/wp-content\/uploads\/2023\/03\/20230313_xrisk-scaled.png","type":"image\/png"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#article","isPartOf":{"@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr"},"author":{"name":"sofia mikton","@id":"https:\/\/simoninstitute.ch\/#\/schema\/person\/ea8369a078364dda9f9ee8732a521b4e"},"headline":"Existential Risk and Rapid Technological Change – a Thematic Study for UNDRR","datePublished":"2023-03-13T11:35:00+00:00","dateModified":"2025-07-18T06:10:10+00:00","mainEntityOfPage":{"@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr"},"wordCount":735,"commentCount":0,"image":{"@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#primaryimage"},"thumbnailUrl":"https:\/\/simoninstitute.ch\/wp-content\/uploads\/2023\/03\/20230313_xrisk-scaled.png","keywords":["risk governance","tech governance","xrisk"],"articleSection":["AI Governance","Biosecurity","Risk Goverance","Multilateralism","Long-Term Governance"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#respond"]}]},{"@type":"WebPage","@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr","url":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr","name":"Existential Risk and Rapid Technological Change - a Thematic Study for UNDRR – Simon Institute for Longterm Governance","isPartOf":{"@id":"https:\/\/simoninstitute.ch\/#website"},"primaryImageOfPage":{"@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#primaryimage"},"image":{"@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#primaryimage"},"thumbnailUrl":"https:\/\/simoninstitute.ch\/wp-content\/uploads\/2023\/03\/20230313_xrisk-scaled.png","datePublished":"2023-03-13T11:35:00+00:00","dateModified":"2025-07-18T06:10:10+00:00","author":{"@id":"https:\/\/simoninstitute.ch\/#\/schema\/person\/ea8369a078364dda9f9ee8732a521b4e"},"breadcrumb":{"@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#primaryimage","url":"https:\/\/simoninstitute.ch\/wp-content\/uploads\/2023\/03\/20230313_xrisk-scaled.png","contentUrl":"https:\/\/simoninstitute.ch\/wp-content\/uploads\/2023\/03\/20230313_xrisk-scaled.png","width":2560,"height":1435},{"@type":"BreadcrumbList","@id":"https:\/\/simoninstitute.ch\/blog\/post\/existential-risk-and-rapid-technological-change-a-thematic-study-for-undrr#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/simoninstitute.ch\/"},{"@type":"ListItem","position":2,"name":"Existential Risk and Rapid Technological Change – a Thematic Study for UNDRR"}]},{"@type":"WebSite","@id":"https:\/\/simoninstitute.ch\/#website","url":"https:\/\/simoninstitute.ch\/","name":"Simon Institute for Longterm Governance","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/simoninstitute.ch\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/simoninstitute.ch\/#\/schema\/person\/ea8369a078364dda9f9ee8732a521b4e","name":"sofia mikton","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/8da2245bb6cde0137cba4dc3bb8bfd3c1c4e2f4ac351dd962ce5183da32cc5db?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/8da2245bb6cde0137cba4dc3bb8bfd3c1c4e2f4ac351dd962ce5183da32cc5db?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8da2245bb6cde0137cba4dc3bb8bfd3c1c4e2f4ac351dd962ce5183da32cc5db?s=96&d=mm&r=g","caption":"sofia mikton"}}]}},"_links":{"self":[{"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/posts\/554","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/comments?post=554"}],"version-history":[{"count":4,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/posts\/554\/revisions"}],"predecessor-version":[{"id":1060,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/posts\/554\/revisions\/1060"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/media\/752"}],"wp:attachment":[{"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/media?parent=554"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/categories?post=554"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/tags?post=554"},{"taxonomy":"post_formats","embeddable":true,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/post_formats?post=554"},{"taxonomy":"post_types","embeddable":true,"href":"https:\/\/simoninstitute.ch\/api\/wp\/v2\/post_types?post=554"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}