{"id":11493,"date":"2022-10-04T09:24:10","date_gmt":"2022-10-04T08:24:10","guid":{"rendered":"https:\/\/ee.yelkdev.site\/?p=11493"},"modified":"2024-12-09T15:42:20","modified_gmt":"2024-12-09T15:42:20","slug":"chaos-day-what-when-how-benefits","status":"publish","type":"post","link":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/","title":{"rendered":"Chaos Days: Your Questions Answered"},"content":{"rendered":"

Chaos Days are an opportunity to introduce disruption to your IT systems, so that you can understand how they will respond to possible \u2018real\u2019 disruptions. Of course, it\u2019s also a highly effective way for teams to practice and improve how they respond to IT failures.<\/p>\n

In this article, we\u2019ll discuss some of the most common questions about Chaos Days and how they can be used to improve IT service resilience. If you\u2019d like to find out more about how to plan, organise and run your own Chaos Day, don\u2019t miss our Chaos Days Playbook<\/a>, which you can download for free<\/a>.<\/p>\n

Q: What is a Chaos Day?<\/h2>\n

A Chaos Day is an event that runs over one or more days where teams can explore how their service responds to failures safely. During a Chaos Day, teams design and run controlled experiments in pre-production or production environments. Each experiment injects a failure into the service, such as terminating a compute instance, or filling up a storage device) and the team observes and analyses the impact and overall system response, and the response of the supporting team. Chaos Days are a practice within the field of chaos engineering.<\/p>\n

Q: What is chaos engineering?<\/h2>\n

Chaos engineering is defined<\/a> as the discipline of experimenting on a system to build confidence in the system’s capability to withstand turbulent conditions in production. Chaos engineering teams design and run experiments that inject failures into a target system, so the team can learn how the system responds. This learning improves the resilience of the system by:<\/p>\n

    \n
  1. Equipping the team with deeper understanding about system behaviour<\/li>\n
  2. Informing the team on where to invest in order to improve system resilience<\/li>\n<\/ol>\n

    Q: Why do we organise Chaos Days?<\/h2>\n

    Chaos Days provide a focal event for your team to practice chaos engineering. They are especially useful to teams that might be less familiar with this discipline, because they introduce chaos engineering in a structured, boundaried manner.<\/p>\n

    Chaos Days improve system resilience by helping your people learn about systems, and gain experience in how to diagnose and solve problems in high-stress situations. They provide an opportunity to improve processes such as incident management, incident analysis and engineering approaches, such as how faults should be handled and how resilience testing is performed during feature development.<\/p>\n

    Finally, Chaos Days help organisations to initiate changes that make services more resilient, improve observability and make services and dependencies better understood.<\/p>\n

    Q: How do you implement chaos engineering?<\/h2>\n

    Chaos engineering is a broad and deep discipline, to which our Chaos Day playbook<\/a>\u00a0provides a great introduction, including a 5-minute guide to running a Chaos Day<\/a>. Once you\u2019ve digested that, the simplest next steps are to:<\/p>\n

      \n
    1. Decide which part of your system you want to learn more about.<\/li>\n
    2. Come up with a hypothesis for how that part responds to specific failures.<\/li>\n
    3. Design and run an experiment to test that hypothesis, by injecting a failure into that part of the system. The failure injection can be manual (e.g. stop a service the system depends on) or automated (e.g. use infrastructure-as-code to remove access to the service for the duration of the experiment).<\/li>\n
    4. Observe how the system responds to the failure and review as a team what was learnt from this experiment and any changes you should make as a result of it.<\/li>\n
    5. Rinse and repeat.<\/li>\n<\/ol>\n

      Q: What are some top tips for Chaos Days?<\/h2>\n
        \n
      1. Start small, with one or two teams and a few experiments, not tens of teams and tens of experiments. This allows you to adapt and learn how to run a Chaos Day in your specific context, before scaling out to multiple teams and many experiments.<\/li>\n
      2. Plan ahead – it\u2019s possible to run a mini chaos event in a single day<\/a>, but you\u2019ll get the most from any chaos event by scheduling time in advance to design and run experiments, then reflect and share the lessons extracted from them.<\/li>\n
      3. Spread knowledge by involving the whole team, but limiting how much diagnosis and repair your most experienced engineers do – either treat them as absent for that day or pair them with less experienced team members.<\/li>\n
      4. Be conscious of business critical events that the chaos might impact (especially if it gets out of control). Also, allow time to return the system to its normal state. You don\u2019t want to take down a key environment just when it\u2019s needed for a critical release.<\/li>\n<\/ol>\n

        Q: What tools are available for running a Chaos Day? How should we run a Chaos Day if we\u2019re running AWS?<\/h2>\n

        The experiments you run during a Chaos Day typically modify system configuration or behaviour in some way that simulates a failure (e.g. shutting down a compute instance, closing a network connection). These modifications can either be done manually (e.g. through temporarily editing configuration) or in a more automated manner via tooling such as infrastructure-as-code (IaC), Chaos Monkey<\/a>, AWS Fault Injection Simulator<\/a> or Gremlin<\/a>. If you want to repeat experiments or track them via source-control, then the tooling approach is preferable, as it codifies the experiment and automates its injection and rollback.<\/p>\n

        Q: How to set up a chaos engineering day?<\/h2>\n

        That\u2019s simple – just follow our playbook<\/a>!<\/p>\n","protected":false},"excerpt":{"rendered":"

        What is a Chaos Day? Who should organise a Chaos Day and what are the risks and potential benefits? Our experts answer your most common questions about Chaos Days for IT development teams <\/p>\n","protected":false},"author":29,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[302,305,278],"location":[397],"class_list":["post-11493","post","type-post","status-publish","format-standard","hentry","category-tech-focus","tag-chaos-day","tag-chaos-day-playbook","tag-security"],"acf":[],"yoast_head":"\nChaos Days: Your Questions Answered | Equal Experts<\/title>\n<meta name=\"description\" content=\"Our experts answer your top questions about Chaos Days and how they can make your IT systems more resilient\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Chaos Days: Your Questions Answered\" \/>\n<meta property=\"og:description\" content=\"What is a Chaos Day? Who should organise a Chaos Day and what are the risks and potential benefits? Our experts answer your most common questions about Chaos Days for IT development teams\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/\" \/>\n<meta property=\"og:site_name\" content=\"Equal Experts\" \/>\n<meta property=\"article:published_time\" content=\"2022-10-04T08:24:10+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-12-09T15:42:20+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.equalexperts.com\/wp-content\/uploads\/2022\/10\/3fb-qa-.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1201\" \/>\n\t<meta property=\"og:image:height\" content=\"631\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Lyndsay Prewer\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Chaos Days: Your Questions Answered\" \/>\n<meta name=\"twitter:description\" content=\"What is a Chaos Day? Who should organise a Chaos Day and what are the risks and potential benefits? Our experts answer your most common questions about Chaos Days for IT development teams\" \/>\n<meta name=\"twitter:creator\" content=\"@EqualExperts\" \/>\n<meta name=\"twitter:site\" content=\"@EqualExperts\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Lyndsay Prewer\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/\"},\"author\":{\"name\":\"Lyndsay Prewer\",\"@id\":\"https:\/\/www.equalexperts.com\/#\/schema\/person\/ab8de7d0a8536946a1c251d65cca5754\"},\"headline\":\"Chaos Days: Your Questions Answered\",\"datePublished\":\"2022-10-04T08:24:10+00:00\",\"dateModified\":\"2024-12-09T15:42:20+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/\"},\"wordCount\":882,\"publisher\":{\"@id\":\"https:\/\/www.equalexperts.com\/#organization\"},\"keywords\":[\"Chaos Day\",\"Chaos Day playbook\",\"security\"],\"articleSection\":[\"Tech Focus\"],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/\",\"url\":\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/\",\"name\":\"Chaos Days: Your Questions Answered | Equal Experts\",\"isPartOf\":{\"@id\":\"https:\/\/www.equalexperts.com\/#website\"},\"datePublished\":\"2022-10-04T08:24:10+00:00\",\"dateModified\":\"2024-12-09T15:42:20+00:00\",\"description\":\"Our experts answer your top questions about Chaos Days and how they can make your IT systems more resilient\",\"breadcrumb\":{\"@id\":\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.equalexperts.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Chaos Days: Your Questions Answered\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.equalexperts.com\/#website\",\"url\":\"https:\/\/www.equalexperts.com\/\",\"name\":\"Equal Experts\",\"description\":\"Making Software. Better.\",\"publisher\":{\"@id\":\"https:\/\/www.equalexperts.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.equalexperts.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.equalexperts.com\/#organization\",\"name\":\"Equal Experts\",\"url\":\"https:\/\/www.equalexperts.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/www.equalexperts.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.equalexperts.com\/wp-content\/uploads\/2018\/08\/Equal_Experts_Logo_CMYK_Colour.jpg\",\"contentUrl\":\"https:\/\/www.equalexperts.com\/wp-content\/uploads\/2018\/08\/Equal_Experts_Logo_CMYK_Colour.jpg\",\"width\":719,\"height\":340,\"caption\":\"Equal Experts\"},\"image\":{\"@id\":\"https:\/\/www.equalexperts.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/EqualExperts\",\"https:\/\/www.linkedin.com\/company\/equal-experts\/?viewAsMember=true\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.equalexperts.com\/#\/schema\/person\/ab8de7d0a8536946a1c251d65cca5754\",\"name\":\"Lyndsay Prewer\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/www.equalexperts.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/40bdd25ad48353db99467923f1513696e5f0f7d20e7c2a93d6a97a41545d1bd3?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/40bdd25ad48353db99467923f1513696e5f0f7d20e7c2a93d6a97a41545d1bd3?s=96&d=mm&r=g\",\"caption\":\"Lyndsay Prewer\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Chaos Days: Your Questions Answered | Equal Experts","description":"Our experts answer your top questions about Chaos Days and how they can make your IT systems more resilient","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/","og_locale":"en_GB","og_type":"article","og_title":"Chaos Days: Your Questions Answered","og_description":"What is a Chaos Day? Who should organise a Chaos Day and what are the risks and potential benefits? Our experts answer your most common questions about Chaos Days for IT development teams","og_url":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/","og_site_name":"Equal Experts","article_published_time":"2022-10-04T08:24:10+00:00","article_modified_time":"2024-12-09T15:42:20+00:00","og_image":[{"width":1201,"height":631,"url":"https:\/\/www.equalexperts.com\/wp-content\/uploads\/2022\/10\/3fb-qa-.png","type":"image\/png"}],"author":"Lyndsay Prewer","twitter_card":"summary_large_image","twitter_title":"Chaos Days: Your Questions Answered","twitter_description":"What is a Chaos Day? Who should organise a Chaos Day and what are the risks and potential benefits? Our experts answer your most common questions about Chaos Days for IT development teams","twitter_creator":"@EqualExperts","twitter_site":"@EqualExperts","twitter_misc":{"Written by":"Lyndsay Prewer","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/#article","isPartOf":{"@id":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/"},"author":{"name":"Lyndsay Prewer","@id":"https:\/\/www.equalexperts.com\/#\/schema\/person\/ab8de7d0a8536946a1c251d65cca5754"},"headline":"Chaos Days: Your Questions Answered","datePublished":"2022-10-04T08:24:10+00:00","dateModified":"2024-12-09T15:42:20+00:00","mainEntityOfPage":{"@id":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/"},"wordCount":882,"publisher":{"@id":"https:\/\/www.equalexperts.com\/#organization"},"keywords":["Chaos Day","Chaos Day playbook","security"],"articleSection":["Tech Focus"],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/","url":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/","name":"Chaos Days: Your Questions Answered | Equal Experts","isPartOf":{"@id":"https:\/\/www.equalexperts.com\/#website"},"datePublished":"2022-10-04T08:24:10+00:00","dateModified":"2024-12-09T15:42:20+00:00","description":"Our experts answer your top questions about Chaos Days and how they can make your IT systems more resilient","breadcrumb":{"@id":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.equalexperts.com\/blog\/tech-focus\/chaos-day-what-when-how-benefits\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.equalexperts.com\/"},{"@type":"ListItem","position":2,"name":"Chaos Days: Your Questions Answered"}]},{"@type":"WebSite","@id":"https:\/\/www.equalexperts.com\/#website","url":"https:\/\/www.equalexperts.com\/","name":"Equal Experts","description":"Making Software. Better.","publisher":{"@id":"https:\/\/www.equalexperts.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.equalexperts.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/www.equalexperts.com\/#organization","name":"Equal Experts","url":"https:\/\/www.equalexperts.com\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.equalexperts.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.equalexperts.com\/wp-content\/uploads\/2018\/08\/Equal_Experts_Logo_CMYK_Colour.jpg","contentUrl":"https:\/\/www.equalexperts.com\/wp-content\/uploads\/2018\/08\/Equal_Experts_Logo_CMYK_Colour.jpg","width":719,"height":340,"caption":"Equal Experts"},"image":{"@id":"https:\/\/www.equalexperts.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/EqualExperts","https:\/\/www.linkedin.com\/company\/equal-experts\/?viewAsMember=true"]},{"@type":"Person","@id":"https:\/\/www.equalexperts.com\/#\/schema\/person\/ab8de7d0a8536946a1c251d65cca5754","name":"Lyndsay Prewer","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.equalexperts.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/40bdd25ad48353db99467923f1513696e5f0f7d20e7c2a93d6a97a41545d1bd3?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/40bdd25ad48353db99467923f1513696e5f0f7d20e7c2a93d6a97a41545d1bd3?s=96&d=mm&r=g","caption":"Lyndsay Prewer"}}]}},"_links":{"self":[{"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/posts\/11493","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/comments?post=11493"}],"version-history":[{"count":0,"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/posts\/11493\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/media?parent=11493"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/categories?post=11493"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/tags?post=11493"},{"taxonomy":"location","embeddable":true,"href":"https:\/\/www.equalexperts.com\/wp-json\/wp\/v2\/location?post=11493"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}