{"id":552,"date":"2022-03-14T01:47:29","date_gmt":"2022-03-14T01:47:29","guid":{"rendered":"https:\/\/fde.cat\/index.php\/2022\/03\/14\/sre-weekly-issue-313\/"},"modified":"2022-03-14T01:47:29","modified_gmt":"2022-03-14T01:47:29","slug":"sre-weekly-issue-313","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2022\/03\/14\/sre-weekly-issue-313\/","title":{"rendered":"SRE Weekly Issue #313"},"content":{"rendered":"<p><a href=\"https:\/\/sreweekly.com\/sre-weekly-issue-313\/\" title=\"Permalink to SRE Weekly Issue #313\" class=\"email_only\">View on sreweekly.com<\/a><\/p>\n<div class=\"sreweekly-sponsor-message\">\n<h2>A message from our sponsor, <a href=\"https:\/\/rootly.com\/demo\/?utm_source=sreweekly\">Rootly<\/a>:<\/h2>\n<p>Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set):<br \/>\n<a href=\"https:\/\/rootly.com\/demo\/\">https:\/\/rootly.com\/demo\/<\/a><\/p>\n<\/div>\n<h2>Articles<\/h2>\n<div class=\"wp-block-group\">\n<div class=\"wp-block-group__inner-container\">\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/firehydrant.io\/blog\/when-to-hire-an-incident-commander\/\" target=\"_blank\" rel=\"noopener\">When to hire an Incident Commander<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Do you need an incident commander? (Yes.) This article is about how to staff your incident command rotation through a couple of different strategies.<\/p>\n<p>\u00a0\u00a0Ryan McDonald \u2014 FireHydrant<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.insurancejournal.com\/news\/international\/2022\/03\/08\/657170.htm\" target=\"_blank\" rel=\"noopener\">How Cloud Downtime Insurance Became a Thing<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>What an interesting idea, an insurance plan that pays out automatically when a cloud provider has an outage.<\/p>\n<p>\u00a0\u00a0L.S. Howard \u2014 Insurance Journal<br \/>\n<em>Full disclosure: Fastly, my employer, is mentioned.<\/em><\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/thenewstack.io\/diary-of-a-first-time-on-call-engineer\/\" target=\"_blank\" rel=\"noopener\">Diary of a First-Time On-Call Engineer<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>LaunchDarkly revamped the way that their on-call system works.  Learn about the experience through the eyes of a newly-onboarded engineer.<\/p>\n<p>\u00a0\u00a0Anna Baker \u2014 LaunchDarkly (via The New Stack)<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.catchpoint.com\/asset\/sre-report-2021\" target=\"_blank\" rel=\"noopener\">2021 SRE Report<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Catchpoint\u2019s yearly SRE Report is out with four key findings.  You have to fill out a form with your email address, and then the link to download the report is presented in your browser.<\/p>\n<p>\u00a0\u00a0Catchpoint<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"http:\/\/highscalability.com\/blog\/2014\/2\/5\/littles-law-scalability-and-fault-tolerance-the-os-is-your-b.html\" target=\"_blank\" rel=\"noopener\">Little\u2019s Law, Scalability and Fault Tolerance: The OS is your bottleneck. What you can\u00a0do?<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>This article shows why one-thread-per-request can be a bottleneck and presents alternatives.<\/p>\n<p>\u00a0\u00a0Ron Pressler \u2014 Parallel Universe (via High Scalability)<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.honeycomb.io\/blog\/brittleness-of-dashboards\/\" target=\"_blank\" rel=\"noopener\">On the Brittleness of Dashboards<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>And this is a truth about incidents: there are always more signals than there is attention available.<\/p>\n<p>It\u2019s so true.<\/p>\n<p>\u00a0\u00a0Fred Hebert \u2014 Honeycomb<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.jeli.io\/incident-analysis-101-facilitating-the-learning-review\/\" target=\"_blank\" rel=\"noopener\">Incident Analysis 101: Facilitating the Learning Review<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>If you\u2019ve ever even considered running a retrospective, read this article.<\/p>\n<p>This is my favorite piece of advice from this article:<\/p>\n<p>If you think \u2018this might be a stupid question,\u2019 ask it.<\/p>\n<p>\u00a0\u00a0Emily Ruppe \u2014 Jeli<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/rootly.com\/blog\/what-does-aiops-mean-for-sres-it-s-complicated\" target=\"_blank\" rel=\"noopener\">What Does AIOps Mean for SREs? It\u2019s Complicated.<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>I\u2019m still not sure how I feel about AIOps.  Fortunately, this article takes a measured stance while providing some useful insight.<\/p>\n<p>Conclusion: AI won\u2019t replace SREs \u2013 but it can help<\/p>\n<p>\u00a0\u00a0JJ Tang \u2014 Rootly<br \/>\n<em>This article is published by my sponsor, Rootly, but their sponsorship did not influence its inclusion in this issue.<\/em><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<h2>Outages<\/h2>\n<p><a href=\"https:\/\/status.cloud.google.com\/incidents\/LuGcJVjNTeC5Sb9pSJ9o\">Google Cloud Traffic Director<\/a><\/p>\n<p>Google has already posted a preliminary outage report at the link above.<\/p>\n<p><a href=\"https:\/\/engineering.atspotify.com\/2022\/03\/incident-report-spotify-outage-on-march-8\/\">Spotify<\/a><\/p>\n<p>This one involved the Traffic Director outage mentioned above, as per Spotify\u2019s outage report <a href=\"https:\/\/engineering.atspotify.com\/2022\/03\/incident-report-spotify-outage-on-march-8\/\">here<\/a>.<\/p>\n<p><a href=\"https:\/\/discord.statuspage.io\/incidents\/cjdx9txnrv03\">Discord<\/a><\/p>\n<p>This one was also related to the Traffic Director outage, according to the final update on their <a href=\"https:\/\/discord.statuspage.io\/incidents\/cjdx9txnrv03\">status post<\/a>.<\/p>\n<p><a href=\"https:\/\/cryptobriefing.com\/polygon-experiences-hours-long-outage\/\">Polygon<\/a><\/p>\n<p><a href=\"https:\/\/mashable.com\/article\/tiktok-down\">TikTok<\/a><br \/>\nSRE WEEKLY<\/p>","protected":false},"excerpt":{"rendered":"<p>View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/ Articles When to hire an&hellip; <a class=\"more-link\" href=\"https:\/\/fde.cat\/index.php\/2022\/03\/14\/sre-weekly-issue-313\/\">Continue reading <span class=\"screen-reader-text\">SRE Weekly Issue #313<\/span><\/a><\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-552","post","type-post","status-publish","format-standard","hentry","category-sre","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":659,"url":"https:\/\/fde.cat\/index.php\/2022\/12\/05\/sre-weekly-issue-350\/","url_meta":{"origin":552,"position":0},"title":"SRE Weekly Issue #350","date":"December 5, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly\u00a0\ud83d\ude92. Rootly automates manual tasks like creating an incident channel, Jira ticket and Zoom rooms, inviting responders, creating statuspage updates, postmortem timelines and more. Want to see why companies like Canva and Grammarly love us?:\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":568,"url":"https:\/\/fde.cat\/index.php\/2022\/05\/02\/sre-weekly-issue-320\/","url_meta":{"origin":552,"position":1},"title":"SRE Weekly Issue #320","date":"May 2, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":543,"url":"https:\/\/fde.cat\/index.php\/2022\/02\/21\/sre-weekly-issue-310\/","url_meta":{"origin":552,"position":2},"title":"SRE Weekly Issue #310","date":"February 21, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly shirt): https:\/\/rootly.com\/demo\/?utm_source=sreweekly Articles\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":535,"url":"https:\/\/fde.cat\/index.php\/2022\/01\/24\/sre-weekly-issue-306\/","url_meta":{"origin":552,"position":3},"title":"SRE Weekly Issue #306","date":"January 24, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly shirt): https:\/\/rootly.com\/demo\/?utm_source=sreweekly Articles\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":579,"url":"https:\/\/fde.cat\/index.php\/2022\/05\/30\/sre-weekly-issue-324\/","url_meta":{"origin":552,"position":4},"title":"SRE Weekly Issue #324","date":"May 30, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":546,"url":"https:\/\/fde.cat\/index.php\/2022\/03\/07\/sre-weekly-issue-312\/","url_meta":{"origin":552,"position":5},"title":"SRE Weekly Issue #312","date":"March 7, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly shirt): https:\/\/rootly.com\/demo\/?utm_source=sreweekly Articles\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/552","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=552"}],"version-history":[{"count":0,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/552\/revisions"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=552"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=552"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=552"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}