{"id":487,"date":"2021-10-11T00:47:58","date_gmt":"2021-10-11T00:47:58","guid":{"rendered":"https:\/\/fde.cat\/index.php\/2021\/10\/11\/sre-weekly-issue-291\/"},"modified":"2021-10-11T00:47:58","modified_gmt":"2021-10-11T00:47:58","slug":"sre-weekly-issue-291","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2021\/10\/11\/sre-weekly-issue-291\/","title":{"rendered":"SRE Weekly Issue #291"},"content":{"rendered":"<p><a href=\"https:\/\/sreweekly.com\/sre-weekly-issue-291\/\" title=\"Permalink to SRE Weekly Issue #291\" class=\"email_only\">View on sreweekly.com<\/a><\/p>\n<div class=\"sreweekly-sponsor-message\">\n<h2>A message from our sponsor, <a href=\"https:\/\/rootly.io\/?utm_source=sreweekly\">Rootly<\/a>:<\/h2>\n<p>Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo:<br \/>\n<a href=\"https:\/\/rootly.io\/?utm_source=sreweekly\">https:\/\/rootly.io\/?utm_source=sreweekly<\/a><\/p>\n<\/div>\n<h2>Articles<\/h2>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/blog.cloudflare.com\/october-2021-facebook-outage\/\">Understanding How Facebook Disappeared from the Internet<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Facebook\u2019s outage caused significantly increased load on DNS resolvers, among other effects. Cloudflare also published this <a href=\"https:\/\/blog.cloudflare.com\/during-the-facebook-outage\/\">followup article<\/a> with more findings.<\/p>\n<p>Celso Martinho and Sabina Zejnilovic \u2014 Cloudflare<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.npr.org\/programs\/invisibilia\/481887848\/the-new-norm\">The New Norm<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Shell (the oil company) reduced accidents by 84% by teaching roughnecks to cry. Listen to this podcast (or check it out in <a href=\"https:\/\/www.npr.org\/sections\/health-shots\/2016\/06\/17\/482203447\/invisibilia-how-learning-to-be-vulnerable-can-make-life-safer\">article form<\/a> to find out how. Can we apply this to SRE?<\/p>\n<p>Alix Spiegel and Hanna Rosin \u2014 NPR\u2019s Invisibilia<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/rootly.io\/blog\/google-s-state-of-devops-2021-report-what-sres-need-to-know\">Google\u2019s State of DevOps 2021 Report: What SREs Need to Know<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Don\u2019t have time to read Google\u2019s entire report? Here are the highlights.<\/p>\n<p>Quentin Rousseau \u2014 Rootly<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/engineering.fb.com\/2021\/10\/05\/networking-traffic\/outage-details\/\">More details about the October 4 outage<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>I really like how open Facebook engineering has been about what went wrong on Monday. This article is an update on their <a href=\"https:\/\/engineering.fb.com\/2021\/10\/04\/networking-traffic\/outage\/\">initial post<\/a>.<\/p>\n<p>Santosh Janardhan \u2014 Facebook<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/jvns.ca\/blog\/2021\/10\/05\/tools-to-look-at-bgp-routes\/\">Tools to explore BGP<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Want to learn about BGP? Ride along as Julia Evans learns. I especially like how she whipped out strace to figure out how traceroute was determining ASNs.<\/p>\n<p>Julia Evans<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.verica.io\/blog\/announcing-the-void\/\">Announcing the VOID<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>The Verica Open Incident Database is an exciting new project that seeks to create a catalog of public incident postings. Click through to check out the VOID and read the inaugural paper with initial findings. I\u2019m really excited to see what this project brings!<\/p>\n<p>Courtney Nash \u2014 Verica<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/rachelbythebay.com\/w\/2021\/10\/05\/cmd\/\">\u2018date -d\u2019 vs. \u2018date -s\u2019, and \u2018show foo\u2019 vs. \u2018clear foo\u2019<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Printing versus setting a date \u2014 they\u2019re only separated by a typo. Perhaps something similar happened with Facebook\u2019s outage.<\/p>\n<p>rachelbythebay<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/bravenewgeek.com\/sre-doesnt-scale\/\">SRE Doesn\u2019t Scale<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Adopting a microservice architecture can strain your SRE. This article highlights an oft-missed section of the SRE book about scaling SRE.<\/p>\n<p>Tyler Treat<\/p>\n<\/div>\n<\/div>\n<h2>Outages<\/h2>\n<p><a href=\"https:\/\/arstechnica.com\/information-technology\/2021\/10\/facebook-instagram-whatsapp-and-oculus-are-down-heres-what-we-know\/\">Facebook, Instagram, WhatsApp, and Oculus<\/a><\/p>\n<p>Well, that sure was a big one. Facebook and related services were totally down for 6+ hours \u2014 even their DNS servers.They also had <a href=\"https:\/\/bestgamingpro.com\/facebook-instagram-and-whatsapp-go-down-for-some-in-second-outage-this-week\/\">another, smaller outage<\/a> later in the week.<\/p>\n<p><a href=\"https:\/\/status.slack.com\/\/2021-10\/55c1c102a575c9ba\">Slack<\/a><\/p>\n<p>Not a real outage, but Slack reported that users were having a hard time connecting to Slack, because resolvers were overloaded by DNS lookups for facebook.com.<\/p>\n<p><a href=\"https:\/\/piunikaweb.com\/2021\/10\/08\/nordvpn-down-as-users-face-password-verification-failed-issue\/\">NordVPN<\/a><br \/>\n<a href=\"https:\/\/piunikaweb.com\/2021\/10\/08\/paypal-down-not-working-or-unable-to-send-receive-money\/\">PayPal<\/a><br \/>\nSRE WEEKLY<\/p>","protected":false},"excerpt":{"rendered":"<p>View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo: https:\/\/rootly.io\/?utm_source=sreweekly Articles Understanding How Facebook Disappeared from the Internet Facebook\u2019s outage caused significantly&hellip; <a class=\"more-link\" href=\"https:\/\/fde.cat\/index.php\/2021\/10\/11\/sre-weekly-issue-291\/\">Continue reading <span class=\"screen-reader-text\">SRE Weekly Issue #291<\/span><\/a><\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-487","post","type-post","status-publish","format-standard","hentry","category-sre","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":543,"url":"https:\/\/fde.cat\/index.php\/2022\/02\/21\/sre-weekly-issue-310\/","url_meta":{"origin":487,"position":0},"title":"SRE Weekly Issue #310","date":"February 21, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly shirt): https:\/\/rootly.com\/demo\/?utm_source=sreweekly Articles\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":579,"url":"https:\/\/fde.cat\/index.php\/2022\/05\/30\/sre-weekly-issue-324\/","url_meta":{"origin":487,"position":1},"title":"SRE Weekly Issue #324","date":"May 30, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":535,"url":"https:\/\/fde.cat\/index.php\/2022\/01\/24\/sre-weekly-issue-306\/","url_meta":{"origin":487,"position":2},"title":"SRE Weekly Issue #306","date":"January 24, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly shirt): https:\/\/rootly.com\/demo\/?utm_source=sreweekly Articles\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":537,"url":"https:\/\/fde.cat\/index.php\/2022\/01\/31\/sre-weekly-issue-307\/","url_meta":{"origin":487,"position":3},"title":"SRE Weekly Issue #307","date":"January 31, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly shirt): https:\/\/rootly.com\/demo\/?utm_source=sreweekly Articles\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":546,"url":"https:\/\/fde.cat\/index.php\/2022\/03\/07\/sre-weekly-issue-312\/","url_meta":{"origin":487,"position":4},"title":"SRE Weekly Issue #312","date":"March 7, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly shirt): https:\/\/rootly.com\/demo\/?utm_source=sreweekly Articles\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":603,"url":"https:\/\/fde.cat\/index.php\/2022\/07\/04\/sre-weekly-issue-329\/","url_meta":{"origin":487,"position":5},"title":"SRE Weekly Issue #329","date":"July 4, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/487","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=487"}],"version-history":[{"count":0,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/487\/revisions"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=487"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=487"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=487"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}