{"id":713,"date":"2023-05-15T00:36:16","date_gmt":"2023-05-15T00:36:16","guid":{"rendered":"https:\/\/fde.cat\/index.php\/2023\/05\/15\/sre-weekly-issue-372\/"},"modified":"2023-05-15T00:36:16","modified_gmt":"2023-05-15T00:36:16","slug":"sre-weekly-issue-372","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2023\/05\/15\/sre-weekly-issue-372\/","title":{"rendered":"SRE Weekly Issue #372"},"content":{"rendered":"<p><a href=\"https:\/\/sreweekly.com\/sre-weekly-issue-372\/\" title=\"Permalink to SRE Weekly Issue #372\" class=\"email_only\">View on sreweekly.com<\/a><\/p>\n<div class=\"sreweekly-sponsor-message\">\n<h2>A message from our sponsor, <a href=\"https:\/\/rootly.com\/demo\/?utm_source=sreweekly\">Rootly<\/a>:<\/h2>\n<p>Rootly is hiring for a Sr. Developer Relations Advocate to continue helping more world-class companies like Figma, NVIDIA, Squarespace, accelerate their incident management journey. Looking for previous on-call engineers with a passion for making the world a more reliable place.  Learn more:<\/p>\n<p><a href=\"https:\/\/rootly.com\/careers?gh_jid=4015888007\">https:\/\/rootly.com\/careers?gh_jid=4015888007<\/a><\/p>\n<\/div>\n<h2>Articles<\/h2>\n<div class=\"wp-block-group\">\n<div class=\"wp-block-group__inner-container\">\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.pulumi.com\/blog\/reducing-our-error-rate\/\" target=\"_blank\" rel=\"noopener\">Read Every Single Error<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>At Pulumi we read every single error message that our API produces. This is the primary mechanism that led to a 17x YoY reduction in our error rate<\/p>\n<p>\u00a0\u00a0<small>Evan Boyle \u2014 Pulumi<\/small><\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/world.hey.com\/itzy\/uptime-guarantees-a-pragmatic-perspective-736d7ea4\" target=\"_blank\" rel=\"noopener\">Uptime Guarantees \u2014 A Pragmatic Perspective<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Rather than striving for a million nines, we should choose the right reliability target based on an evaluation of the effect of downtime on the business.<\/p>\n<p>\u00a0\u00a0<small>Itzy Sabo \u2014 HEY<\/small><\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.infoq.com\/presentations\/blame-accountability\/\" target=\"_blank\" rel=\"noopener\">Reckoning with the Harm We Do: In Search of Restorative Just Culture in Software and Web Operations <\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>This is a presentation of a study of harm and trauma resulting from incident response work.  I especially like the part about blamelessness in theory versus practice.<\/p>\n<p>\u00a0\u00a0<small>Jessica DeVita \u2014 InfoQ<\/small><\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/incident.io\/blog\/learning-from-incidents-is-not-the-goal\" target=\"_blank\" rel=\"noopener\">Learning from incidents is not the goal<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Perhaps a sensationalist title, but there\u2019s a really good point here: learning from incidents is only practical if it actually improves the business.<\/p>\n<p>\u00a0\u00a0<small>Chris Evans \u2014 incident.io<\/small><\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/systemdesign.one\/real-time-presence-platform-system-design\/\" target=\"_blank\" rel=\"noopener\">Real-Time Presence Platform System Design<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>A highly-detailed proposal for a system to track which users are online at a huge scale.<\/p>\n<p>\u00a0\u00a0<small>Nk \u2014 System Design<\/small><\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/engineering.linkedin.com\/blog\/2023\/upscaling-profile-datastore-while-reducing-costs\" target=\"_blank\" rel=\"noopener\">Upscaling LinkedIn\u2019s Profile Datastore While Reducing Costs<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>However, for any cache to be used for the purpose of upscaling, it must operate completely independent from the source of truth (SOT) and must not be allowed to fall back to the SOT on failures.<\/p>\n<p>\u00a0\u00a0<small>Estella Pham and Guanlin Lu \u2013 LinkedIn<\/small><\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/admiralcloudberg.medium.com\/the-madness-in-our-methods-the-crash-of-germanwings-flight-9525-and-our-broken-aeromedical-system-5b95abd4fe6d\" target=\"_blank\" rel=\"noopener\">The Madness in our Methods: The crash of Germanwings flight 9525 and our broken aeromedical system<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>If you design your system to make lying the only viable option, then people will lie.  To me, this article is all about understanding that our systems involve real, squishy humans, an designing appropriately.<\/p>\n<p>\u00a0\u00a0<small>Admiral Cloudberg<\/small><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>SRE WEEKLY<\/p>","protected":false},"excerpt":{"rendered":"<p>View on sreweekly.com A message from our sponsor, Rootly: Rootly is hiring for a Sr. Developer Relations Advocate to continue helping more world-class companies like Figma, NVIDIA, Squarespace, accelerate their incident management journey. Looking for previous on-call engineers with a passion for making the world a more reliable place. Learn more: https:\/\/rootly.com\/careers?gh_jid=4015888007 Articles Read Every&hellip; <a class=\"more-link\" href=\"https:\/\/fde.cat\/index.php\/2023\/05\/15\/sre-weekly-issue-372\/\">Continue reading <span class=\"screen-reader-text\">SRE Weekly Issue #372<\/span><\/a><\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-713","post","type-post","status-publish","format-standard","hentry","category-sre","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":673,"url":"https:\/\/fde.cat\/index.php\/2023\/02\/06\/sre-weekly-issue-358\/","url_meta":{"origin":713,"position":0},"title":"SRE Weekly Issue #358","date":"February 6, 2023","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly\u00a0\ud83d\ude92. Rootly automates manual tasks like creating an incident channel, Jira ticket and Zoom rooms, inviting responders, creating statuspage updates, postmortem timelines and more. Want to see why companies like Canva and Grammarly love us?:\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":639,"url":"https:\/\/fde.cat\/index.php\/2022\/10\/10\/sre-weekly-issue-342\/","url_meta":{"origin":713,"position":1},"title":"SRE Weekly Issue #342","date":"October 10, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly\u00a0\ud83d\ude92. Rootly automates manual tasks like creating an incident channel, Jira ticket and Zoom rooms, inviting responders, creating statuspage updates, postmortem timelines and more. Want to see why companies like Canva and Grammarly love us?:\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":579,"url":"https:\/\/fde.cat\/index.php\/2022\/05\/30\/sre-weekly-issue-324\/","url_meta":{"origin":713,"position":2},"title":"SRE Weekly Issue #324","date":"May 30, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":603,"url":"https:\/\/fde.cat\/index.php\/2022\/07\/04\/sre-weekly-issue-329\/","url_meta":{"origin":713,"position":3},"title":"SRE Weekly Issue #329","date":"July 4, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":577,"url":"https:\/\/fde.cat\/index.php\/2022\/05\/16\/sre-weekly-issue-322\/","url_meta":{"origin":713,"position":4},"title":"SRE Weekly Issue #322","date":"May 16, 2022","format":false,"excerpt":"View on sreweekly.com Bit of a short issue this week. This morning, I stepped on my phone, crushing it mightily beneath my bootheel. Unfortunately a lot of my automation for reviewing articles is on there\u2026 thank goodness I have functioning backups. A message from our sponsor, Rootly: Manage incidents directly\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":594,"url":"https:\/\/fde.cat\/index.php\/2022\/06\/06\/sre-weekly-issue-325\/","url_meta":{"origin":713,"position":5},"title":"SRE Weekly Issue #325","date":"June 6, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/713","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=713"}],"version-history":[{"count":0,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/713\/revisions"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=713"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=713"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=713"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}