{"id":807,"date":"2023-12-25T03:30:10","date_gmt":"2023-12-25T03:30:10","guid":{"rendered":"https:\/\/fde.cat\/index.php\/2023\/12\/25\/sre-weekly-issue-404\/"},"modified":"2023-12-25T03:30:10","modified_gmt":"2023-12-25T03:30:10","slug":"sre-weekly-issue-404","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2023\/12\/25\/sre-weekly-issue-404\/","title":{"rendered":"SRE Weekly Issue #404"},"content":{"rendered":"

View on sreweekly.com<\/a><\/p>\n

\n

A message from our sponsor, FireHydrant<\/a>:<\/h2>\n

Looking to cozy up with a good read this week? Check out \u201cYour guide to better status pages.\u201d It\u2019s a mini masterclass on how to better communicate on your status pages.
\nhttps:\/\/firehydrant.com\/blog\/your-guide-to-better-incident-status-pages\/<\/a><\/p>\n<\/div>\n

\n
\n
\n
Rule of 10x per 9<\/a><\/div>\n
\n

For every 9 you add to SLO, you\u2019re making the system 10x more reliable but also 10x more expensive.<\/p>\n

\u00a0\u00a0Alex Ewerl\u00f6f<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Patching around a C++ crash with a little bit of Lua<\/a><\/div>\n
\n

In this incident story, the feature flags were served by the main application server. When a new feature caused the server to crash, there was no way to flip the flag back off to stop the crashes.<\/p>\n

\u00a0\u00a0rachelbythebay<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Set Taxonomies to Neutral<\/a><\/div>\n
\n

The author of a classification system for human error reflects 20 years later on the harm that such systems can cause by using deficit-based language.<\/p>\n

\u00a0\u00a0Dr. Steven Shorrock<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Post Mortem on VOID Report: Cloudflare Control Plane and Analytics Outage<\/a><\/div>\n
\n

Here\u2019s Fred Hebert\u2019s analysis of Cloudflare\u2019s write-up of their incident on November 2.<\/p>\n

I\u2019m hoping they\u2019re going to do a more in-depth review.<\/p>\n

\u00a0\u00a0Fred Hebert \u2014 VOID<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Integrating manual with automatic instrumentation<\/a><\/div>\n
\n

In this post, we introduce a hybrid approach that seamlessly combines the precision of manual instrumentation with the comfort, efficiency, and performance of automatic instrumentation.<\/p>\n

\u00a0\u00a0Ron Federman \u2014 Odigos<\/small><\/p>\n<\/div>\n<\/div>\n

\n
The Swedbank Outage shows that Change Controls don\u2019t\u00a0work<\/a><\/div>\n
\n

Change is not the problem. It\u2019s unaddressed risk<\/p>\n

\u00a0\u00a0Bruce Johnston \u2014 High Scalability<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Production Postmortem: The Spawn of Denial of Service<\/a><\/div>\n
\n

A shell script with a loop running a DB client can fill up your ephemeral ports in a hurry.<\/p>\n

\u00a0\u00a0Oren Eini \u2014 RavenDB<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Writing Code is the Same Thing as Writing Prose<\/a><\/div>\n
\n

When you get right down to it, it\u2019s all human communication, even assembly code. It\u2019s human factors all the way down.<\/p>\n

\u00a0\u00a0Michael Hart<\/small><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

SRE WEEKLY<\/p>","protected":false},"excerpt":{"rendered":"

View on sreweekly.com A message from our sponsor, FireHydrant: Looking to cozy up with a good read this week? Check out \u201cYour guide to better status pages.\u201d It\u2019s a mini masterclass on how to better communicate on your status pages. https:\/\/firehydrant.com\/blog\/your-guide-to-better-incident-status-pages\/ Rule of 10x per 9 For every 9 you add to SLO, you\u2019re making… Continue reading SRE Weekly Issue #404<\/span><\/a><\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-807","post","type-post","status-publish","format-standard","hentry","category-sre","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":498,"url":"https:\/\/fde.cat\/index.php\/2021\/11\/01\/sre-weekly-issue-294\/","url_meta":{"origin":807,"position":0},"title":"SRE Weekly Issue #294","date":"November 1, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo: https:\/\/rootly.com\/?utm_source=sreweekly Articles Five Steps To Reduce SRE Toil\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":797,"url":"https:\/\/fde.cat\/index.php\/2023\/11\/27\/sre-weekly-issue-400\/","url_meta":{"origin":807,"position":1},"title":"SRE Weekly Issue #400","date":"November 27, 2023","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, FireHydrant: How is FireHydrant building its alerting tool, Signals, to be robust, lightning-fast, and configurable to how YOU work? In this edition, of their Captain\u2019s Log, they dive into CEL and how they\u2019re using it to handle routing and logic. https:\/\/firehydrant.com\/blog\/captains-log-how-were-leveraging-cel\/ A\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":725,"url":"https:\/\/fde.cat\/index.php\/2023\/06\/19\/sre-weekly-issue-377\/","url_meta":{"origin":807,"position":2},"title":"SRE Weekly Issue #377","date":"June 19, 2023","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Curious how companies like Figma, Tripadvisor, and 100s of others leverage Rootly to manage incidents in Slack and unlock instant best practices? Check out this lightning demo: https:\/\/www.loom.com\/share\/051c4be0425a436e888dc0c3690855ad Articles Why did AWS Support fail with US-EAST-1 again? AWS had a major\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":627,"url":"https:\/\/fde.cat\/index.php\/2022\/09\/05\/sre-weekly-issue-337\/","url_meta":{"origin":807,"position":3},"title":"SRE Weekly Issue #337","date":"September 5, 2022","format":false,"excerpt":"View on sreweekly.com Thanks for all the vacation well-wishes! It was really great and relaxing. Take vacations, it\u2019s important for reliability! While I was out, I shipped the past two issues with content prepared in advance, and without the Outages section. This gave me a chance to really think hard\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":603,"url":"https:\/\/fde.cat\/index.php\/2022\/07\/04\/sre-weekly-issue-329\/","url_meta":{"origin":807,"position":4},"title":"SRE Weekly Issue #329","date":"July 4, 2022","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem timeline, setting up reminders, and more. Book a demo (+ get a snazzy Rootly lego set): https:\/\/rootly.com\/demo\/\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":607,"url":"https:\/\/fde.cat\/index.php\/2022\/07\/18\/sre-weekly-issue-330\/","url_meta":{"origin":807,"position":5},"title":"SRE Weekly Issue #330","date":"July 18, 2022","format":false,"excerpt":"View on sreweekly.com Thanks for all the well-wishes as I took a sick day last week. I\u2019m feeling much better! A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly \ud83d\ude92. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging and adding responders, postmortem\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/807","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=807"}],"version-history":[{"count":0,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/807\/revisions"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=807"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=807"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=807"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}