{"id":889,"date":"2024-07-01T01:24:33","date_gmt":"2024-07-01T01:24:33","guid":{"rendered":"https:\/\/fde.cat\/index.php\/2024\/07\/01\/sre-weekly-issue-431\/"},"modified":"2024-07-01T01:24:33","modified_gmt":"2024-07-01T01:24:33","slug":"sre-weekly-issue-431","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2024\/07\/01\/sre-weekly-issue-431\/","title":{"rendered":"SRE Weekly Issue #431"},"content":{"rendered":"

View on sreweekly.com<\/a><\/p>\n

\n

A message from our sponsor, FireHydrant<\/a>:<\/h2>\n

We\u2019ve gone all out on our new integration with Microsoft Teams. If you\u2019re a MS Teams user, FireHydrant now supports the most comprehensive integration for incident management. Run the entire IM process without ever leaving the chat.<\/p>\n

https:\/\/firehydrant.com\/blog\/introducing-a-brand-new-microsoft-teams-integration\/<\/a><\/p>\n<\/div>\n

\n
\n
\n
Cloudflare incident on June 20, 2024<\/a><\/div>\n
\n

This is a really thorny one. As individual subprocesses started infinitely looping, their system shifted load to other datacenters, masking the problem. A coinciding failure in the load shifting system made things even more interesting.<\/p>\n

\u00a0\u00a0Lloyd Wallis, Julien Desgats, and Manish Arora \u2014 Cloudflare<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Are dashboards dead? Not quite. They just haven\u2019t evolved<\/a><\/div>\n
\n

A great discussion of where dashboards fall short and what we should look for instead.<\/p>\n

\u00a0\u00a0Adam Kinniburgh \u2014 SquaredUp<\/small><\/p>\n<\/div>\n<\/div>\n

\n
How we improved push processing on GitHub<\/a><\/div>\n
\n

Read how we have significantly improved the ability of our monolith to correctly and fully process pushes from our users.<\/p>\n

\u00a0\u00a0Will Haltom \u2014 GitHub<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Can you run in a tight loop and still be well-behaved?<\/a><\/div>\n
\n

Timing things to happen at specific intervals is yet another way that we collectively find out that dealing with time is a hard problem.<\/p>\n

This article illustrates the subtle but important pitfalls in trying to create a system that does something on a strict interval.<\/p>\n

\u00a0\u00a0rachelbythebay<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Using LLMs to Generate Terraform Code<\/a><\/div>\n
\n

This article reads more like a case study. The author gave a prompt to three different LLMs and actually tested the Terraform config it produced.<\/p>\n

\u00a0\u00a0Mike Vanbuskirk \u2014 Terrateam<\/small><\/p>\n<\/div>\n<\/div>\n

\n
How the Pusher team built subscription counting at scale<\/a><\/div>\n
\n

When your pub\/sub system can have a million subscribers, even something mundane as notifying about subscriber counts requires careful thought.<\/p>\n

\u00a0\u00a0Ashmeet Singh \u2014 Pusher<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Quick and Dirty vs. Polished and Perfect: The Two Sides of Engineering<\/a><\/div>\n
\n

To me, this concept comes up over and over in SRE, and it\u2019s a core part of SLOs.<\/p>\n

\u00a0\u00a0Juraj Masar \u2014 BetterStack<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Feature flag vs feature management<\/a><\/div>\n
\n

In this blog post, we\u2019ll dive deep into the technical aspects of feature flags and feature management, exploring how they can be leveraged by SREs to enable progressive delivery, improve system resilience, and optimize the user experience. <\/p>\n

\u00a0\u00a0Hope Lynch \u2014 CloudBees<\/small><\/p>\n<\/div>\n<\/div>\n

\n
Pilots Unable to PULL UP!! Air Transat flight 211<\/a><\/div>\n
\n

This week\u2019s Mentour Pilot video covers an accident that involved an inaccurate flight simulator. I wasn\u2019t familiar with the term \u201cnegative training\u201d before, but now I\u2019m going to be keeping an eye out for it in the systems I manage!<\/p>\n

\u00a0\u00a0Mentour Pilot<\/small><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

SRE WEEKLY<\/p>","protected":false},"excerpt":{"rendered":"

View on sreweekly.com A message from our sponsor, FireHydrant: We\u2019ve gone all out on our new integration with Microsoft Teams. If you\u2019re a MS Teams user, FireHydrant now supports the most comprehensive integration for incident management. Run the entire IM process without ever leaving the chat. https:\/\/firehydrant.com\/blog\/introducing-a-brand-new-microsoft-teams-integration\/ Cloudflare incident on June 20, 2024 This is… Continue reading SRE Weekly Issue #431<\/span><\/a><\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-889","post","type-post","status-publish","format-standard","hentry","category-sre","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":872,"url":"https:\/\/fde.cat\/index.php\/2024\/06\/03\/sre-weekly-issue-427\/","url_meta":{"origin":889,"position":0},"title":"SRE Weekly Issue #427","date":"June 3, 2024","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, FireHydrant: We\u2019ve gone all out on our new integration with Microsoft Teams. If you\u2019re a MS Teams user, FireHydrant now supports the most comprehensive integration for incident management. Run the entire IM process without ever leaving the chat. https:\/\/firehydrant.com\/blog\/introducing-a-brand-new-microsoft-teams-integration\/ Why didn\u2019t you\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":874,"url":"https:\/\/fde.cat\/index.php\/2024\/06\/10\/sre-weekly-issue-428\/","url_meta":{"origin":889,"position":1},"title":"SRE Weekly Issue #428","date":"June 10, 2024","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, FireHydrant: We\u2019ve gone all out on our new integration with Microsoft Teams. If you\u2019re a MS Teams user, FireHydrant now supports the most comprehensive integration for incident management. Run the entire IM process without ever leaving the chat. https:\/\/firehydrant.com\/blog\/introducing-a-brand-new-microsoft-teams-integration\/ The Reverse Red\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":882,"url":"https:\/\/fde.cat\/index.php\/2024\/06\/17\/sre-weekly-issue-429\/","url_meta":{"origin":889,"position":2},"title":"SRE Weekly Issue #429","date":"June 17, 2024","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, FireHydrant: We\u2019ve gone all out on our new integration with Microsoft Teams. If you\u2019re a MS Teams user, FireHydrant now supports the most comprehensive integration for incident management. Run the entire IM process without ever leaving the chat. https:\/\/firehydrant.com\/blog\/introducing-a-brand-new-microsoft-teams-integration\/ Virtualizing Our Storage\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":885,"url":"https:\/\/fde.cat\/index.php\/2024\/06\/24\/sre-weekly-issue-430\/","url_meta":{"origin":889,"position":3},"title":"SRE Weekly Issue #430","date":"June 24, 2024","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, FireHydrant: We\u2019ve gone all out on our new integration with Microsoft Teams. If you\u2019re a MS Teams user, FireHydrant now supports the most comprehensive integration for incident management. Run the entire IM process without ever leaving the chat. https:\/\/firehydrant.com\/blog\/introducing-a-brand-new-microsoft-teams-integration\/ r\/sre: Senior SRE\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":899,"url":"https:\/\/fde.cat\/index.php\/2024\/07\/22\/sre-weekly-issue-434\/","url_meta":{"origin":889,"position":4},"title":"SRE Weekly Issue #434","date":"July 22, 2024","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, FireHydrant: We\u2019ve gone all out on our new integration with Microsoft Teams. If you\u2019re a MS Teams user, FireHydrant now supports the most comprehensive integration for incident management. Run the entire IM process without ever leaving the chat. https:\/\/firehydrant.com\/blog\/introducing-a-brand-new-microsoft-teams-integration\/ Technical Details: Falcon\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":891,"url":"https:\/\/fde.cat\/index.php\/2024\/07\/08\/sre-weekly-issue-432\/","url_meta":{"origin":889,"position":5},"title":"SRE Weekly Issue #432","date":"July 8, 2024","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, FireHydrant: We\u2019ve gone all out on our new integration with Microsoft Teams. If you\u2019re a MS Teams user, FireHydrant now supports the most comprehensive integration for incident management. Run the entire IM process without ever leaving the chat. https:\/\/firehydrant.com\/blog\/introducing-a-brand-new-microsoft-teams-integration\/ Investigating Mysterious Kafka\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/889","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=889"}],"version-history":[{"count":0,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/889\/revisions"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=889"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=889"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=889"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}