{"id":329,"date":"2021-08-31T14:39:51","date_gmt":"2021-08-31T14:39:51","guid":{"rendered":"https:\/\/fde.cat\/?p=329"},"modified":"2021-08-31T14:39:51","modified_gmt":"2021-08-31T14:39:51","slug":"sre-weekly-issue-278","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-278\/","title":{"rendered":"SRE Weekly Issue #278"},"content":{"rendered":"

View on sreweekly.com<\/a><\/p>\n

\n

A message from our sponsor, StackHawk:<\/h2>\n

Learn how our team at StackHawk tests external cookie authentication using Ktor, and check out some of the helper functions we wrote to make the tests easy to write, read, and maintain
\nhttps:\/\/sthwk.com\/ktor<\/a><\/p>\n<\/div>\n

Articles<\/h2>\n
\n
That Sinking Feeling (The #HugOps Song)<\/a><\/div>\n
\n

Whoa.\u00a0 This is the best thing ever.\u00a0 I feel like I want to make this the official theme song of SRE Weekly.<\/p>\n

Forrest Brazeal<\/p>\n<\/div>\n<\/div>\n

\n
r\/WallStreetBets Incident Anthology (What Worked Edition): Autoscaler<\/a><\/div>\n
\n

Their auto-scaling algorithm needed a tweak. Before: scale up by N instances. After: scale up by an amount proportional to the current number of instances.<\/p>\n

Fran Garcia \u2014 Reddit<\/p>\n<\/div>\n<\/div>\n

\n
The Incident Review: 4 Incidents in Outer Space<\/a><\/div>\n
\n

here\u2019s a look at incidents and reliability challenges that have occurred in outer space, and what SREs stand to learn from them.<\/p>\n

JJ Tang \u2014 Rootly<\/p>\n<\/div>\n<\/div>\n

\n
Prepare for overnight success \u2014 with the right load testing approach<\/a><\/div>\n
\n

This one includes 3 key things to remember while load testing. My favorite: test the whole system, not just parts.<\/p>\n

Cortex<\/p>\n<\/div>\n<\/div>\n

\n
4 ways to improve your influence as an SRE<\/a><\/div>\n
\n

SRE is as much about building consensus and earning buy-in as it is about actual engineering.<\/p>\n

Cortex<\/p>\n<\/div>\n<\/div>\n

\n
NoOps: What Does the Future Hold for DevOps Engineers?<\/a><\/div>\n
\n

The definition of NoOps in this article is more clear than others I\u2019ve seen. It\u2019s not about firing your operations team \u2014 their skill set is still necessary.<\/p>\n

Kentaro Wakayama<\/p>\n<\/div>\n<\/div>\n

\n
Systems Observability<\/a><\/div>\n
\n

Even though I know what observability is, I got a lot out of this article. It has some excellent examples of questions that are hard to answer with traditional dashboards, and includes my new favorite term:<\/p>\n

The industrial term for this problem is Watermelon Metrics<\/strong>; A situation where individual dashboards look green, but the overall performance is broken and red inside.<\/p>\n

Nishant Modak and Piyush Verma \u2014 Last9<\/p>\n<\/div>\n<\/div>\n

\n
Controlling a process we don\u2019t understand<\/a><\/div>\n
\n

Instead, we should consider the fields there where practitioners are responsible for controlling a dynamic process that\u2019s too complex for humans to fully understand<\/strong>.<\/p>\n

Lorin Hochstein<\/p>\n<\/div>\n<\/div>\n

\n
Troubleshooting: A journey into the unknown<\/a><\/div>\n
\n

In this epic troubleshooting story, a weird curl bug coupled with Linux memory tuning parameters led to unexpected CPU consumption in an unrelated process.<\/p>\n

Pavlos Parissis \u2014 Booking.com<\/p>\n<\/div>\n<\/div>\n

\n
How Back Market SREs prepared for Black Friday<\/a><\/div>\n
\n

Learning a lesson from a rough Black Friday in 2019, these folks used load testing to gather hard data on how they would likely fare in 2020.<\/p>\n

Mathieu Garstecki \u2014 Back Market<\/p>\n<\/div>\n<\/div>\n

Outages<\/h2>\n

Akbank<\/a>
\nCommonwealth Bank<\/a>
\nHeroku<\/a>
\nTikTok<\/a>
\nSRE WEEKLY<\/p>\n","protected":false},"excerpt":{"rendered":"

View on sreweekly.com A message from our sponsor, StackHawk: Learn how our team at StackHawk tests external cookie authentication using Ktor, and check out some of the helper functions we wrote to make the tests easy to write, read, and maintain https:\/\/sthwk.com\/ktor Articles That Sinking Feeling (The #HugOps Song) Whoa.\u00a0 This is the best thing… Continue reading SRE Weekly Issue #278<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-329","post","type-post","status-publish","format-standard","hentry","category-sre","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":254,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-253\/","url_meta":{"origin":329,"position":0},"title":"SRE Weekly Issue #253","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: How do you know if your GraphQL API is secure? Watch StackHawk CSO Scott Gerlach walk through how to run application security tests for GraphQL-backed apps. http:\/\/sthwk.com\/graphql-webinar Articles May 30 SSL incident TLS can be such a headache. This was an\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":269,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-257\/","url_meta":{"origin":329,"position":1},"title":"SRE Weekly Issue #257","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: Keeping your APIs secure requires thoughtful design and testing. Learn how to protect your REST, SOAP and GraphQL APIs from security vulnerabilities with StackHawk http:\/\/sthwk.com\/api-protection Articles Sometimes alerts have inobvious reasons for existing This one really got me thinking. Make sure\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":350,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-284\/","url_meta":{"origin":329,"position":2},"title":"SRE Weekly Issue #284","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com Like last week, I prepared this week\u2019s issue in advance, so no Outages section.\u00a0 Have a great week! A message from our sponsor, StackHawk: Trying to automate application and API security testing? See how StackHawk and Burp Suite Enterprise stack up: https:\/\/sthwk.com\/burp-enterprise Articles Alerting on SLOs like\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":463,"url":"https:\/\/fde.cat\/index.php\/2021\/09\/20\/sre-weekly-issue-287\/","url_meta":{"origin":329,"position":3},"title":"SRE Weekly Issue #287","date":"September 20, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: Trying to figure out how to keep your APIs secure? You\u2019re not the only one. See how DataRobot is automating API security testing with StackHawk. https:\/\/sthwk.com\/DataRobot Articles Industry Interviews: Colm Doyle, Incident Commander at Slack Lots of details about how Slack\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":255,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-252\/","url_meta":{"origin":329,"position":4},"title":"SRE Weekly Issue #252","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: Interested in how you can automate application security testing with GitHub Actions? Check out this on demand webinar from StackHawk and Snyk and see how simple it is to get started. https:\/\/sthwk.com\/stackhawk-snyk Articles Building On-Call Culture at GitHub Their on-call started\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":327,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-277\/","url_meta":{"origin":329,"position":5},"title":"SRE Weekly Issue #277","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: Planelty saved weeks of work by implementing StackHawk instead of building an internal ZAP service. See how: https:\/\/sthwk.com\/planetly-stackhawk Articles FINRA Orders Record Financial Penalties Against Robinhood Financial LLC Remember all those Robinhood outages? The US financial regulatory agency is making Robinhood\u2026","rel":"","context":"In "SRE"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/329","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=329"}],"version-history":[{"count":1,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/329\/revisions"}],"predecessor-version":[{"id":381,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/329\/revisions\/381"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=329"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=329"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=329"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}