{"id":327,"date":"2021-08-31T14:39:51","date_gmt":"2021-08-31T14:39:51","guid":{"rendered":"https:\/\/fde.cat\/?p=327"},"modified":"2021-08-31T14:39:51","modified_gmt":"2021-08-31T14:39:51","slug":"sre-weekly-issue-277","status":"publish","type":"post","link":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-277\/","title":{"rendered":"SRE Weekly Issue #277"},"content":{"rendered":"<p><a href=\"https:\/\/sreweekly.com\/sre-weekly-issue-277\/\" title=\"Permalink to SRE Weekly Issue #277\" class=\"email_only\">View on sreweekly.com<\/a><\/p>\n<div class=\"sreweekly-sponsor-message\">\n<h2>A message from our sponsor, StackHawk:<\/h2>\n<p>Planelty saved weeks of work by implementing StackHawk instead of building an internal ZAP service. See how:<br \/>\n<a href=\"https:\/\/sthwk.com\/planetly-stackhawk\">https:\/\/sthwk.com\/planetly-stackhawk<\/a><\/p>\n<\/div>\n<h2>Articles<\/h2>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.finra.org\/media-center\/newsreleases\/2021\/finra-orders-record-financial-penalties-against-robinhood-financial\">FINRA Orders Record Financial Penalties Against Robinhood Financial LLC<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Remember all those Robinhood outages? The US financial regulatory agency is making Robinhood repay folks for the losses they sustained as a result and also fining them for other reasons.<\/p>\n<p>Michelle Ong, Ray Pellecchia, Angelita Plemmer Williams, and Andrew DeSouza \u2014 FINRA<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.reddit.com\/r\/RedditEng\/comments\/o4yb4z\/rwallstreetbets_incident_anthology_more_data_more\/\">r\/WallStreetBets Incident Anthology: More Data, More Problems<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>This is brilliant and I wish I\u2019d thought of it years ago:<\/p>\n<p>One of the things we\u2019ve previously seen during database incidents is that a set of impacted tables can provide a unique fingerprint to identify a feature that\u2019s triggering issues.<\/p>\n<p>Courtney Wang \u2014 Reddit<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.circleid.com\/posts\/20210628-the-deeper-root-cause-of-the-fastly-and-akamai-outages\/\">The Deeper Root Cause of the Fastly and Akamai Outages<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>The suggested root cause involves\u00a0consolidation in cloud providers and the importance of DNS.<\/p>\n<p>Alban Kwan \u2014 CircleID<\/p>\n<p><em>Full disclosure: Fastly, my employer, is mentioned.<\/em><\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC2821100\/\">The normalization of deviance in healthcare delivery<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>This paper is about recognizing normalization of deviance and techniques for dealing with it. This tidbit really made me think:<\/p>\n<p>[\u2026] they might have been taught a system deviation without realizing that it was so [\u2026]<\/p>\n<p>Bus Horiz<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.blameless.com\/blog\/elephant-in-the-blameless-war-room-accountability\">Elephant in the Blameless War Room: Accountability<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>Blameless incident analysis is often at odds with a desire to \u201chold people accountable\u201d. This article explores that conflict and techniques for managing the needs involved.<\/p>\n<p>Christina Tan and Emily Arnott \u2014 Blameless<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/www.honeycomb.io\/blog\/shipping-on-spent-error-budget\/\">Shipping on a Spent Error Budget<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>What can you do if you\u2019re out of error budget but you still want to deliver new features? Get creative.<\/p>\n<p>Paul Osman \u2014 Honeycomb<\/p>\n<\/div>\n<\/div>\n<div class=\"sreweekly-entry\">\n<div class=\"sreweekly-title\"><a href=\"https:\/\/medium.com\/@bruce_25864\/the-sre-incident-response-game-db242fff391c\">The SRE Incident Response game<\/a><\/div>\n<div class=\"sreweekly-description\">\n<p>I am going to go through the variation we use to up skill our on-call engineers we called \u201cThe Kobayashi Maru\u201d, the name we borrowed from the Star Trek training exercise to test the character of Starfleet cadets.<\/p>\n<p>Bruce Dominguez<\/p>\n<\/div>\n<\/div>\n<h2>Outages<\/h2>\n<p><a href=\"https:\/\/status.slack.com\/\/2021-06\/227bc1fa2a751188\">Slack<\/a><br \/>\n<a href=\"https:\/\/www.techzim.co.zw\/2021\/06\/zss-outage-affecting-bancabc-and-others\/\">Zimbabwe Shared Services (financial services)<\/a><br \/>\n<a href=\"https:\/\/gamingideology.com\/2021\/06\/28\/snapchat-crashes-iphone-users-report-app-not-working-and-keeps-closing\/\">Snapchat<\/a><br \/>\n<a href=\"https:\/\/thestarphoenix.com\/pmn\/business-pmn\/facebook-says-services-restored-after-outage\">Facebook<\/a><br \/>\n<a href=\"https:\/\/www.bolnews.com\/technology\/2021\/06\/google-youtube-gmail-services-down-for-multiple-users\/\">YouTube<\/a><br \/>\n<a href=\"https:\/\/www.express.co.uk\/entertainment\/gaming\/1456784\/Twitter-down-posts-not-working-outage-report\">Twitter<\/a><br \/>\n<a href=\"https:\/\/status.nest.com\/issue\/4071c788-1bc5-400c-bfe8-f9c6e76ded54\">Nest<\/a><br \/>\n<a href=\"https:\/\/twitter.com\/gcashofficial\/status\/1409432338291855360\">GCash<\/a><br \/>\nSRE WEEKLY<\/p>\n","protected":false},"excerpt":{"rendered":"<p>View on sreweekly.com A message from our sponsor, StackHawk: Planelty saved weeks of work by implementing StackHawk instead of building an internal ZAP service. See how: https:\/\/sthwk.com\/planetly-stackhawk Articles FINRA Orders Record Financial Penalties Against Robinhood Financial LLC Remember all those Robinhood outages? The US financial regulatory agency is making Robinhood repay folks for the losses&hellip; <a class=\"more-link\" href=\"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-277\/\">Continue reading <span class=\"screen-reader-text\">SRE Weekly Issue #277<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[8],"tags":[],"class_list":["post-327","post","type-post","status-publish","format-standard","hentry","category-sre","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":252,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-255\/","url_meta":{"origin":327,"position":0},"title":"SRE Weekly Issue #255","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: With StackHawk\u2019s new GitHub Action, you can integrate AppSec testing directly into your GitHub CI\/CD pipeline. See how: http:\/\/sthwk.com\/appsec-github-action Articles Why It Should Be Service, Not Site Reliability It really should! Even Google is much more accurately described as a \u201cservice\u201d\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":255,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-252\/","url_meta":{"origin":327,"position":1},"title":"SRE Weekly Issue #252","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: Interested in how you can automate application security testing with GitHub Actions? Check out this on demand webinar from StackHawk and Snyk and see how simple it is to get started. https:\/\/sthwk.com\/stackhawk-snyk Articles Building On-Call Culture at GitHub Their on-call started\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":298,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-266\/","url_meta":{"origin":327,"position":2},"title":"SRE Weekly Issue #266","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: Are you a ZAP user looking to automate your security testing? Make sure to tune in to ZAPCon After Hours on Tuesday at 8 am PT to see how you can use Jenkins and Zest scripts to automate ZAP. http:\/\/sthwk.com\/zapcon-ah Articles\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":350,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-284\/","url_meta":{"origin":327,"position":3},"title":"SRE Weekly Issue #284","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com Like last week, I prepared this week\u2019s issue in advance, so no Outages section.\u00a0 Have a great week! A message from our sponsor, StackHawk: Trying to automate application and API security testing? See how StackHawk and Burp Suite Enterprise stack up: https:\/\/sthwk.com\/burp-enterprise Articles Alerting on SLOs like\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":269,"url":"https:\/\/fde.cat\/index.php\/2021\/08\/31\/sre-weekly-issue-257\/","url_meta":{"origin":327,"position":4},"title":"SRE Weekly Issue #257","date":"August 31, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: Keeping your APIs secure requires thoughtful design and testing. Learn how to protect your REST, SOAP and GraphQL APIs from security vulnerabilities with StackHawk http:\/\/sthwk.com\/api-protection Articles Sometimes alerts have inobvious reasons for existing This one really got me thinking. Make sure\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":463,"url":"https:\/\/fde.cat\/index.php\/2021\/09\/20\/sre-weekly-issue-287\/","url_meta":{"origin":327,"position":5},"title":"SRE Weekly Issue #287","date":"September 20, 2021","format":false,"excerpt":"View on sreweekly.com A message from our sponsor, StackHawk: Trying to figure out how to keep your APIs secure? You\u2019re not the only one. See how DataRobot is automating API security testing with StackHawk. https:\/\/sthwk.com\/DataRobot Articles Industry Interviews: Colm Doyle, Incident Commander at Slack Lots of details about how Slack\u2026","rel":"","context":"In &quot;SRE&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/327","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/comments?post=327"}],"version-history":[{"count":1,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/327\/revisions"}],"predecessor-version":[{"id":383,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/posts\/327\/revisions\/383"}],"wp:attachment":[{"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/media?parent=327"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/categories?post=327"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fde.cat\/index.php\/wp-json\/wp\/v2\/tags?post=327"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}