How to ETL at Petabyte-Scale with Trino

Trino (formerly known as PrestoSQL) is widely appreciated as a fast distributed SQL query engine, but there is precious little information online about using it for batch extract, transform, and load (ETL) ingestion (outside of the original Facebook paper), particularly at petabyte+ scale. After deciding to use Trino as a key piece of Salesforce’s Big… Continue reading How to ETL at Petabyte-Scale with Trino

Published
Categorized as Technology

SRE Weekly Issue #291

View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly 🚒. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo: https://rootly.io/?utm_source=sreweekly Articles Understanding How Facebook Disappeared from the Internet Facebook’s outage caused significantly… Continue reading SRE Weekly Issue #291

Published
Categorized as SRE

Evolution of Region Assignment in the Apache HBase Architecture — Part 3

Evolution of Region Assignment in the Apache HBase Architecture — Part 3 Authors: Viraj Jasani, Andrew Purtell, 张铎(Duo Zhang) In the second part of this blog post series, we provided an overview of how the redesigned AssignmentManager in HBase 2 efficiently and reliably manages the process of region assignment. In this third entry in this blog post series, we… Continue reading Evolution of Region Assignment in the Apache HBase Architecture — Part 3

Published
Categorized as Technology

SRE Weekly Issue #290

View on sreweekly.com A message from our sponsor, Rootly: Manage incidents directly from Slack with Rootly 🚒. Automate manual admin tasks like creating incident channel, Jira and Zoom, paging the right team, postmortem timeline, setting up reminders, and more. Book a demo: https://rootly.io/?utm_source=sreweekly Articles Postmortem: Partial RavenDB Cloud outage Despite carefully testing how they would… Continue reading SRE Weekly Issue #290

Published
Categorized as SRE

Open-sourcing Mariana Trench: Analyzing Android and Java app security in depth

We’re sharing details about Mariana Trench (MT), a tool we use to spot and prevent security and privacy bugs in Android and Java applications. As part of our effort to help scale security through building automation, we recently open-sourced MT to support security engineers at Facebook and across the industry.  This post is the third… Continue reading Open-sourcing Mariana Trench: Analyzing Android and Java app security in depth

Published
Categorized as Technology

Switch It Up!

It is vital that a microservice striving for high availability have at its disposal several choices on how to rollback changes when unforeseen production issues occur. A very interesting article comes to mind from O’Reilly, Generic Mitigations, where the theme is to restore service functionality FIRST and FAST — and THEN root cause the real fix as… Continue reading Switch It Up!

Published
Categorized as Technology