Consolidating Facebook storage infrastructure with Tectonic file system

What the research is:  Tectonic, our data center scale distributed file system, enables better resource utilization, promotes simpler services, and requires less operational complexity than our previous approach. Our previous storage infrastructure consisted of a set of use-case specific storage systems. Clusters, or instances of these storage systems, used to scale to tens of petabytes.… Continue reading Consolidating Facebook storage infrastructure with Tectonic file system

Published
Categorized as Technology

117. Open Source with Jim Jagielski

ListenSubscribe Jim Jagielski is the newest member of Salesforce’s Open Source Program Office, but he’s no newbie to open source. In this episode, he talks with Alyssa Arvin, Senior Program Manager for Open Source about his early explorations into open source software during his time as an actual rocket scientist at NASA, what he’s learned… Continue reading 117. Open Source with Jim Jagielski

Published
Categorized as Technology

SRE Weekly Issue #276

View on sreweekly.com A message from our sponsor, StackHawk: Get ready for some GraphQL! Tune in this Tuesday, June 29 at 9 AM PT for an automated GraphQL security testing learning lab. Register: http://sthwk.com/graphql-learning-lab Articles @GergelyOrosz on blaming the intern HBO accidentally sent an email to a bunch of people, and they tweeted (jokingly?) blaming… Continue reading SRE Weekly Issue #276

Published
Categorized as SRE

Driving towards an open internet ecosystem to help tackle the digital divide

Connectivity is an integral part of Facebook’s mission to bring people closer together, and the COVID-19 pandemic has only heightened the demand for critical internet access. According to the latest edition of our Inclusive Internet Index, nearly 70 percent of people around the world believe that increased internet usage in all aspects of their lives… Continue reading Driving towards an open internet ecosystem to help tackle the digital divide

Published
Categorized as Technology

Asicmon: A platform agnostic observability system for AI accelerators

We will be hosting a talk about our work on, “A Platform Agnostic Observability System for AI Accelerators” during our virtual Systems @Scale event at 10:20 a.m. PT on Wednesday, June 30, followed by a live Q&A session. Please submit any questions to systemsatscale@fb.com before the event. Accelerators are special-purpose hardware devices optimized for specific… Continue reading Asicmon: A platform agnostic observability system for AI accelerators

Published
Categorized as Technology

SRE Weekly Issue #277

View on sreweekly.com A message from our sponsor, StackHawk: Planelty saved weeks of work by implementing StackHawk instead of building an internal ZAP service. See how: https://sthwk.com/planetly-stackhawk Articles FINRA Orders Record Financial Penalties Against Robinhood Financial LLC Remember all those Robinhood outages? The US financial regulatory agency is making Robinhood repay folks for the losses… Continue reading SRE Weekly Issue #277

Published
Categorized as SRE

Ribbon filter: Practically smaller than Bloom and Xor

What the research is: The Ribbon filter is a new data structure that is more space-efficient than the popular Bloom filters that are widely used for optimizing data retrieval. One of the ways that Bloom, and now Ribbon, filters solve real engineering problems is by providing smooth configurability unmatched by other filters. Bloom filters work… Continue reading Ribbon filter: Practically smaller than Bloom and Xor

Published
Categorized as Technology

SRE Weekly Issue #278

View on sreweekly.com A message from our sponsor, StackHawk: Learn how our team at StackHawk tests external cookie authentication using Ktor, and check out some of the helper functions we wrote to make the tests easy to write, read, and maintain https://sthwk.com/ktor Articles That Sinking Feeling (The #HugOps Song) Whoa.  This is the best thing… Continue reading SRE Weekly Issue #278

Published
Categorized as SRE

Enforcing encryption at scale

Our infrastructure supports thousands of services that handle billions of requests per second. We’ve previously discussed how we built our service encryption infrastructure to keep these globally distributed services operating securely and performantly. This post discusses the system we designed to enforce encryption policies within our network and shares some of the lessons we learned… Continue reading Enforcing encryption at scale

Published
Categorized as Technology

How WhatsApp enables multi-device capability

For years, people have been asking us to create a true multi-device experience that allows people to use WhatsApp on other devices without requiring a smartphone connection. Today, we’re announcing the rollout of a limited public beta test for WhatsApp’s updated multi-device capability.  With this new capability, you can now use WhatsApp on your phone… Continue reading How WhatsApp enables multi-device capability

Published
Categorized as Technology