Co-written by Alex Oscherov Up until recently, we, like many companies, built our data pipelines in any one of a handful of technologies using Java or Scala, including Apache Spark, Storm, and Kafka. But Java is a very verbose language, so writing these pipelines in Java involves a lot of boilerplate code. For example, simple bean… Continue reading Building Data Pipelines Using Kotlin
Blog
SRE Weekly Issue #279
View on sreweekly.com A message from our sponsor, StackHawk: On July 28, ZAP Creator Simon Bennetts is giving a first look at ZAP’s new automation framework. Grab your spot: https://sthwk.com/ZAP-Automation Articles Managing the Risk of Cascading Failure This is a presentation by Laura Nolan (with text transcript) all about cascading failure, what causes it, how… Continue reading SRE Weekly Issue #279
Innovation is About the Journey: The Mulesoft Design Services Story
Meet Mulesoft Design Services At Mulesoft, a critical part of integrating everything is building the Mule Applications that make those integrations. For such, Mulesoft has many different options for our customers to use, including Composer, Flow Designer, and Studio, among others. All of those need a Mule Runtime in the back to help the customer quickly… Continue reading Innovation is About the Journey: The Mulesoft Design Services Story
How to Rename a Helm Release
Problem The process for migrating from Helm v2 to v3, the latest stable major release, was pretty straightforward. However, while performing the migration, we encountered an anomaly with how one of the application charts had been deployed, thus introducing additional challenges. One of our application’s Helm v2 releases did not adhere to the standard naming… Continue reading How to Rename a Helm Release
SRE Weekly Issue #284
View on sreweekly.com Like last week, I prepared this week’s issue in advance, so no Outages section. Have a great week! A message from our sponsor, StackHawk: Trying to automate application and API security testing? See how StackHawk and Burp Suite Enterprise stack up: https://sthwk.com/burp-enterprise Articles Alerting on SLOs like Pros Soundcloud is very clear… Continue reading SRE Weekly Issue #284
RAMP-TAO: Layering atomic transactions on Facebook’s online graph store
What the research is: RAMP-TAO is a new protocol that improves the developer experience on TAO, Facebook’s online social graph store, by providing stronger transactional guarantees. It is the first protocol to provide transactional semantics over an eventually consistent massive-scale data store while still preserving the system’s overall reliability and performance. RAMP-TAO enables an intuitive… Continue reading RAMP-TAO: Layering atomic transactions on Facebook’s online graph store
Apricot subsea cable will boost internet capacity, speeds in the Asia-Pacific region
We are excited to announce our participation in the Apricot subsea cable system, together with leading regional and global partners. When completed, the project (which is still subject to regulatory approvals) will deliver much-needed internet capacity, redundancy, and reliability to expand connections in the Asia-Pacific region. The 12,000-kilometer-long cable will connect Japan, Taiwan, Guam, the… Continue reading Apricot subsea cable will boost internet capacity, speeds in the Asia-Pacific region
SRE Weekly Issue #283
View on sreweekly.com I’m on vacation enjoying the sunny beaches in Maine with my family, so I prepared this week’s issue in advance. No outages section, save for one big one I noticed due to direct personal experience. See you all next week! A message from our sponsor, StackHawk: StackHawk is now integrated with GitHub Code… Continue reading SRE Weekly Issue #283
Open-sourcing a more precise time appliance
Facebook engineers have built and open-sourced an Open Compute Time Appliance, an important component of the modern timing infrastructure. To make this possible, we came up with the Time Card — a PCI Express (PCIe) card that can turn almost any commodity server into a time appliance. With the help of the OCP community, we… Continue reading Open-sourcing a more precise time appliance
Open-sourcing Thrift for Haskell
What it is: Thrift is a serialization and remote procedure call (RPC) framework used for cross-service communication. Most services at Facebook communicate via Thrift because it provides a simple, language-agnostic protocol for communicating with structured data. Thrift can already be used in programming languages such as C++, Python, and Java using fbthrift. We are also… Continue reading Open-sourcing Thrift for Haskell