The Graph’s Service Outage Highlights Need for Decentralized Infrastructure

The Graph, a prominent blockchain data indexing protocol, recently experienced significant service disruptions, affecting several decentralized finance (DeFi) applications. According to The Graph’s official blog, the outages occurred due to a dramatic increase in query volumes, jumping from 25 million to 45 million queries per day, catalyzed by the growing adoption of DeFi applications.

Service Disruptions and Causes

On June 24, The Graph’s hosted service witnessed a severe degradation starting at midnight PST, lasting several hours. During this period, users faced slow responses and numerous 500 error messages. The service was restored by 11:10 am PST, with a subsequent disruption occurring later that day.

The primary cause of the outage was the overutilization of The Graph’s database CPU on Google Cloud, which reached 100% capacity. This was compounded by the influx of complex queries that strained the system further. The Graph’s query processing software, Graph Node, struggled with these complex queries, leading to increased failure rates.

Response and Mitigation Measures

In response to the outage, The Graph has implemented several immediate measures to prevent future occurrences. These include introducing sophisticated query complexity costing, optimizing query processing through improved caching, and setting more aggressive alerts. Additionally, horizontal database scaling and selective rate-limiting have been introduced to manage unexpected traffic spikes effectively.

The company also plans to expand its engineering team across different time zones to ensure better response capabilities during future incidents.

Decentralization: A Fundamental Solution

The incident has highlighted the importance of decentralization in ensuring application reliability. The Graph’s mission is to transition towards a fully decentralized network, reducing reliance on centralized infrastructure and enhancing the resilience of blockchain applications.

Decentralized infrastructure will allow developers to build on a foundation that is less susceptible to failures, ensuring that applications remain operational regardless of individual component failures. The Graph is committed to advancing this mission, aiming to provide a robust data layer for the burgeoning crypto economy.

The outage serves as a reminder of the challenges faced by centralized systems in the rapidly evolving DeFi landscape, underscoring the need for decentralized solutions to support future growth.

Image source: Shutterstock