By Itay Braun, CTO Metis

Database Observability Toolkit for Developers

The Database Observability Toolkit is an open-source project designed to simplify the intricate task of monitoring and managing databases for developers. Given the complexity of databases and the fact that many developers may not possess an in-depth understanding of their inner workings, our project strives to provide a comprehensive, clear, and actionable set of tools. These tools empower developers to seamlessly detect, comprehend, and effectively resolve database-related issues.

Key Features

Our project centers on providing an intuitive and developer-centric experience, encompassing the following key features:

• Real-time Monitoring: Gain real-time insights into your database's performance and resource utilization. Detect unusual patterns and spikes that could adversely affect your application's performance.

• Query Analysis: Dive into the impact of queries on your database's performance. Identify sluggish queries, scrutinize execution plans, and optimize queries to enhance efficiency.

• Historical Data: Access historical data to discern trends and patterns over time. Such historical insight is invaluable for capacity planning and identifying long-term performance tendencies.

• Troubleshooting Guides: Benefit from actionable guidance when issues are uncovered. The toolkit supplies troubleshooting steps and recommendations to address commonplace database predicaments.

Key Modules

Our project is composed of three key modules, each catering to a specific aspect of database observability:

SQL Queries Library

The SQL Queries Library serves as a curated repository of valuable SQL commands. These commands are meticulously crafted or sourced from high-quality blog posts. By providing a well-organized collection of useful queries, we equip developers with a valuable resource to better understand their databases.

DB Observability Notebooks

The DB Observability Notebooks module takes the curated SQL queries and transforms them into actionable insights. These notebooks execute the queries against the monitored databases and present developers with meaningful information. This empowers developers to proactively monitor their databases' performance, track trends, and pinpoint areas that require attention.

Troubleshooting Flows

Arguably the most significant module, Troubleshooting Flows, offers predefined, step-by-step workflows designed to swiftly tackle specific problems. These flows are tailored to guide developers through a systematic approach to root cause analysis. They pose crucial questions to identify potential issues, interpret query results, and provide clear explanations. This module acts as a compass for developers navigating complex database issues.

Troubleshooting Flow - High CPU

...

Included Observability Notebooks

The DB Observability Notebooks module within the Database Observability Toolkit offers a collection of insightful notebooks that enable developers to delve into various aspects of database performance and health. These notebooks leverage the curated SQL queries and present valuable information in an accessible format. Here are some of the included notebooks:

• CPU Usage Analysis

• Memory Usage Insights

• Database Size Overview

• Tables Size and Bloat Analysis

• Indexes Activity Examination

• Buffer Cache Utilization Insights