Historical Reports in Nobl9
Historical Reports in Nobl9 allow you to get data-driven insights into your Service Level Objectives. With Nobl9 Reports, you can resolve critical questions for your business: for instance, whether to focus on the development of new features or on managing your technical debt.
You can create custom reports besides displaying the ready-made Resource Usage Summary report.
The old version of Historical Reports, along with all deep links, is still available. To switch to the old version, go to Reports and click Go to old Reports:
Types of Reports
The following types of Reports are available in Nobl9:
The Resource Usage Summary report is ready-made and is always available in the Reports tab.
This report type allows you to check the performance of your SLOs. It is helpful for in-depth analyses of events and can be used by teams working in different time zones who want to see the same data in reports.
SLO History reports can be configured with two types of reporting time ranges:
- Rolling presents data according to the selected time window that dynamically moves as time progresses. For example, if you set the rolling time range to
1 month, you will see data for the past 30 days up to the current time of the report opening.
- Calendar-aligned range is tied to a specific window of time on the calendar with a clear start and stop date
Error Budget Status
This report type gives you the percentage of errors in the selected time frame. It provides you with a quick and easy way to verify the statuses of SLOs.
Resource Usage Summary
This report shows the number of resources configured in Nobl9 and their peak usage.
The Reporting Time Range for the Resource Usage Summary is always the current month.
This report allows Nobl9 users to gain a bird's-eye view of their Services' aggregated reliability over an extended period of time. Check Reliability Roll-up Reports documentation for more details.
While Reliability Roll-up Reports can seem similar to Composite SLOs, they are two different tools to access the resource's performance.
- Reliability Roll-up Report: Error budget
- Composite SLO: Burn rate
- Calculates the time percentage when the SLO was within its error budget. Calculations are based on the SLO's error budget per reporting time. Every value obtained is averaged per a score level recursively up to the overall reliability score.
- ☺ Flexible hierarchy. It means you can boil down many systems to a single number instead of sticking to the Nobl9 data model
- ☺ Measures reliability as needed: by user journey, organization, team, application, etc.
- ☺ Updated with labels
- ☺ Easy to share
- ☹ Currently, reliability scores are updated daily at 00:00 UTC
- ☹ You must set alerts at the level of individual SLOs when necessary
- ☹ Focuses on SLO Target adherence, not specific error budget numbers
- Future Capabilities
- ⚙ Weigh for folders (score layers)
- ⚙ Reliability score charts over time
- ⚙ Label-driven dynamic updates
- Compares the burn rates for existing SLO objectives and marks the minutes
- ☺ Permanently available burn rate
- ☺ Continuous composite error budget calculations providing a graphical representation
- ☹ Burn rates are evaluated in real time. It limits the number of signals included in a single composite
- ☹ Computationally intensive
badin the composite SLO when burn rates exceed your set threshold.
You must have at least one service in Nobl9 to create a new custom report. If you don't have any services, the button will be inactive, and building a new report won’t be possible:
If you've already created Services but there are no SLOs attached to them, Nobl9 will display the following screen:
Once you have services and SLOs, you can create your custom report. For this, click the report creation button. The Report Wizard opens:
Overview of Creation Steps
The Report Wizard contains 2 or 3 steps, depending on your chosen report type. Step 3 Select Time Range is not shown for the Error Budget Report. For this report type, Nobl9 always displays the current time ranges of selected SLOs. That's why you can't change it.
Here is an overview of all the steps required to create Reports:
Step 1: Name Report and Choose its Type
Type in the name of your report in the Report Name field.
This will be the display name that you and other users in your organization will later see in Nobl9. The name can:
- Have a maximum of 63 characters.
- Contain special characters, including emojis that may make the name of your report more visually appealing and improve the report's discoverability for other users.
The type of report you choose at Step 1 determines if Step 3 is then presented in the Report Wizard. You can select time range for SLO History or Reliability Roll-up reports only.
Step 2: Define Report Scope
To define the scope of the report, fill out at least one of the following fields:
If there are more than 500 SLOs in your organization, you can experience downgraded performance, creating a report. Our team is currently working on fixing this issue.
Filtering by Report Fields
Search for the Projects, Services, and Service Level Objectives you need to include in your report. You can type their names or select them in the list.
Projects, Services, and Service Level Objectives are interconnected: choosing options in one field narrows down the results available in other fields. The dependency is Project > Service > SLO.
- Select a specific project, so the Services field displays services that a part of the project you've selected.
- Select a specific service, so the Service Level Objectives field displays SLOs that are part of the service you've selected.
- Leave the Projects and Services fields blank, so you have access to all available SLOs in the Service Level Objectives field.
- Select several projects or services, so the available options in their dependant fields are part of all the projects or services you selected.
The Labels field is optional but also filters the data displayed in a report.
You can’t define the report scope with a label only. Primarily, you must fill out at least one project, service, or SLO, and use labels as the additional option.
You can choose from all the labels that you have in Nobl9. To filter out a specific resource, you don't have to use a label attached directly to that resource.
A project in Nobl9 contains two SLOs. The project has no labels; SLO 1 has
label-1, and SLO 2 has
label-2. To build a report with data related to SLO 1, select either this project +
label-1 or all projects and
Data in Reports Over Time
Note that the data displayed in a report may change.
If you create a report with no Services and SLOs, the Report will show no data. However, if a Service with SLOs is added to that Project later, the service with your SLOs will appear in your Report.
And vice-versa: if you build a report with services and SLOs and then remove SLOs from the service, the report will show no data.
Step 3: Select Time Window
There are two types of Time Ranges available:
Rolling Time Range
If you choose the Rolling Time Range, the selected time range (for example, Last 1 week, last 2 weeks, last 1 quarter, etc.) is dynamically calculated starting from when you open or refresh the report.
Calendar-Aligned Time Range
The Calendar-Aligned Time Range reflects the calendar periods, such as the Last Calendar Month (from June 1 to June 30) or the Last Week (from Sunday through Saturday).
You can choose a specific time zone used in your report. Although the users who access the report might be in different time zones, the data they will see in the report will be the same.
Sharing Reports and Inviting Users
Report owners can share their reports with other users. For this, click .
After you’ve shared the report, you can copy a link to it:
An Organization Admin can see all the shared reports within the organization.
If the Report owner loses access to the Report's resources, they will still be able to view this Report on the Reports list.
In such a situation, the Report's details will indicate that the user has limited access to its data. The report creator can still share or delete the Report but won't be able to make any edits.
Downloading Reports Raw Data
You can download a CSV file with the report data in Error Budget Status reports. Click to download the CSV file with the data.
Accessing Reports List
When you click on the Reports icon in the main sidebar, you’ll be redirected to the reports list containing all Reports you’ve created and the ones shared with you.
The report list also lets you remove or share a selected report directly.
Report Details View
Click the required report in the Reports list. The report preview opens:
The preview contains various details related to the opened report:
The report preview fields explained: