Overview of an SLI Analysis
Besides computing your actual SLO status with the configured metric and time window settings, SLI Analyzer provides you with additional statistical data. These numbers can help you better understand the performance of your service:
Besides the above-mentioned statistical data, you can also see percentiles. These include:
- For the Values field operators
- For the Values field operators
The reliability burn down chart is available and visible only for a successfully performed analysis.
Keep in mind the following assumptions:
These variables are defined below in terms of time series distributions. A time series distribution is a set of data defined by
time: valuepairs. The statistical analyses performed by the SLI Analyzer are being performed against the returned data as a distribution as a whole.
The values you see for these variables are not directly related to setting up a new SLO. Some are more useful for simply understanding the performance of an SLI, and you can use them to understand the historical performance of your SLI metrics (e.g., during an incident, etc.) or for setting up a new SLO.
SLI Charts Aggregations
There are different aggregations used for displaying the SLI time series chart.
Aggregations in the SLI Charts for the threshold metrics follow the below assumptions:
95thpercentile for operators
5thpercentile for operators
Aggregations in the SLI Charts for the ratio metrics follow the below assumptions:
- The last value for a given aggregation period for the incremental metrics
- The sum for non-incremental metrics
Definitions of the Statistcal Data in SLI Analyzer
Below you can find definitions for all statistical data shown in the SLI Analyzer:
Min: The lowest value in the distribution of the returned SLI values.
Mean: The average value of the distribution. An average is a value you get when you add up all values in a distribution and then divide that by the total number of data points in the distribution.
Max: The highest value in the distribution.
StdDev: The standard deviation of the distribution. A low value of
StdDevmeans that most values are close to the mean. A high value of
StdDevmeans that values vary much more.
Variance: The number from which a standard deviation is derived. A standard deviation is the square root of variance.
variancevalue tells you how dispersed the numbers in an entire distribution are, while a
StdDevgives you a value to set up steps away from the mean.
- Like a standard deviation, a low value means that there is less variability across the distribution, while a high value means there is more.
min): The delta between the largest and smallest values in the distribution.
Percentiles vs. Percentages
It is also essential to understand the difference between a percentile and a percentage.
A percentage is the number of something concerning the number 100. If you have 4 out of 5 of something, you have 80% of that something.
A percentile is used to compare individual data points in a distribution. If the value of the 90th percentile is 250, you know that 90% of all other data points in the distribution fall below 250.
SLI Values Distribution Charts
An SLI Values Distribution chart shows the frequency distribution of the data points by collecting them into “buckets” of values that fall within specific ranges. For example, you could say, “We have 5 data points between 0-10, 12 data points between 10-20, and 3 data points between 20-30,” etc.
Nobl9 displays an SLI Values Distribution chart in the SLI Analyzer as it is much simpler to think about all of the values in a time series distribution at once than it is to try to see how a time series rises and falls over time.
For example, the following is a an SLI Values Distribution chart for a threshold metric:
The following shows an example of an SLI Values Distribution chart for a ratio metric:
Linear and Logarithmic Scales
You can select a linear or logarithmic scale for the Y-axis in the SLI Values Distribution chart. Logarithmic scale is useful when its buckets contain a wide range of values:
Linear scale displaying a wide range of values of an SLI metric:
Logarithmic scale offering a more useful insight into a wide range of values of the same metric:
According to a convention assumed in SLI Analyzer, the ranges of the buckets in the SLI Values Distribution chart are shifted. Effectively, the first bucket begins before the minimum value in the distribution of the analyzed time series:
What Reliability Target Should I Choose