欧洲杯投注软件

How histograms changed the game for monitoring time series with Prometheus

Published: 14 Apr 2020 RSS

Histograms are one of my favorite topics in the Prometheus universe. Last November, I delivered a talk at that was titled .

Only the part about the past had to be cut due to time constraints. But I made a promise to resurrect my talk about the history of histograms and I kept my word.

In February, I premiered the at .

Following the many examples of movie trilogies in popular culture, I positioned this talk as a prequel to my original PromCon EU presentation. The PromCon talk covers the important topic of what the Prometheus histograms can do well today and where there is still work to be done.

The prequel talk at FOSDEM describes how we got there and why. It’s an interesting archaeological dig into the Git log of the Prometheus open-source project, touching on not only how it started back in 2013 with its well-known counters and gauges. The presentation also covers how early versions of Prometheus offered summaries with precalculated quantiles to represent distributions.

欧洲杯投注软件But for precalculated quantiles, certain parameters have to be set during code instrumentation. They cannot be changed in hindsight. Even worse, precalculated quantiles cannot be aggregated later along the dimensions of your choice. Thus, summaries could not deliver on the first proverb from my : “Instrument first, ask questions later.”

欧洲杯投注软件The introduction of histograms in 2015 solved a lot of those problems, but not all of them. The remaining issues were left there “by design.” In other words, they are inherent to the way we designed histograms. (Those problems and possible future solutions to them are covered in the PromCon EU talk.)

The FOSDEM talk, however, highlights another set of problems – those that were created by historical design decisions somewhere else in the Prometheus universe that affected histograms in an indirect way. It’s reminiscent of a Shakespearean tragedy: These design decisions were so problematic for histograms, yet, on the other hand, they contributed substantially to the huge success and progress of Prometheus. Enter the seductively simple text format, the celebrated improvements of the Prometheus v2 release, and, last but not least, the standardization efforts of a Prometheus-like exposition format by the project.

I hope you enjoy watching the talk, even with its tragic undertones. But I won’t leave you without a silver lining: I’m actively working on better histograms for Prometheus, which is precisely the title of . Because of the current COVID-19 pandemic that is forcing many companies to restrict employees to work from home, the conference is currently postponed until August. But that only means I’ll be able to present even more results from my research. Stay tuned for Episode III of the histogram trilogy!

For more from Grafana Labs at FOSDEM 2020, check out our talks on how Tanka, Grafana Labs’ new jsonnet-based project, improves Kubernetes usage and learn how to configure Grafana as code.

Related Posts

Grafana Labs team members will be attending FOSDEM this weekend. Come join us!
Dave manages the team responsible for running pilot projects with customers, understanding the technical challenges encountered, and working out how the Grafana observability stack can help provide them with the solutions.
A customer asked for a dashboard with a simple search for labels already pre-set to help teams quickly find what they are looking for while troubleshooting. Here’s our solution.

Related Case Studies

DigitalOcean gains new insight with Grafana visualizations

欧洲杯投注软件The company relies on Grafana to be the consolidated data visualization and dashboard solution for sharing data.

"Grafana produces beautiful graphs we can send to our customers, works with our Chef deployment process, and is all hosted in-house."
– David Byrd, Product Manager, DigitalOcean

How Grafana Cloud is enabling HotSchedules to develop next-generation applications

The visibility for all these metrics helps service delivery teams quickly iterate on new features.

"Grafana Cloud enables us to achieve observability bliss at HotSchedules. We don’t have to worry about scaling and maintaining the service."
– Denise Stockman, Director, Infrastructure, Hotschedules

How Grafana Cloud is enabling Packet’s teams, from engineering to sales

欧洲杯投注软件Most people at Packet look at a Grafana dashboard at some point during their work day.

"Being able to, in a single dashboard, pull in data from a variety of different data sources provides the biggest value for us."
– Nathan Goulding, SVP, Engineering, Packet