How to get rid of stale datapoints in case of Gauge

[killerbot242]

A Gauge is using the "last value aggregation", when using the async version, when the callback is called, we can provide a measurement value together with attributes.

We use the attributes for different purposes:

• to just add an attribute carrying meta data (say a certain key:pair value we add to a "temperature metric", temperature as in instant temperature)
• to give the same metric for multiple instances of something, where those multiple instances are dynamic, they may come and go, the attribute is for example "Name":"Instance15".

What we noticed is the moment an attribute changes (or a attribute gets added), the old situation (with the old attribute value and old measurement, or without the new attributed) keeps being reported, so we end up with an ever increasing set of datapoints, where the old ones are to be considered obsolete and should just die.

In the dynamic case, we will always report all of the existing instances, the fact we no longer mention a given instance means it is gone, it has passed on, it died ;-)

How can this be achieved ?