Missing data when using unique count and creating an aggregation in Kibana

jaspernygaard

I have a behavior in Kibana, I can't explain. The following is a simple bar chart, counting unique users, filtered by application and a role, and ensuring certain fields exist on the logs:

enter image description here

This graph shows that I have approx. 170 users which have the role 'Landmand'. If I split the bar by the term 'fields.Role', I would expect a identical chart, since I already applied a filter specifying 'fields.Role:Landmand' in the search. However I see this.

Bar chat split by term

This suddenly limits the unique count to approx. 150 users. I've tried with different fields and it seems to have the same behavior - as soon as I split the bar, I seem to limit the data somehow.

Any information is greatly appreciated.

Pigueiras

It happens because it uses the cardinality aggregation to do the unique count. As it is explained in the link, the count is approximate and it has a % of error. Just do a quick test, try to copy the request and try with a different precision threshold to see the difference.

To set a custom precision_threshold you can use the advanced section and put a custom JSON Input to the aggregation:

Adding a precision threshold to the aggregation

If you go to the Request section, you can actually see that the threshold has been added to the cardinality aggregation.

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

Creating a count table of unique values when there are multiple values in a single cell using R

how to return the count of unique documents by using elasticsearch aggregation

Kibana 5.5 visualization data aggregation percentage

Getting count of total documents when using aggregation along with skip and limit

Why unique count in kibana visualize chart is incorrect?

ElasticSearch/Kibana - Get count of unique session Ids

Kibana - Average Count per Unique Field

kibana unique count seeing names with - as different entery

How to count total number of records inside data using $group aggregation

CosmosDB: Count unique values with DISTINCT Subquery Expected Result in Data Explorer but not when using Rest API

missing values when creating training and testing data with caret

How to handle missing JSON data when creating objects? (Typescript)

Panel Data - dealing with missing year when creating lead and lag variables

How to count cases by group with n() when there are missing data

Data/Contents are missing when using Python Selenium

Missing query data when using Sum

Count if the data is not unique

including missing (zero-count) rows when using GROUP BY

C# missing value when using count++

Issue with AccumulatorOperators Max when creating aggregation pipeline

Using a Missing aggregation for a Term, as opposed to a field

Unexpected behaviour when using Google Sheets Macros to create Charts with Count Aggregation

How to get list of data containing count of a field using Aggregation and Criteria in Spring Boot with MangoDB

Returning count w/ data in MongoDB Aggregation

Creating a unique list using Pandas

Using "$count" Within an "addField" Operation in MongoDB Aggregation

How to count specific documents in a row using aggregation?

Group into group and count using aggregation framework in MongoDB

How to construct Aggregation (Count) of records using NEST?

TOP Ranking

HotTag

Archive