Questions tagged [kibana]

Kibana is an application for exploring and visualizing your data. It helps you find and demonstrate trends in your data with tools for searching, creating visualizations, and combining those visualizations to build dashboards.

0
votes
0answers
8 views

How do you track user actions in Kibana?

I have three questions. I want to track user actions in Kibana. However, the session ID is changed for each request. (I use Kibana6.7.0) First, The session id seems to be encrypted, is that correct? ...
0
votes
1answer
16 views

How to change format of field from epoh to date

I have a field in data file which is in epoch format.I want to change data in that field into date format. Is there any easy way? https://drive.google.com/open?id=1JRZj8myVu1UHJ3jxZzzb8LSKKMicY0Qi
-1
votes
0answers
11 views

How to integreate local sql database with kibana

I have these type of errors: OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. [2019-06-18T12:54:00,282][WARN ][...
1
vote
1answer
18 views

Logstash use in kibana

Can logstash be used to upload data from the file into kibana? https://drive.google.com/open?id=1JRZj8myVu1UHJ3jxZzzb8LSKKMicY0Qi I have this kind of data.
0
votes
0answers
14 views

shingle in nested object

In Elasticsearch 6.3, I'm trying to apply bigram query in the nested object field which generates bigram data by combining all values in the nested field. Below is the mappings. PUT /testindex ...
0
votes
0answers
16 views

Get a list of all duplicate documents in Elastic Search index

Imagine I have documents like this: { "customerId" : "some-id", ... } How can I retrieve a list of all documents that have a non-unique value in the customerId field? So, for this collection: {...
-1
votes
1answer
16 views

upload the data into elastic search-kibana through file

I have data files. one of them is this https://drive.google.com/open?id=1JRZj8myVu1UHJ3jxZzzb8LSKKMicY0Qi. I want to upload them into elastic search through kibana what is the best way to do it?
0
votes
0answers
18 views

Upload multiple files in kibana in same index

I have json files.I want to upload them into kibana. They have option for uploading a file. Which creates a new index every time.I want to upload file data into existing index how can I do that? ...
0
votes
0answers
12 views

How to extract httpRequest.headers in AWS Elasticsearch with Kinesis/WAF/Elasticsearch setup?

I wish to extract values to obtain specific httpRequest.headers in AWS WAF in Elasticsearch but I have "Object in arrays are not well supported" Pls help?
0
votes
1answer
15 views

ElasticSearch/Kibana: The correct syntax to exclude a value?

I'm racking my brain trying to work out why this search doesn't work properly. I want to find all documents where instance=ko14274 but exclude any that are maxlevel=UNKNOWN. I have tried the following:...
0
votes
0answers
10 views

Displaying more information on a point at a Kibana line graph

Every night a .json with data is being sent to Kibana. The data is requested by a line graph visualisations. The line graphs have Y axes "Date" and X axes "Data entry". The data Entry is specific ...
1
vote
1answer
23 views

How to set kibana index pattern from filebeat?

I am using elk stack with a node application. I am sending logs from host to logstash with filebeat, logsstash formats and send data to elastic and kibana reads from elastic. In kibana i see default ...
0
votes
1answer
40 views

How do I do an Anti Match Pattern on Keyword Field Elasticsearch Query 6.4.2

The problem: Our log data has 27-34 million entries for a /event-heartbeat. I need to filter those entries out to see just viable log messages in Kibana. Using Kibana filters with wildcards does ...
0
votes
0answers
21 views

ElastAlert New Term with Frequency

So I'm wanting to set up an alert that looks at javascript error messages. I want the alert to kick off if the error message is thrown 20 times, and within a 7 day time period. I've tried this ...
0
votes
0answers
15 views

How to write query in kibana?

I have a app.People all over the world are using it. It sends me the certain type of package (see the json format below) when it is connected to the internet at the interval of 15 minutes. Now I want ...
1
vote
1answer
17 views

Is there a way to find out if load on Elastic stack is growing?

I have just started learning Elastic stack and I already have to diagnose production issue. Our setup from time to time has problems with pulling messages from ActiveMq to Elastic Search using ...
0
votes
1answer
34 views

I have a data file.I want to insert that data in to elastic search- kibana. Is there any automated way I can do this?

I have a data file.I want to insert that data in to elastic search- kibana. Is there any automated way I can do this? link - deliver-events-to-s3-7-2019-06-04-03-49-01-5df38ba9-86c0-4860-b51f-...
0
votes
1answer
16 views

In ElasticSearch how to check if a field exists that it equals some value, or that the field doesn't exist?

I want to find all documents in elasticsearch, where my "updated" field exists and is less that some value or where the field doesn't exist in the document at all. I can see that using a bool query, ...
0
votes
1answer
17 views

Recursive queries in Elasticsearch/Kibana

I have hierarchical Elasticsearch data, which I "normalized" into documents of the following mapping: _id | custom_id | parent_id | text | value Where _id is the autogenerated Elasticsearch id, ...
0
votes
0answers
19 views

kibana - how to search unique urls

In kibana, I have below type of log entries in the "message" field. I want to search for all the unique/distinct URLs from the log. My URL format is like web.cluster.test.com/api/* 123.456.78.90 - ...
0
votes
1answer
12 views

change date format from epoch to date in kibana-7.1.1

I am working on kibana-7.1.1. I want it to be interactive. I have one field of timestamp where field type is in epoch format. But I want to filter data in date format. I feel that I will have to ...
0
votes
0answers
11 views

How do I upload a json file to the elastic cloud?

This is unbelievably frustrating. Elasticsearch looks like they go to great lengths to make starting easy for new users but I can't find an easy way that works to upload json to an ES cluster I am ...
0
votes
0answers
4 views

How to ignore highlighted fields in a kibana query?

I'm trying to make a query in kibana that shows all the errors in a service, but the results only shows the data with the field "highlight", how can I ignore it? I've tried making a DSL query like ...
0
votes
0answers
13 views

Pie chart in Kibana - how can I see the numbers inside the pie?

How can I see the numbers in the pie chart in Kibana instead of seeing it by the mouse tooltip? Should it be JSON? This is what I found... { "trackedData": { "properties": { "...
0
votes
0answers
23 views

How to integrate JMeter with kafka to stream realtime test results into kafk to be consumed by elasticsearch

I am trying to build realtime dashboard in kibana for monitoring jmeter non-gui tests. Due to the scale of the enterprise and security policy any data flows to elastic search should be streamed via ...
0
votes
0answers
6 views

Kibana - How to fetch nested json element

I've JSON structure like below, which I'm storing in Kibana. { "alphaid": 300896, "product": "ConsolidatedProject", "projectList": [ "Project1", "Project2" ], "projectQualityDetails"...
0
votes
0answers
20 views

"mapper [geo.coordinates] of different type, current_type [geo_point], merged_type [ObjectMapper]

Trying to load sample data from Kibana using the tutorial : https://www.elastic.co/guide/en/kibana/current/tutorial-load-dataset.html but facing en error of "error" : { "type" : "...
0
votes
0answers
14 views

Kibana Filter Logs for when Message /event-heartbeat doesn't exist not working with wildcard

I'm trying to filter log messages in kibana for when the message field doesn't contain /event-heartbeat I used the built in features with wild cars for filtering when fields "is not one of" but it ...
0
votes
0answers
3 views

Kibana: Cannot find module 'puid'

I just got this error while trying to start kibana server and i have no clue what that's about. Any help would be much appreciated. Jun 11 14:50:45 mike kibana[29374]: {"type":"log","@timestamp":"...
0
votes
0answers
24 views

Unable to access Kibana after successful authentication with IBM Cloud AppID

I have a k8s deployment of Kibana in IBM Cloud. It is exposed through ClusterIP k8s service, a k8s Ingress and it is accessible for a single Cloud Directory user authenticated through IBM Cloud App ID....
0
votes
0answers
17 views

Multi-term must match doesn't work in elasticSearch

I'm using elasticSearch to query on multiple terms. My query is structured thus: GET db/_search? { "size":10, "query": { "bool": { "must": [ {"term": {"field_1": "A"}}, {"term": {"...
0
votes
0answers
9 views

Elasticsearch DSL query to filter duplicate documents (based on a filter) from Kibana logs

I'm working on a system which delivers emails, SMSs etc. I'm publishing the application logs to Kibana via an ELK pipeline. The logs look something like this: { "@timestamp": "2019-06-11T13:52:...
0
votes
1answer
25 views

Kibana fails to connect to Elasticsearch on docker

I am following https://www.elastic.co/guide/en/elasticsearch/reference/6.5/docker.html and https://www.elastic.co/guide/en/kibana/6.5/docker.html But it does not seems to work well with kibana, ES ...
0
votes
0answers
8 views

How to index and form a country pie chart in Elastic Search and Kibana in Vb.net?

Currently the basic setup in my VB.net application is done which is Dim node = New Uri("http://localhost:9200") Dim settings = New ConnectionSettings(node) ' settings.ThrowExceptions(...
1
vote
0answers
13 views

Filtering visualization in Kibana by latest date

I’m working with ELK version 6.2.3. I was able to create several visualizations for my data, but I would like for some of them to have a “complex” filter. My index contains an id field and a date ...
0
votes
0answers
17 views

Kibana and Elasticsearch fails when trying to include time in data

I'm really stuggling. My elasticsearch data and mapping is in this format: Data { "test" : [ { "data" : "119050300", "date" : "10:00 2019-06-03" } ] } Mapping { "mappings": { "...
1
vote
1answer
26 views

Elasticsearch range query not working as expected

I am trying to fetch data by applying range on date type field("timeA" in this case). My query is: { "query": { "bool": { "must": [ { "match_phrase": { "...
0
votes
0answers
11 views

Plot cumulative delta using ELK

We have 2 sample log lines as below: [LOGSTASH]time=May 28,2019 07:41:20;logging-level=INFO;request-id=xxxxxxx;task-type=xxxxxxxxx; [LOGSTASH]time=May 28,2019 07:41:20;logging-level=INFO;response-...
0
votes
1answer
23 views

How can I monitor both metrics and log messages on same dashboard?

Right now I use Grafana and Choreograf with influxes. But I also want to show the logs of my application. I tried Loki, but it only works on explore and can't be used on a dashboard. Do you know if ...
0
votes
1answer
16 views

How to make query both to parent and child index?

I got parent index users and child purchase. Purchase has field purchase_count it is number of purchase made by user, for example first purchase of some user will be with purchase_count = 1, second ...
0
votes
0answers
14 views

How do I import log4j logs from an application onto Kibana via Filebeat and Logstash?

Trying to import logs from an application to Kibana so that I can filter through them. I've tried importing logs onto Filebeat and send those to Logstash, and then to Elasticsearch to finally have ...
0
votes
0answers
8 views

How to sum strings in a kibana visualisation?

I am using Kibana version 6.3.2 via logzIo. And I want to create a visualisation in which I need to sum values from a string field. This field just has numbers but they are Strings. Is there a way ...
2
votes
1answer
38 views

How to structure data in elasticsearch for hourly visitors

I'm struggling with how to structure my data in elasticsearch. I have one number per hour. So it will be something like this: 2018-01-01T03:00:00 - 280 That is to say, 280 visitors for 3am. I'm ...
0
votes
0answers
27 views

Get JSON substring from log message

I have log messages like this message:2019-06-07 15:49:10.110 INFO 5632 --- [http-nio-9026-exec-1] *****************.jdbc.audit.AuditHandler : AUDITHANDLER:{"USER":"0c27e6ef- b615-4328-...
1
vote
0answers
50 views

Percentage for each bucket

Im trying to get the percentage for each bucket in elasticsearch 7.1 with this query: { "size":0, "aggs":{ "group_by_status":{ "terms":{ "field":"status....
0
votes
0answers
14 views

Elasticsearch field type says conflict and reindexing

I have created following template with ipv type as "text"and inserted data. After some days of processing, I have changed ipv to type "ip". Deleted old index and created new index(same name as old one)...
1
vote
1answer
31 views

Migration of kibana dashboards

I exported all the visualizations and dashboards from dev and imported into prod. Even I have created all the index patterns and all the required indices into prod equivalent to dev, still, my ...
0
votes
0answers
12 views

Extended Stats Bucket not returning sum of bucket - Using Top Hits Aggregation

I am struggling to use a "Top Hits" aggregation and "extended_stats_bucket". From the buckets returned my "extended_stats_bucket" path cannot read the metric value count_status. Is this is a draw ...
7
votes
5answers
145 views

Kibana fails to pick up date from elasticsearch when I include the hour and minute

I'm really stuggling to get this specific time format into elasticsearch so I can graph it in Kibana. I cannot change this format. My elasticsearch data and mapping is in this format: STEP 1: Setup ...
0
votes
0answers
51 views

Kibana - Request Timeout after 30000ms at /usr/share/kibana/node_modules/elasticsearch/src/lib/transport.js:355:15

Fresh installment of Kibana (On redhat 7.6 (64bit) via yum) starts, but is restarting every minute. Before it restarted every 5 seconds, but i fixed it after changing /etc/fstab to allow noexec on /...