elasticsearch Questions

Apache Log grok pattern

February 10, 2021
Radu
2 Answers

Can anybody please help with the grok pattern for below example of logs? 85.85.85.85 webmail.company.com "CN=First Last/O=Company/C=CZ" [14/Dec/2020:05:58:18 +0100] "GET /mail/User.nsf/iNotes/Proxy/?OpenDocument&Form=s_ReadViewEntries&PresetFields=DBQuotaInfo;1,FolderName;($Inbox),UnreadCountInfo;1,SearchSort;DateD,s_UsingHttps;1,noPI;1&TZType=UTC&Start=1&Count=23&resortdescending=6 HTTP/1.1" 200 2054 "https://webmail.company.com/mail/User.nsf/iNotes/Proxy/?OpenDocument&Form=l_ScriptFrame&l=en&gz&CR&MX&TSF=20170318T181650,92Z&TSX=20180206T185427,18Z&EFF=%2FiNotes%2FForms9_x&charset=UTF-8&charset=UTF-8&KIC&ua=safari&pt" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36" 125 INOTES_LOGIN_ID=First%20Last; Shimmer=SI_TLM:20210209T072811%2C40Z&ST_Counter:3&LAO:mail&SAB:1&CS_TLM:20210209T072831%2C15Z&V_TLM:20210210T080147%2C82Z&DMS:5&ui:X&MOTLM:20210129T113159%2C00Z&DBQS:1503571%2C%207168000%2C%206963200%2C%200%2C%201503571&SPRKL:1&KOSCZ:GTB&FISD:1;…

VIEW QUESTION

How change global elasticsearch index creation setting? – Debian

November 20, 2020
user3202300
2 Answers

OS: #1 SMP Debian 4.19.152-1 (2020-10-18) Install elastic by this tutorial https://www.elastic.co/guide/en/elasticsearch/reference/current/deb.html: { "name" : "web", "cluster_name" : "elasticsearch", "cluster_uuid" : "HSeOQvkHRey2P_JN2Nv-GA", "version" : { "number" : "7.10.0", "build_flavor" : "default", "build_type" : "deb", "build_hash" : "51e9d6f22758d0374a0f3f5c6e8f3a7997850f96", "build_date" : "2020-11-09T21:30:33.964949Z",…

VIEW QUESTION

Magento 2.4 Could not validate a connection to Elasticsearch. No alive nodes found in your cluster

November 4, 2020
Eric Brown
2 Answers

I am trying to upgrade my Magento 2.3 store to 2.4. In trying to do so, when I try to run bin/magento setup:upgrade I receive the following error: Could not validate a connection to Elasticsearch. No alive nodes found in…

VIEW QUESTION

Elasticsearch Docker: flood stage disk watermark [95%] exceeded – Debian

September 14, 2020
Stimmot
4 Answers

I have a problem with my Elasticsearch nodes running in a docker environment. I'm starting them up with docker-compose and after a few minutes they tell me: flood stage disk watermark [95%] exceeded I'm running it on a cluster with…

VIEW QUESTION

Magento 2.4 reindex issue with elasticsearch

September 1, 2020
Emily
2 Answers

I have installed an elastic search(7.x) with Magento2.4 and I am using PHP 7.3 When I run the reindex command(bin/magento indexer:reindex) getting the following error. Catalog Search index process unknown error: {"error":{"root_cause":[{"type":"cluster_block_exception","reason":"index [magento2_product_1_v1] blocked by: [TOO_MANY_REQUESTS/12/disk usage exceeded flood-stage watermark,…

VIEW QUESTION

Install of elastic 7.5 on RHEL 7.8 makes memory violation sig=6 due to JNA – CentOS

I am installing a brand new elasticsearch 7.5 on OS:Red Hat Enterprise Linux Server release 7.8 (Maipo) At startup of the service, I have hard failure. here is what the service info provides ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service;…

VIEW QUESTION

How to improve search speed of a query in Elastic Search? – CentOS

August 16, 2020
Web developer
2 Answers

The host is AWS from ElasticSearch, I have 2TB of data stored in 6 nodes and in 30 indexes with 10 shards each. A simple search in all indexes is very very slow and takes a few minutes. Where I…

VIEW QUESTION

Ebay API – ElasticSearch aggregate documents by field into array

July 30, 2020
JeyJ
2 Answers

I'm trying to write the following logic as a query in java to elasticsearch : ES contains following documents : {"request" : 1, "store":"ebay", "status" : "retrieved" , "lastdate": "2012/12/20 17:00", "retrieved_by" : "John"} {"request" : 1, "store":"ebay", "status" :…

VIEW QUESTION

How do I route in Fluentd by field content – Debian

July 22, 2020
Andrew Pickin
2 Answers

I wish to process (call a parser on) the contents of a log event via fluend. These come different formats (json, apache2, nginx and bespoke regexp), sometime I may wish to skip any processing. Events come from the same source…

VIEW QUESTION

Send logs with filebeat to logstash – CentOS

July 17, 2020
HeadTea
2 Answers

I'm trying to make filebeat send log to logstash on another machine and I just can't get it to work. This is the filebeat.yml configuration: https://pastebin.com/8a2RtGBa (Using pastebin because of character limit) This is the configuration on the machine that…

VIEW QUESTION