Elasticsearch Lab#3 – DSL Query Collection Part#1
Reference Sample Data & Query – https://github.com/devopsschool-demo-labs-projects/elasticsearch Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I have worked at Cotocus. I share tech blog…
What is seq_no and primary_term in elasticsearch?
the _seq_no and _primary_term as parameter needed to implement the optimistic locking. Elasticsearch keeps tracks of the sequence number and primary term of the last operation to…
Elasticsearch Lab#2 – Bulk indexing document using mget & bulk api
Sample Data Reference Sample Data & Query – https://github.com/devopsschool-demo-labs-projects/elasticsearch Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I have worked at Cotocus. I share…
Elasticsearch Lab#1 – CRUD
Reference Sample Data & Query – https://github.com/devopsschool-demo-labs-projects/elasticsearch Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I have worked at Cotocus. I share tech blog…
Example of Elastic Logstash pipeline input, filter and output
Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I have worked at Cotocus. I share tech blog at DevOps School, travel stories at Holiday…
Elasticsearch Cluster Setup and Configuration Tutorial step by step using AWS ec2
Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I have worked at Cotocus. I share tech blog at DevOps School, travel stories at Holiday…
Elasticsearch QUERY Parameters Examples with Explanation
Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I have worked at Cotocus. I share tech blog at DevOps School, travel stories at Holiday…
Elasticsearch-ELK Errors and Solutions Database
Elastic Search Error – Node is started with node.data=false, but has shard data Elastic Search Error – max virtual memory areas vm.max_map_count [65530] is too low, increase…
ElasticSearch Error – filebeat – filebeat.yml – did not find expected key
Errors Solutions Check filebeat.yml: Only one file beat output is supported …check #output.elasticsearch is comments Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I…
ElasticSearch Error – filebeat – filebeat.yml – more than one namespace configured accessing ‘output’
Errors Answer Check output.logstash in filebeat.yml: should be uncommented. Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I have worked at Cotocus. I share…
ElasticSearch Error – this can cause resize pauses and prevents mlockall from locking the entire heap
Error Message Solutions Setting the parameter -Xms to the same value of -Xmx in /etc/elasticsearch/jvm.options solved the problem 🙂 Thanks Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about…
Elasticsearch Command Lines and their Usage Guide
elasticsearch elasticsearch-certgen elasticsearch-certutil elasticsearch-cli elasticsearch-croneval elasticsearch-env elasticsearch-env-from-file elasticsearch-keystore elasticsearch-migrate elasticsearch-node elasticsearch-plugin elasticsearch-saml-metadata elasticsearch-setup-passwords elasticsearch-shard elasticsearch-sql-cli elasticsearch-sql-cli-7.6.0.jar elasticsearch-syskeygen elasticsearch-users x-pack-env x-pack-security-env x-pack-watcher-env Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate…
How to enable Elastic Search REST API Accessible using IP Address?
By default http transport and internal elasticsearch transport only listens to localhost. If you want to access Elasticsearch from the host other than localhost then try adding…
Kibana 7.2 Install and configuration in RHEL 7/Centos
Install and Setup JDK 8+ Download and Install Kibana 7.X Configure Kibana 7.X How to start kibana service? Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge…
How to use elastic search EC2 discovery plugin?
Problem To increase the performance in Elasticsearch, many times we add new nodes to Elasticsearch cluster and manually change the configuration file with new IP address, etc….
Elastic Search Error – Node is started with node.data=false, but has shard data
[2019-07-11T09:59:18,013][ERROR][o.e.b.Bootstrap ] [es-master01] Exception java.lang.IllegalStateException: Node is started with node.data=false, but has shard data: [/home/ec2-user/elasticsearch-7.2.0/data/nodes/0/indices/6XsNftnbSbOnzPK3wOKc 0w/0]. Use ‘elasticsearch-node repurpose’ tool to clean up at org.elasticsearch.env.NodeEnvironment.ensureNoShardData(NodeEnvironment.java:1065) ~[elasticsearch-7.2.0.jar:7.2.0] at…
Elastic Search Error – max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
Errors [2]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144] Solution To make it persistent, you can add this line: $…
Elastic Search Error – max file descriptors [4096] for elasticsearch process is too low, increase to at least [65535]
Elastic Search Error – max file descriptors [4096] for elasticsearch process is too low, increase to at least [65535] Solution Temporary to the current login session To…
How to create sample data to perform searches using elastic search?
Step 1 – Go to: http://www.json-generator.com/ Step 2 – Download and save as customers_full.json Step 3 – Open customers_full.json in sublimetext Remove the array brackets Find-Replace },{…
What is difference between application/x-ndjson and application/json?
Lets understand what is json? JSON stands for JavaScript Object Notation JSON is a lightweight format for storing and transporting data JSON is often used when data…
Elastic Search Error – The bulk request must be terminated by a newline
FIX – Add a New line in customers_full.json Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert passionate about sharing knowledge and experiences. I have worked at Cotocus. I share tech…
ElasticSearch Error – illegal_argument_exception – Rejecting mapping update to type
########### COMMAND ################# ########### OUTPUT ########### Solution Multiple mapping types are not supported in indices created in 6.0 The ability to have multiple mapping types per index…
ElasticSearch Error – Content-Type header [application/x-www-form-urlencoded] is not supported
To fix this, add curl option -H ‘Content-Type: application/json’. This error is due to strict content-type checking introduced in ElasticSearch 6.0 Solution Rajesh KumarI’m a DevOps/SRE/DevSecOps/Cloud Expert…
Understanding the Update API in Elasticsearch
The update API allows to update(also allows to delete, or ignore the operation). a document based on a script provided. The operation gets the document from the…
Understanding Elasticsearch Index Mapping & Schema
A schema is a description of one or more fields that describes the document type and how to handle the different fields of a document. The schema…
Find out elastic Search health using _cat/health
To check elasticsearch cluster health by using (CURL) and Cluster API “cat” provieded by elasticsearch The cat API print the info in JSON format, compact and aligned…
Understanding Elasticsearch Keywords and Terminology
Understanding Elasticsearch Keywords and Terminology Elasticsearch Terminology Description Cluster “A cluster is a collection of one or more nodes (servers) that together holds your entire data and…
Crash Course of Elasticsearch in 10 mins
What is Elasticsearch? Elasticsearch is fast, horizontally scalable open source search engine. It provides HTTP API for storing and indexing JSON documents and with default configuration it…
Elasticsearch Web References & Cheatsheet
Elasticsearch official documentation https://www.elastic.co/guide/en/elasticsearch/reference/6.x/index.html Very good Elasticsearch Guide on Github https://github.com/dzharii/awesome-elasticsearch Elasticsearch Official forum https://discuss.elastic.co/ Stackoverflow elasticsearch handlers http://stackoverflow.com/questions/tagged/elasticsearch Jolicode elasticsearch Cheatsheet http://elasticsearch-cheatsheet.jolicode.com/ Elasticsearch DevOpsSchool reference https://www.devopsschool.com/blog/category/elastic-stack/…
Web GUI tools for Elasticsearch cluster
elasticsearch-head is a web front end for browsing and interacting with an Elastic Search cluster. There are multiple ways of running elasticsearch-head. Running as a plugin of…