Logging and monitoring with Elastic stack on Ubuntu 16.04

From ICO wiki
Revision as of 22:23, 19 June 2017 by Mdhasan (talk | contribs)
Jump to navigationJump to search

Introduction

Elasticsearch is an open source search engine based on Lucene, developed in java. It provides a distributed and multitenant full-text search engine with an HTTP Dashboard web-interface (Kibana) and JSON documents scheme. Elasticsearch is a scalable search engine that can be used to search for all types of documents, including log file. Elasticsearch is the heart of the 'Elastic Stack' or ELK Stack.

Logstash is an open source tool for managing system events and logs. It provides real-time pipelining to collect data. Logstash will collect the log or data, convert all data into JSON documents, and store them in Elasticsearch.


Kibana is a data visualization interface for Elasticsearch. Kibana provides a pretty dashboard (web interfaces), it allows you to manage and visualize all data from Elasticsearch on your own. It's not just beautiful, but also powerful.

In this HOW TO, I will show you how to install and configure Elastic Stack on a single Ubuntu 16.04 server for monitoring server logs and how to install 'Elastic beats' on client PCs with Ubuntu 16.04 and CentOS 7 operating system.

Prerequisite

Ubuntu 16.04 64 bit server with 4GB of RAM, hostname - elk-master Ubuntu 16.04 64 bit client with 1 GB of RAM, hostname - elk-client1 CentOS 7 64 bit client with 1GB of RAM, hostname - elk-client2