How to Setup ELK Stack in Ubuntu with Filebeat to collect logs from servers

  Рет қаралды 12,059

Linux Tutions

Linux Tutions

Жыл бұрын

#awsfordevelopers #aws #hinditutorial #urdotutorial #elkstack #observerbility
#devops #technoronix #filebeat #monitoring #serveradministration
#devops #support #linux_tutorial #linuxsystemadministration #linuxtutions
Setup Elasticsearch :
1 apt-get update
2 sudo apt-get install openjdk-8-jdk
3 wget -qO - artifacts.elastic.co/GPG-KEY-... | sudo apt-key add -
4 sudo apt-get install apt-transport-https
5 echo "deb artifacts.elastic.co/packages... stable main" | sudo tee -a /etc/apt/sources.list.d/elastic-7.x.list
6 sudo apt-get update
7 sudo apt-get install elasticsearch
8 sudo nano /etc/elasticsearch/elasticsearch.yml
network.host: 10.0.44.189
http.port: 9200
9 systemctl start elasticsearch.service
10 curl 10.0.44.189:9200
Setup Kibana
1 apt-get update
2 sudo apt-get install openjdk-8-jdk
3 wget -qO - artifacts.elastic.co/GPG-KEY-... | sudo apt-key add -
4 sudo apt-get install apt-transport-https
5 echo "deb artifacts.elastic.co/packages... stable main" | sudo tee -a /etc/apt/sources.list.d/elastic-7.x.list
6 sudo apt-get update
7 sudo apt-get install kibana
8 sudo nano /etc/kibana/kibana.yml
server.port: 5601
server.host: "10.0.43.154"
elasticsearch.hosts: ["10.0.44.189:9200"]
9 systemctl start kibana
10 systemctl status kibana
11 tail -f /var/log/kibana/kibana.log
Setup Logstash
logstash pipeline samples : www.elastic.co/guide/en/logst...
12 sudo apt-get install logstash
13 cd /etc/logstash/conf.d/
14 vim apache.conf
logstash pipeline for apache using filebeat
15 curl -L -O artifacts.elastic.co/download...
16 dpkg -i filebeat-7.17.6-amd64.deb
17 sudo filebeat modules enable system
18 systemctl start logstash.service
Client Setup (Apache Web server)
1 curl -L -O artifacts.elastic.co/download...
2 dpkg -i filebeat-7.17.6-amd64.deb
3 vim /etc/filebeat/filebeat.yml
paths:
- /var/log/apache2/*.log
output.logstash:
The Logstash hosts
hosts: ["10.0.43.154:5044"]
4 sudo filebeat setup --index-management -E output.logstash.enabled=false -E 'output.elasticsearch.hosts=["10.0.44.189:9200"]'
5 sudo filebeat modules enable system
6 sudo filebeat modules enable apache
7 systemctl restart filebeat.service
8 filebeat test output

Пікірлер: 27
@muhaphotograpy
@muhaphotograpy Жыл бұрын
you are GOD gifted person with speaking capabilities i love the way you explain very complex things in details p
@professorosborn1486
@professorosborn1486 Жыл бұрын
i really like the way you described in the video please keep post more videos also let us know how we can connect to you
@furqanhassan7199
@furqanhassan7199 Жыл бұрын
fantastic video much needed
@soloflight9297
@soloflight9297 Жыл бұрын
Great teacher
@Wiji920
@Wiji920 Жыл бұрын
Thank you bro you are sloving my projects 🙏
@linuxtutions
@linuxtutions 7 ай бұрын
Good to know that i am able to help someone
@professorosborn1486
@professorosborn1486 Жыл бұрын
mighty good
@surajshetty8429
@surajshetty8429 Жыл бұрын
Thanks Bro
@allanhawkin2073
@allanhawkin2073 Жыл бұрын
Ca we use grafana instead of kibana as it give more cool UI and dashboards
@rahulpardeshi4427
@rahulpardeshi4427 Жыл бұрын
very well explain. let us know how we can connect to you???
@recon0x7f16
@recon0x7f16 11 ай бұрын
Have u tried SOF-elk sans I imported it but didn’t c the gui installed centos gui but didn’t show any of the tools any ideas how to fix ?
@demotest-vr4uh
@demotest-vr4uh 8 ай бұрын
will i be able to get logs from microservices present in EKS from the above configuration?
@e1Pr0f3ss0r
@e1Pr0f3ss0r Жыл бұрын
How to check if this is running or not? I tried service arcsight-syslogd restart But it is not working
@marktim3915
@marktim3915 Жыл бұрын
Hey mansur is there any way i can connect with you to learn more about observability tools ?
@nirmalunagar
@nirmalunagar Жыл бұрын
Can we directly send data to Elasticsearch from filebeat instead of logstash?
@linuxtutions
@linuxtutions Жыл бұрын
Yes we can instead of logstash output you can enable elasticsearch
@randalgomez4522
@randalgomez4522 Жыл бұрын
🌸 p♥r♥o♥m♥o♥s♥m
@karantandon6755
@karantandon6755 9 ай бұрын
Can you specify versions
@linuxtutions
@linuxtutions 7 ай бұрын
it was 7.x as i remember
@jeevan9057
@jeevan9057 Жыл бұрын
I have followed all the steps mentioned in the video but I don't see the logs on kibana. what is the reason
@linuxtutions
@linuxtutions Жыл бұрын
You must need to check logstash connection with elasticsearch is logstash connected to elasticsearch
@jeevan9057
@jeevan9057 Жыл бұрын
@@linuxtutions How do i check if it is connected or not
@maheshvlogs8427
@maheshvlogs8427 11 ай бұрын
HI Bro, its show the Kibana Ui, but I didn't get the logs on Kibana, What is reason bro ?
@linuxtutions
@linuxtutions 11 ай бұрын
Check your pipeline or beat status
@maheshvlogs8427
@maheshvlogs8427 11 ай бұрын
@@linuxtutions filebeat status Running
@karantandon6755
@karantandon6755 9 ай бұрын
Is it elastic search or elastic search hadoop?
@linuxtutions
@linuxtutions 9 ай бұрын
Elasticsearch
Setting Up the ELK Stack in 2023: Step-by-Step Tutorial
36:36
The Devops Diary
Рет қаралды 5 М.
Kubernetes monitoring with ELK stack | Demo
40:30
Deekshith SN
Рет қаралды 32 М.
Задержи дыхание дольше всех!
00:42
Аришнев
Рет қаралды 3,6 МЛН
Nastya and SeanDoesMagic
00:16
Nastya
Рет қаралды 34 МЛН
Sigma Kid Hair #funny #sigma #comedy
00:33
CRAZY GREAPA
Рет қаралды 37 МЛН
Iron Chin ✅ Isaih made this look too easy
00:13
Power Slap
Рет қаралды 36 МЛН
Stand Alone Elastic Agent 8.x - No Fleet Server
22:51
Evermight Systems
Рет қаралды 7 М.
Filebeat + Elk Stack Tutorial With Kubernetes
19:57
Michael Guay
Рет қаралды 41 М.
Everything you Always Wanted to Know about Filebeat * But Were Afraid to Ask
1:07:10
Official Elastic Community
Рет қаралды 38 М.
Self Host Tailscale with Headscale - How To Setup
21:51
Jim's Garage
Рет қаралды 61 М.
ELK using Docker Compose | Elasticsearch Logstash Kibana Tutorial
17:24
Filebeat, a simple example with nginx logs - #ELK 04
11:42
XavkiEn
Рет қаралды 14 М.
Filebeat with Elasticsearch 8.x - Part 1: Install and Secure
43:07
Evermight Systems
Рет қаралды 9 М.
Look, this is the 97th generation of the phone?
0:13
Edcers
Рет қаралды 7 МЛН
S24 Ultra and IPhone 14 Pro Max telephoto shooting comparison #shorts
0:15
Photographer Army
Рет қаралды 10 МЛН
Kumanda İle Bilgisayarı Yönetmek #shorts
0:29
Osman Kabadayı
Рет қаралды 2,2 МЛН