Skip to main content

Logstash throws error while installing plugins

While trying to install logstash plugin, I was getting below error:
$ /work/logstash/logstash-5.5.2/bin/logstash-plugin install logstash-input-cloudwatch
WARNING: A maven settings file already exist at ~/.m2/settings.xml, please review the content to make sure it include your proxies configuration.
Validating logstash-input-cloudwatch
Installing logstash-input-cloudwatch
Error Bundler::InstallError, retrying 1/10
An error occurred while installing logstash-core (5.5.2), and Bundler cannot continue.
Make sure that `gem install logstash-core -v '5.5.2'` succeeds before bundling.
Error Bundler::InstallError, retrying 2/10
An error occurred while installing logstash-core (5.5.2), and Bundler cannot continue.
Make sure that `gem install logstash-core -v '5.5.2'` succeeds before bundling.
Here are the things I did to make it work:
  1. Created maven ~/.m2/settings.xml file
    <?xml version="1.0" encoding="UTF-8"?>
    <settings xmlns="http://maven.apache.org/SETTINGS/1.0.0"
              xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
              xsi:schemaLocation="http://maven.apache.org/SETTINGS/1.0.0 http://maven.apache.org/xsd/settings-1.0.0.xsd">
      <proxies>
        <proxy>
          <id>proxy.server.0</id>
          <active>true</active>
          <protocol>http</protocol>
          <host>proxy.server</host>
          <port>80</port>
        </proxy>
      </proxies>
    </settings>
    
  2. Set environment variables:
    export JAVA_HOME="/work/elasticsearch/jre1.8.0_162/"
    export PATH=$JAVA_HOME/bin:$PATH
    export http_proxy=http://proxy.server:80
    export https_proxy=http://proxy.server:80
    export NO_PROXY="127.0*,[::1],localhost,.local"
    export no_proxy=$NO_PROXY
    
  3. Installed the plugin:
    /usr/bin/sudo -u root -H /bin/env https_proxy=http://proxy.server:80 HTTPS_PROXY=http://proxy.server:80 JRUBY_OPTS="-J-Dhttp.proxyHost=proxy.server -J-Dhttp.proxyPort=80" DEBUG=1 /work/logstash/logstash-5.5.2/bin/logstash-plugin install logstash-input-cloudwatch
    

Comments

Popular posts from this blog

MPlayer subtitle font problem in Windows

While playing a video with subtitles in mplayer, I was getting the following problem:
New_Face failed. Maybe the font path is wrong. Please supply the text font file (~/.mplayer/subfont.ttf).
Solution is as follows:
Right click on "My Computer".Select "Properties".Go to "Advanced" tab.Click on "Environment Variables".Delete "HOME" variable from User / System variables.

Procedure for name and date of birth change (Pune)

For change of name, the form (scribd) is available free of cost at Government Book Depot (Shaskiya Granthagar), which is located near Collector’s office, next to Saint Helena's School. The postal address is:
Government Photozinco Press Premises and Book Depot,
5, Photozinco Press Road, Pune, MH, 411001.
Wikimapia link

Charges for name or date of birth change, in the Maharashtra Government Gazette:
INR 120.00 per insertion (for two copies of the Gazette)
For backward class applicants: INR 60.00
Charges for extra copy of the Gazette: INR 15.00 per copy (two copies are enough, so you may not want to pay extra for extra copies).

Backward class applicants are required to submit a xerox of caste certificate of old name as issued by the Collector of the District concerned.

Once the form is duly submitted, it normally takes 10 to 15 days for publication of advertisement in the Maharashtra Government Gazette. The Gazette copy reaches to the address filled in the form within next 7 to 15 day…

Setting up ELK 5.x (ElasticSearch, Logstash, Kibana) cluster

We recently upgraded from ElasticSearch 2.4.3 to 5.6.2.
Below are the steps that we used to install and configure new ELK cluster.

ElasticSearchInstallationmkdir -p /work/elk/data/data-es562 mkdir -p /work/elk/data/logs-es562 mkdir -p /work/elk/data/repo-es562 cd /work/elk/ curl -O https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.6.2.tar.gz tar -zxvf elasticsearch-5.6.2.tar.gz curl -O https://artifacts.elastic.co/downloads/packs/x-pack/x-pack-5.6.2.zip cd /work/elk/elasticsearch-5.6.2 ./bin/elasticsearch-plugin install file:///work/elk/x-pack-5.6.2.zip
Configuration
Settings for Master + Ingest node in elasticsearch.ymlWe have reused master nodes as ingest nodes, because we don't have any heavy ingest pipelines, and x-pack monitoring requires at-least one ingest node to be present in the cluster.
cluster.name: ESDev562 node.name: "master_01" node.master: true # Enable the node.master role (enabled by default). node.data: false # D…