Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-4251

FIWARE.Request.Tech.Data.BigData-Analysis.SharkError

    Details

    • Type: extRequest
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: 2021
    • Component/s: FIWARE-TECH-HELP
    • Labels:
      None

      Description

      To whom it may concern,
      from yesterday our applications have been getting the following error
      when trying to connect to Hive/Shark:

      > INFO: Getting Historical Load Data by Sector
      >
      > Sep 21, 2015 10:16:31 AM eu.finesce.emarketplace.client.HiveClient
      > getHiveConnection
      >
      > SEVERE: HIVE Connection Error
      >
      > java.sql.SQLException: Could not establish connection to
      > 130.206.80.46:9999/default?user=FINESCE-WP4&password=******************:
      > java.net.ConnectException: Connection refused
      >
      > at
      > org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:117)
      >
      > at
      > org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:106)
      >
      > at java.sql.DriverManager.getConnection(DriverManager.java:571)
      >
      > at java.sql.DriverManager.getConnection(DriverManager.java:233)

      Just to give you more details, when we try to launch hive from CLI, we
      get (although the CLI starts in the end):
      >
      > login as: FINESCE-WP4
      >
      > FINESCE-WP4@130.206.80.46's password:
      >
      > Last login: Mon Sep 21 10:15:40 2015 from 89-97-237-254.ip19.fastwebnet.it
      >
      > -bash-4.1$ hive
      >
      > log4j:ERROR Could not instantiate class
      > [org.apache.hadoop.hive.shims.HiveEventCounter].
      >
      > java.lang.RuntimeException: Could not load shims in class
      > org.apache.hadoop.log.metrics.EventCounter
      >
      > at
      > org.apache.hadoop.hive.shims.ShimLoader.createShim(ShimLoader.java:123)
      >
      > at
      > org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:115)
      >
      > at
      > org.apache.hadoop.hive.shims.ShimLoader.getEventCounter(ShimLoader.java:98)
      >
      > at
      > org.apache.hadoop.hive.shims.HiveEventCounter.<init>(HiveEventCounter.java:34)
      >
      > at
      > sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      >
      > at
      > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
      >
      > at
      > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
      >
      > at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
      >
      > at java.lang.Class.newInstance0(Class.java:357)
      >
      > at java.lang.Class.newInstance(Class.java:310)
      >
      > at
      > org.apache.log4j.helpers.OptionConverter.instantiateByClassName(OptionConverter.java:330)
      >
      > at
      > org.apache.log4j.helpers.OptionConverter.instantiateByKey(OptionConverter.java:121)
      >
      > at
      > org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:664)
      >
      > at
      > org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:647)
      >
      > at
      > org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:544)
      >
      > at
      > org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:440)
      >
      > at
      > org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:476)
      >
      > at
      > org.apache.log4j.PropertyConfigurator.configure(PropertyConfigurator.java:354)
      >
      > at
      > org.apache.hadoop.hive.common.LogUtils.initHiveLog4jDefault(LogUtils.java:127)
      >
      > at
      > org.apache.hadoop.hive.common.LogUtils.initHiveLog4jCommon(LogUtils.java:77)
      >
      > at
      > org.apache.hadoop.hive.common.LogUtils.initHiveLog4j(LogUtils.java:58)
      >
      > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:641)
      >
      > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
      >
      > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      >
      > at
      > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      >
      > at
      > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      >
      > at java.lang.reflect.Method.invoke(Method.java:597)
      >
      > at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
      >
      > Caused by: java.lang.ClassNotFoundException:
      > org.apache.hadoop.log.metrics.EventCounter
      >
      > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
      >
      > at java.security.AccessController.doPrivileged(Native Method)
      >
      > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
      >
      > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
      >
      > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
      >
      > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
      >
      > at java.lang.Class.forName0(Native Method)
      >
      > at java.lang.Class.forName(Class.java:171)
      >
      > at
      > org.apache.hadoop.hive.shims.ShimLoader.createShim(ShimLoader.java:120)
      >
      > ... 27 more
      >
      > log4j:ERROR Could not instantiate appender named "EventCounter".
      >
      > Logging initialized using configuration in
      > jar:file:/usr/local/apache-hive-0.13.0-bin/lib/hive-common-0.13.0.jar!/hive-log4j.properties

      Could someone from COSMOS team help us sorting the issue out, please?

      Regards,

      Massimiliano


      ===============================================================

      Massimiliano Nigrelli
      Direzione Ricerca e Innovazione - R&D Lab
      massimiliano.nigrelli@eng.it

      Engineering Ingegneria Informatica S.p.A.
      Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

      Phone: +39 091.75.11.847

      ============================================================

      _______________________________________________
      Fiware-lab-help mailing list
      Fiware-lab-help@lists.fiware.org
      https://lists.fiware.org/listinfo/fiware-lab-help-new
      [Created via e-mail received from: Massimiliano Nigrelli <massimiliano.nigrelli@eng.it>]

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open In Progress In Progress
        11m 50s 1 Francisco Romero 21/Sep/15 10:41 AM
        In Progress In Progress Answered Answered
        2m 9s 1 Francisco Romero 21/Sep/15 10:44 AM
        Answered Answered Closed Closed
        11m 39s 1 Francisco Romero 21/Sep/15 10:55 AM

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: