Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-4512

FIWARE.Request.Tech.Data.BigData-Analysis.CygnusChannelFullError

    Details

    • Type: extRequest
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: 2021
    • Component/s: FIWARE-TECH-HELP
    • Labels:
      None

      Description

      Hello

      We are having troubles with Cygnus. When we have some devices sending
      information to Context Broker (and context broker subscripted to Cygnus,
      sending information to Cosmos and CKAN), the log show errors

      There are errors both ckan-channel and hdfs-channel

      Here a subset of log.

      02 Sep 2015 06:46:07,948 WARN [1701535537@qtp-1850408381-327]
      (org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost:203) -
      Error appending event to channel. Channel might be full. Consider
      increasing the channel capacity or make sure the sinks perform faster.
      org.apache.flume.ChannelException: Unable to put batch on required channel:
      org.apache.flume.channel.MemoryChannel

      {name: ckan-channel}

      at
      org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:200)
      at
      org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:201)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
      at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
      at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
      at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
      at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
      at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
      at org.mortbay.jetty.Server.handle(Server.java:326)
      at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
      at
      org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
      at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
      at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
      at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
      at
      org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
      at
      org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
      Caused by: org.apache.flume.ChannelException: Space for commit to queue
      couldn't be acquired Sinks are likely not keeping up with sources, or the
      buffer size is too tight
      at org.apache.flume.channel.MemoryChannel

      The complete log is available here:
      https://dl.dropboxusercontent.com/u/2537618/cygnus_a.log

      _______________________________________________
      Fiware-finodex-coaching mailing list
      Fiware-finodex-coaching@lists.fi-ware.org
      https://lists.fi-ware.org/listinfo/fiware-finodex-coaching

      [Created via e-mail received from: MAPT Talkykar <miguel@talkykar.com>]

        Issue Links

          Activity

          Hide
          frb Francisco Romero added a comment -
          Show
          frb Francisco Romero added a comment - Answered in https://jira.fiware.org/browse/HELC-986

            People

            • Assignee:
              frb Francisco Romero
              Reporter:
              fw.ext.user FW External User
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: