Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-4512

FIWARE.Request.Tech.Data.BigData-Analysis.CygnusChannelFullError

    Details

    • Type: extRequest
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: 2021
    • Component/s: FIWARE-TECH-HELP
    • Labels:
      None

      Description

      Hello

      We are having troubles with Cygnus. When we have some devices sending
      information to Context Broker (and context broker subscripted to Cygnus,
      sending information to Cosmos and CKAN), the log show errors

      There are errors both ckan-channel and hdfs-channel

      Here a subset of log.

      02 Sep 2015 06:46:07,948 WARN [1701535537@qtp-1850408381-327]
      (org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost:203) -
      Error appending event to channel. Channel might be full. Consider
      increasing the channel capacity or make sure the sinks perform faster.
      org.apache.flume.ChannelException: Unable to put batch on required channel:
      org.apache.flume.channel.MemoryChannel

      {name: ckan-channel}

      at
      org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:200)
      at
      org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:201)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
      at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
      at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
      at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
      at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
      at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
      at org.mortbay.jetty.Server.handle(Server.java:326)
      at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
      at
      org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
      at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
      at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
      at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
      at
      org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
      at
      org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
      Caused by: org.apache.flume.ChannelException: Space for commit to queue
      couldn't be acquired Sinks are likely not keeping up with sources, or the
      buffer size is too tight
      at org.apache.flume.channel.MemoryChannel

      The complete log is available here:
      https://dl.dropboxusercontent.com/u/2537618/cygnus_a.log

      _______________________________________________
      Fiware-finodex-coaching mailing list
      Fiware-finodex-coaching@lists.fi-ware.org
      https://lists.fi-ware.org/listinfo/fiware-finodex-coaching

      [Created via e-mail received from: MAPT Talkykar <miguel@talkykar.com>]

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open In Progress In Progress
          22m 42s 1 Francisco Romero 30/Sep/15 3:22 PM
          In Progress In Progress Answered Answered
          1s 1 Francisco Romero 30/Sep/15 3:22 PM
          Answered Answered Closed Closed
          2s 1 Francisco Romero 30/Sep/15 3:22 PM

            People

            • Assignee:
              frb Francisco Romero
              Reporter:
              fw.ext.user FW External User
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: