Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-4512

FIWARE.Request.Tech.Data.BigData-Analysis.CygnusChannelFullError

    Details

    • Type: extRequest
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: 2021
    • Component/s: FIWARE-TECH-HELP
    • Labels:
      None

      Description

      Hello

      We are having troubles with Cygnus. When we have some devices sending
      information to Context Broker (and context broker subscripted to Cygnus,
      sending information to Cosmos and CKAN), the log show errors

      There are errors both ckan-channel and hdfs-channel

      Here a subset of log.

      02 Sep 2015 06:46:07,948 WARN [1701535537@qtp-1850408381-327]
      (org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost:203) -
      Error appending event to channel. Channel might be full. Consider
      increasing the channel capacity or make sure the sinks perform faster.
      org.apache.flume.ChannelException: Unable to put batch on required channel:
      org.apache.flume.channel.MemoryChannel

      {name: ckan-channel}

      at
      org.apache.flume.channel.ChannelProcessor.processEventBatch(ChannelProcessor.java:200)
      at
      org.apache.flume.source.http.HTTPSource$FlumeHTTPServlet.doPost(HTTPSource.java:201)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:814)
      at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
      at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
      at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
      at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
      at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
      at org.mortbay.jetty.Server.handle(Server.java:326)
      at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
      at
      org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
      at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
      at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
      at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
      at
      org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
      at
      org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
      Caused by: org.apache.flume.ChannelException: Space for commit to queue
      couldn't be acquired Sinks are likely not keeping up with sources, or the
      buffer size is too tight
      at org.apache.flume.channel.MemoryChannel

      The complete log is available here:
      https://dl.dropboxusercontent.com/u/2537618/cygnus_a.log

      _______________________________________________
      Fiware-finodex-coaching mailing list
      Fiware-finodex-coaching@lists.fi-ware.org
      https://lists.fi-ware.org/listinfo/fiware-finodex-coaching

      [Created via e-mail received from: MAPT Talkykar <miguel@talkykar.com>]

        Issue Links

          Activity

          backlogmanager Backlog Manager created issue -
          backlogmanager Backlog Manager made changes -
          Field Original Value New Value
          Link This issue relates to HELC-986 [ HELC-986 ]
          pasquale.vitale Pasquale Vitale made changes -
          Assignee Francisco Romero [ frb ]
          Hide
          frb Francisco Romero added a comment -
          Show
          frb Francisco Romero added a comment - Answered in https://jira.fiware.org/browse/HELC-986
          frb Francisco Romero made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          frb Francisco Romero made changes -
          Status In Progress [ 3 ] Answered [ 10104 ]
          frb Francisco Romero made changes -
          Resolution Done [ 10000 ]
          Status Answered [ 10104 ] Closed [ 6 ]
          mev Manuel Escriche made changes -
          Summary FIWARE.Request.Lab.FIWARE.Request.Lab.Data.BigData-Analysis.CygnusChannelFullError FIWARE.Request.Lab.Data.BigData-Analysis.CygnusChannelFullError
          mev Manuel Escriche made changes -
          Summary FIWARE.Request.Lab.Data.BigData-Analysis.CygnusChannelFullError FIWARE.Request.Tech.Data.BigData-Analysis.CygnusChannelFullError
          mev Manuel Escriche made changes -
          Sender Email miguel@talkykar.com
          mev Manuel Escriche made changes -
          HD-Enabler Cosmos [ 10872 ]
          HD-Chapter Data [ 10838 ]
          fla Fernando Lopez made changes -
          Fix Version/s 2021 [ 12600 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open In Progress In Progress
          22m 42s 1 Francisco Romero 30/Sep/15 3:22 PM
          In Progress In Progress Answered Answered
          1s 1 Francisco Romero 30/Sep/15 3:22 PM
          Answered Answered Closed Closed
          2s 1 Francisco Romero 30/Sep/15 3:22 PM

            People

            • Assignee:
              frb Francisco Romero
              Reporter:
              fw.ext.user FW External User
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: