Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-5966

FIWARE.Request.Tech.Data.BigData-Analysis.Cygnus-Kafka sink

    Details

    • Type: extRequest
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: 2021
    • Component/s: FIWARE-TECH-HELP
    • Labels:
      None

      Description

      Hello,

      I am trying to connect Cygnus to Kafka

      I am connected to the zookeeper but no values have been persisted in Kafka and I got this exception:

      time=2016-02-24T11:48:24.197UTC | lvl=WARN | trans= | srv= | subsrv= | function=poll | comp=Cygnus | msg=org.apache.kafka.common.network.Selector[276] : Error in I/O with host myKafkaHostName/ myKafkaHostIP

      java.io.EOFException

      at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)

      at org.apache.kafka.common.network.Selector.poll(Selector.java:248)

      at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)

      at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)

      at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)

      at java.lang.Thread.run(Thread.java:745)

      Any idea what is the cause?

      Thanks & Best regards,

      Sabrine FATNASSI

      Test and Validation Engineer

      Easy Global Market : http://www.eglobalmark.com/ <http://www.eglobalmark.com/>

      Email : sabrine.fatnassi@eglobalmark.com <sabrine.fatnassi@eglobalmark.com>

      Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
      Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
      _______________________________________________
      Fiware-tech-help mailing list
      Fiware-tech-help@lists.fiware.org
      https://lists.fiware.org/listinfo/fiware-tech-help
      [Created via e-mail received from: "Sabrine Fatnassi (EGM)" <sabrine.fatnassi@eglobalmark.com>]

        Activity

        Hide
        fw.ext.user FW External User added a comment -

        Hello,

        I am trying to connect Cygnus to Kafka

        I am connected to the zookeeper but no values have been persisted in Kafka and I got this exception:

        time=2016-02-24T11:48:24.197UTC | lvl=WARN | trans= | srv= | subsrv= | function=poll | comp=Cygnus | msg=org.apache.kafka.common.network.Selector[276] : Error in I/O with host myKafkaHostName/ myKafkaHostIP

        java.io.EOFException

        at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)

        at org.apache.kafka.common.network.Selector.poll(Selector.java:248)

        at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)

        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)

        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)

        at java.lang.Thread.run(Thread.java:745)

        Any idea what is the cause?

        Thanks & Best regards,

        Sabrine FATNASSI

        Test and Validation Engineer

        Easy Global Market : http://www.eglobalmark.com/

        Email : sabrine.fatnassi@eglobalmark.com <sabrine.fatnassi@eglobalmark.com>

        Show
        fw.ext.user FW External User added a comment - Hello, I am trying to connect Cygnus to Kafka I am connected to the zookeeper but no values have been persisted in Kafka and I got this exception: time=2016-02-24T11:48:24.197UTC | lvl=WARN | trans= | srv= | subsrv= | function=poll | comp=Cygnus | msg=org.apache.kafka.common.network.Selector [276] : Error in I/O with host myKafkaHostName/ myKafkaHostIP java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62) at org.apache.kafka.common.network.Selector.poll(Selector.java:248) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122) at java.lang.Thread.run(Thread.java:745) Any idea what is the cause? Thanks & Best regards, Sabrine FATNASSI Test and Validation Engineer Easy Global Market : http://www.eglobalmark.com/ Email : sabrine.fatnassi@eglobalmark.com < sabrine.fatnassi@eglobalmark.com >
        Hide
        fw.ext.user FW External User added a comment -

        Hi again Sabrine,

        I will need the complete log trace and the configuration you are using.

        Regards,
        Francisco

        El 24/2/16 14:06, "Manuel Escriche (JIRA)" <jira-help-desk@fi-ware.org>

        ________________________________

        Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

        The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

        Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
        Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
        Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
        _______________________________________________
        Fiware-tech-help mailing list
        Fiware-tech-help@lists.fiware.org
        https://lists.fiware.org/listinfo/fiware-tech-help

        Show
        fw.ext.user FW External User added a comment - Hi again Sabrine, I will need the complete log trace and the configuration you are using. Regards, Francisco El 24/2/16 14:06, "Manuel Escriche (JIRA)" <jira-help-desk@fi-ware.org> ________________________________ Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción. The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it. Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost. Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one. _______________________________________________ Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help
        Hide
        frb Francisco Romero added a comment -

        Hi,

        I¹m afraid I cannot do nothing. It seems an open problem about Kafka:

        https://issues.apache.org/jira/browse/KAFKA-2078

        I¹ve seen 160 notifications where successfully persisted before that. Is
        that true? I mean, were you able to see the data before raising the
        warning?

        Regards,
        Francisco

        El 24/2/16 17:12, "Sabrine Fatnassi (EGM)"
        <sabrine.fatnassi@eglobalmark.com> escribió:

        Hi,

        Please find log file and kafka agent configuration in the attached files.

        For your information, I tested with another kafka instance and the result
        is the following:
        Even after the warning appearance, the kafka instance is able of
        receiving new data.
        But still I am interested in knowing the warning cause.
        Thanks!

        Best regards,
        Sabrine FATNASSI
        Test and Validation Engineer

        Easy Global Market : http://www.eglobalmark.com/
        Email : sabrine.fatnassi@eglobalmark.com

        Show
        frb Francisco Romero added a comment - Hi, I¹m afraid I cannot do nothing. It seems an open problem about Kafka: https://issues.apache.org/jira/browse/KAFKA-2078 I¹ve seen 160 notifications where successfully persisted before that. Is that true? I mean, were you able to see the data before raising the warning? Regards, Francisco El 24/2/16 17:12, "Sabrine Fatnassi (EGM)" <sabrine.fatnassi@eglobalmark.com> escribió: Hi, Please find log file and kafka agent configuration in the attached files. For your information, I tested with another kafka instance and the result is the following: Even after the warning appearance, the kafka instance is able of receiving new data. But still I am interested in knowing the warning cause. Thanks! Best regards, Sabrine FATNASSI Test and Validation Engineer Easy Global Market : http://www.eglobalmark.com/ Email : sabrine.fatnassi@eglobalmark.com

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: