Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-5978

FIWARE.Request.Tech.Data.BigData-Analysis.Cygnus - Ckan integration error

        Details

        • Type: extRequest
        • Status: Closed
        • Priority: Major
        • Resolution: Done
        • Fix Version/s: 2021
        • Component/s: FIWARE-TECH-HELP
        • Labels:
          None
        • HD-Chapter:
          Data
        • HD-Enabler:
          Cosmos

          Description

          Good morning Dear,

          We have a problem with Cygnus-Ckan integration, whenever Cygnus sends data request to Ckan, it gets this error:

          25 Feb 2016 07:44:40,217 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.sinks.OrionSink.processOneByOne:267) - Runtime error (Don't know how to treat response code 503))

          We talked with Sergio Garcia Gomez and thanks to him, he's created us an organization <https://data.lab.fiware.org/organization/fiwaredemos> and gave the admin rights to our users in Ckan.

          Please find our Cygnus conf files content below:

          Could you please help us with this error?
          we need to publish this data in Ckan but we are stucked at the last step of this integration with this error above..

          Thanks kr
          Omer Ozdemir

          agent:

          [root@idas conf]# more agent_test.conf
          cygnusagent.sources = http-source
          cygnusagent.sinks = ckan-sink
          cygnusagent.channels = ckan-channel

          cygnusagent.sources.http-source.channels = ckan-channel
          cygnusagent.sources.http-source.type = org.apache.flume.source.http.HTTPSource
          cygnusagent.sources.http-source.port = 5050
          cygnusagent.sources.http-source.handler = com.telefonica.iot.cygnus.handlers.OrionRestHandler
          cygnusagent.sources.http-source.handler.notification_target = /notify
          cygnusagent.sources.http-source.handler.default_service = def_serv
          cygnusagent.sources.http-source.handler.default_service_path = def_servpath
          cygnusagent.sources.http-source.handler.events_ttl = 2
          cygnusagent.sources.http-source.interceptors = ts gi
          cygnusagent.sources.http-source.interceptors.ts.type = timestamp
          cygnusagent.sources.http-source.interceptors.gi.type = com.telefonica.iot.cygnus.interceptors.GroupingInterceptor$Builder
          cygnusagent.sources.http-source.interceptors.gi.gropuing_rules_conf_file = /Applications/apache-flume-1.4.0-bin/conf/grouping_rules.
          conf

          cygnusagent.channels.ckan-channel.type = memory
          cygnusagent.channels.ckan-channel.capacity = 1000
          cygnusagent.channels.ckan-channel.transactionCapacity = 100

          cygnusagent.sinks.ckan-sink.channel = ckan-channel
          cygnusagent.sinks.ckan-sink.type = com.telefonica.iot.cygnus.sinks.OrionCKANSink
          cygnusagent.sinks.ckan-sink.enable_grouping = false
          cygnusagent.sinks.ckan-sink.api_key = MY API KEY GOES HERE
          cygnusagent.sinks.ckan-sink.ckan_host = https://data.lab.fiware.org
          cygnusagent.sinks.ckan-sink.ckan_port = 80
          cygnusagent.sinks.ckan-sink.orion_url = localhost:1026
          cygnusagent.sinks.ckan-sink.attr_persistence = row
          cygnusagent.sinks.ckan-sink.ssl = false
          cygnusagent.sinks.ckan-sink.batch_size = 1
          cygnusagent.sinks.ckan-sink.batch_timeout = 10

          instance:

          [root@idas conf]# more cygnus_instance_1.conf
          CYGNUS_USER=cygnus
          CONFIG_FOLDER=/usr/cygnus/conf
          CONFIG_FILE=/usr/cygnus/conf/agent_test.conf
          AGENT_NAME=cygnusagent
          LOGFILE_NAME=cygnus.log
          ADMIN_PORT=8085
          POLLING_INTERVAL=30

          Bu mesaj ve ekleri gönderilen kişiye özeldir ve gizli bilgiler içerebilir. Eğer mesajın gönderilmek istendiği kişi değilseniz lütfen kopyalamayınız, başkalarına göndermeyiniz ve göndericiyi bilgilendiriniz. Internet üzerinden gönderilen mesajların güvenli ve hatasız olduğunun garantisi olmadığından Atos grubu mesajın içeriğinden sorumlu tutulamaz. Göndericinin bilgisayarı anti-virüs sistemleri tarafından taranmaktadır, ancak yine de mesajın virüs içermediği garanti edilemez ve gönderici, meydana gelebilecek zararlardan sorumlu tutulamaz.

          This e-mail and the documents attached are confidential and intended solely for the addressee; it may also be privileged. If you receive this e-mail in error, please notify the sender immediately and destroy it. As its integrity cannot be secured on the Internet, the Atos group liability cannot be triggered for the message content. Although the sender endeavors to maintain a computer virus-free network, the sender does not warrant that this transmission is virus-free and will not be liable for any damages resulting from any virus transmitted.

          Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
          Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
          _______________________________________________
          Fiware-tech-help mailing list
          Fiware-tech-help@lists.fiware.org
          https://lists.fiware.org/listinfo/fiware-tech-help

            Activity

            Ascending order - Click to sort in descending order
            23 older comments
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            A correction to the command to be run:

            $ /usr/cygnus/bin/cygnus-flume-ng agent —conf /usr/cygnus/conf -f
            /usr/cygnus/conf/<your_agent_conf_file> -n cygnusagent
            -Dflume.root.logger=INFO,console

            El 26/2/16 10:24, "FW External User (JIRA)" <jira-help-desk@fi-ware.org>

            ________________________________

            Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

            The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

            Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição

            Show
            fw.ext.user FW External User added a comment - A correction to the command to be run: $ /usr/cygnus/bin/cygnus-flume-ng agent —conf /usr/cygnus/conf -f /usr/cygnus/conf/<your_agent_conf_file> -n cygnusagent -Dflume.root.logger=INFO,console El 26/2/16 10:24, "FW External User (JIRA)" <jira-help-desk@fi-ware.org> ________________________________ Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción. The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it. Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
            Hide
            Permalink
            oozdemir Ozdemir, Omer added a comment -

            Hello Francisco,

            We just finished testing all the flows and it seems Cygnus is working well, thanks a lot again for your help

            So would you suggest me to use Cygnus this way till the new release?

            Show
            oozdemir Ozdemir, Omer added a comment - Hello Francisco, We just finished testing all the flows and it seems Cygnus is working well, thanks a lot again for your help So would you suggest me to use Cygnus this way till the new release?
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            Yeah! Nice to hear that.

            Yes, until we fix everything and produce a new rlease (0.13.0).

            Cygnus works the same as a process, the only differenc is you don’t have
            services like start, stop, restart, and everything must e done by
            yourself (looking for the PID, killing the process, restartin the
            command, etc). But the functionality is the same (that’s the importan
            stuff).

            Anything you may need, please contact me

            Regards,
            Francisco

            ________________________________

            Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

            The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

            Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
            Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
            Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
            _______________________________________________
            Fiware-tech-help mailing list
            Fiware-tech-help@lists.fiware.org
            https://lists.fiware.org/listinfo/fiware-tech-help

            Show
            fw.ext.user FW External User added a comment - Yeah! Nice to hear that. Yes, until we fix everything and produce a new rlease (0.13.0). Cygnus works the same as a process, the only differenc is you don’t have services like start, stop, restart, and everything must e done by yourself (looking for the PID, killing the process, restartin the command, etc). But the functionality is the same (that’s the importan stuff). Anything you may need, please contact me Regards, Francisco ________________________________ Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción. The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it. Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost. Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one. _______________________________________________ Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help
            Hide
            Permalink
            oozdemir Ozdemir, Omer added a comment -

            Thanks a lot Francisco, much appreciated )

            Have a nice weekend..

            PS:I guess we can close the ticket now

            Show
            oozdemir Ozdemir, Omer added a comment - Thanks a lot Francisco, much appreciated ) Have a nice weekend.. PS:I guess we can close the ticket now
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            FYI, this is the bug description:
            https://github.com/telefonicaid/fiware-cygnus/issues/826

            Have a nice weekend as well!

            Regards,
            Francisco

            ________________________________

            Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

            The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

            Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
            Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
            Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
            _______________________________________________
            Fiware-tech-help mailing list
            Fiware-tech-help@lists.fiware.org
            https://lists.fiware.org/listinfo/fiware-tech-help

            Show
            fw.ext.user FW External User added a comment - FYI, this is the bug description: https://github.com/telefonicaid/fiware-cygnus/issues/826 Have a nice weekend as well! Regards, Francisco ________________________________ Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción. The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it. Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost. Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one. _______________________________________________ Fiware-tech-help mailing list Fiware-tech-help@lists.fiware.org https://lists.fiware.org/listinfo/fiware-tech-help

              People

              • Assignee:
                frb Francisco Romero
                Reporter:
                oozdemir Ozdemir, Omer
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: