Hi Ozdemir,

Instead of:

cygnusagent.sinks.ckan-sink.ckan_host = https://data.lab.fiware.org

cygnusagent.sinks.ckan-sink.ckan_port = 80

cygnusagent.sinks.ckan-sink.ssl = false

Please configure:

cygnusagent.sinks.ckan-sink.ckan_host = data.lab.fiware.org

cygnusagent.sinks.ckan-sink.ckan_port = 443

cygnusagent.sinks.ckan-sink.ssl = true

Let me know if it works.

Regards,
Francisco

El 25/2/16 9:32, "Ozdemir, Omer Faruk (JIRAo)"

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Hello Francisco,

Now I get this error:

25 Feb 2016 08:49:48,723 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.sinks.OrionSink.processOneByOne:267) - Runtime error (Don't know how to treat the response code. Possibly the organization already exists in a deleted state (respCode=403, orgName=ariot))

Thanks kind regards
Omer

Hi Ozdemir,

Could you please run Cygnus in DEBUG mode and do the run again?

Anyway, such a message appears when CKAN tells Cygnus the organization
could not be created. Most of the times it is because the organization
existed in the past and it was deleted (could you confirm this?). Deletion
in CKAN is quite special... Deleted elements continue existing in CKAN but
with a “deletion” flag avoiding to crate new elements with the same name.
Nevertheless, the problems may be other: wrong API key, user not allowed
to create organizations, etc.

Regards,
Francisco

El 25/2/16 9:53, "Ozdemir, Omer Faruk (JIRA)" <jira-help-desk@fi-ware.org>

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Hello Francisco,

Im running in DEBUG mode and here is the message:

{"message": "Access denied: User OTHER_API_KEY_FROM_DEMO_CKAN_WEBSITE not authorized to create organizations", "__type": "Authorization Error"}}

OTHER_API_KEY_FROM_DEMO_CKAN_WEBSITE = I was testing with another API key from http://demo.ckan.org/ but I switched back to the original API_KEY from(data.lab.fiware.org) couple of days ago.
It seems that Cygnus is not updating this value on startup, do you have any solution to remove the old catched value?

Thanks kr
Omer

Hi,

Simply restart the Cygnus service and the new configuration will be
applied.

Anyway… I not sure if even using the proper API KEY you are allowed to
create new organizations in data.lab.fiware.org. Copying Sergio about this
issue.

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Hello Francisco,

Restarting doesnt solve this cache problem.
Cygnus still sends the old key(OLD_KEY).

25 Feb 2016 09:57:15,981 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.backends.http.HttpBackend.createJsonResponse:280) - response payload: {"help": "https://data.lab.fiware.org/api/3/action/help_show?name=organization_create", "success": false, "error": {"message": "Access denied: User OLD_KEY not authorized to create organizations", "__type": "Authorization Error"}}

Sergio already created an organization and gave our users the rights..

Thanks kr
Omer

Hi Ozdemir,

Independently of the API KEY (I’ll try to reproduce the error ASAP):
Sergio created an organization in order all your data was persisted under
it. That means you are only allowed to create CKAN packages (also known as
datasets) and CKAN resources under those packages/datasets. Nevertheless,
the issue we are discussing is about creating a new organization, “ariot”.
Let me explain you how Cygnus maps the notified data from Orion to CKAN:

• An organization is created, if not yet existing, regarding the notified
  fiware-service. If no fiware-service is notified, then the configured
  value cygnusagent.sources.http-source.handler.default_service is taken.
• A package is created, if not yet existing, regarding the notified
  fiware-servicePath (it must be said the organization name is prefixed to
  the dataset name). If no fiware-servicePath is notified, then the
  configured value
  cygnusagent.sources.http-source.handler.default_service_path is taken.
• A resource is created, if not yet existing, regarding the notified
  entityId and entityType.
• A datastore is created and associated to the above resource.
• A resource viewer is created and associated to the above resource.

I’m guessing all your Orion’s entities are under the fiware-service
“ariot”, right? That should be the reason Cygnus is trying to create a new
organization with that name. Thus, all your entities should be under the
organization name Sergio created for you.

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

I’m re-writting my last sentence, it was not clear at all

I’m guessing all your Orion’s entities are under the fiware-service
“ariot”, right? That should be the reason Cygnus is trying to create a new
organization with that name. Thus, in order to fix these organization
creations you must place all your entities under a fiware-service named as
the organization name Sergio created for you.

Regards,
Francisco

El 25/2/16 11:15, "FRANCISCO ROMERO BUENO"

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Hello Francisco,

I understood this part.

I switched to my friends APIKEY(and changed the service path) and when I send some temperature notifications to Cykan I see that dataset is created and 1 resource is added in CKAN
https://data.lab.fiware.org/organization/activity/fiwaredemos/0

But when i check the content of this resource its empty, it doenst store any values.

hence I've checked the Cygnus log and there is this part, please check:

25 Feb 2016 10:36:51,962 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.Wire.wire:86) - << "{"help": "https://data.lab.fiware.org/api/3/action/help_show?name=datastore_upsert", "success": false, "error": {"records": ["row \"1\" has extra keys \"fiwareServicePath\""], "__type": "Validation Error"}}"
25 Feb 2016 10:36:51,962 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.PoolingClientConnectionManager.releaseConnection:262) - Connection [id: 4][route:

->https://data.lab.fiware.org:443][total kept alive: 1; route allocated: 1 of 100; total allocated: 1 of 500]
25 Feb 2016 10:36:51,963 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.backends.http.HttpBackend.createJsonResponse:280) - response payload: {"help": "https://data.lab.fiware.org/api/3/action/help_show?name=datastore_upsert", "success": false, "error": {"records": ["row \"1\" has extra keys \"fiwareServicePath\""], "__type": "Validation Error"}}
25 Feb 2016 10:36:51,963 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.backends.http.HttpBackend.doRequest:138) - The used Http endpoint is not active, trying another one (host=data.lab.fiware.org)
25 Feb 2016 10:36:51,963 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.sinks.OrionSink.processOneByOne:228) - [com.telefonica.iot.cygnus.backends.ckan.CKANBackendImpl.insert(CKANBackendImpl.java:176), com.telefonica.iot.cygnus.backends.ckan.CKANBackendImpl.persist(CKANBackendImpl.java:80), com.telefonica.iot.cygnus.sinks.OrionCKANSink.persistAggregation(OrionCKANSink.java:386), com.telefonica.iot.cygnus.sinks.OrionCKANSink.persistBatch(OrionCKANSink.java:181), com.telefonica.iot.cygnus.sinks.OrionCKANSink.persistOne(OrionCKANSink.java:154), com.telefonica.iot.cygnus.sinks.OrionSink.processOneByOne(OrionSink.java:222), com.telefonica.iot.cygnus.sinks.OrionSink.process(OrionSink.java:148), org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68), org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147), java.lang.Thread.run(Unknown Source)]
25 Feb 2016 10:36:51,964 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.sinks.OrionSink.processOneByOne:267) - Runtime error (Don't know how to treat response code 409)

Hi Ozdemir,

Great yo hear that Regarding the last error, now it must be said the
fault is on our side... the issue you are experiencing is this one:
https://github.com/telefonicaid/fiware-cygnus/issues/800. It has been
fixed in the current develop branch, but there is not a RPM with such a
fix. The good news is a new release of Cygnus having the fix will be
released tomorrow (or the next Monday). In the meantime, I think there are
two options:

• Build a Cygnus jar from the current develop branch, and copying it in
  the Cygnus installation folder. I can do this for you and upload it to
  some storage utility such as dropbox or something like that. Once
  downloaded the jar, it is just a matter of copying it to the proper folder.
• Try to update the name of the column in the datastore of CKAN via the
  CKAN REST API. I don’t really know if this is possible, but we can try.

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Thanks a lot for your instant responses Francisco! much appreciated

We could go with the first option, could you please tell me which folder i should place this jar file?

Hi again,

This is the link to the jar you must donwload (86 MB):
https://www.dropbox.com/s/6kppoq0mwlogo3w/cygnus-0.12.0_SNAPSHOT-jar-with-d
ependencies.jar?dl=0

Once downloaded, simply copy it to:
/usr/cygnus/plugins.d/cygnus/lib

The already existent one must be renamed to something not finishing in
.jar (e.g. .jar.old).

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Thanks Francisco,

I copied the jar file but the result is the same http error 409 conflict.

I wanna mention one thing here please, are we sure that you've uploeded the latest one?

becuase the current one is called: cygnus-0.12.1-jar-with-dependencies.jar.
But the one already uploaded is called: cygnus-0.12.0_SNAPSHOT-jar-with-dependencies.jar

Maybe there was some confusion ?

Thanks kind regards
Omer

Hi,

Yes, the name is correct. Because it comes from the develop branch, the
name has that “_SNAPSHOT” suffix (it means, “this is 0.12.0 plus all the
things that will produce 0.13.0). The 0.12.1 version you were using was at
some time a 0.12.0_SNAPSHOT that became 0.12.1. Anyway, the name is
irrelevant, Cygnus takes the .jar within the mentioned path
(/usr/cygnus/plugins.d/cygnus/lib).

Did you restarted the service?

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Additionally... if the test was done regarding the same entity, then the
CKAN resoruce+datastore will remain with the old wrong format. I would
delete everything under your organization and I would start testing again.

Regards,
Francisco

El 25/2/16 14:19, "FRANCISCO ROMERO BUENO"

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Yes Francisco, I have restarted service with the new jar file, removed the old one tho another dir.

Deleted datasets from Ckan and still get this error:

response payload: {"help": "https://data.lab.fiware.org/api/3/action/help_show?name=datastore_upsert", "success": false, "error": {"records": ["row \"1\" has extra keys \"fiwareServicePath\""], "__type": "Validation Error"}}
25 Feb 2016 13:28:45,077 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.sinks.OrionSink.processNewBatches:425) - Runtime error (Don't know how to treat response code 409)

Hi,

I’m not seeing nothing under the fiwaredemos organization:

https://data.lab.fiware.org/organization/fiwaredemos

At least, the packages/datasets should be there... I’m afraid of the way
CKAN deletes its stuff. In fact, if I query for the supposedly non
existent package “fiwaredemos_def_servpath”:

$ curl -X POST
"https://data.lab.fiware.org/api/3/action/package_show?id=fiwaredemos_def_s
ervpath" -H "Authorization: 271af10a-57e4-4e31-8da8-079e7422de4a"
{"help":
"https://data.lab.fiware.org/api/3/action/help_show?name=package_show",
"success": false, "error": {"message": "Access denied: User
e170190b41724b298862fdc89d32f8e7 not authorized to read package
47206b46-2bd0-4ebe-b135-87b792cdc9dc", "__type": "Authorization Error"}}

I.e. I cannot read the package because I’m not authorized… not because it
is really deleted! Just remember what I told you regarding the “deleted”
flag CKAN puts to the deleted elements.

Thus, I would use another not “burned” service path, either in Orion or in
the Cygnus configuration (remember, the
cygnusagent.sources.http-source.handler.default_service_path parameter).

Another option is to use something I heard about “flusing” or “committing”
the deletions, in order to effectively delete things in CKAN. But I don’t
know the details…

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Hi all again,

I’ve asked Sergio to allow me for writing in fiwaredemos in order to
perform a test, and this is the result:

https://data.lab.fiware.org/dataset/fiwaredemos_frbtest/resource/f8051abb-3
ef8-4a74-81cb-eaf8226fb74e

Everything has been created as expected. The jar version I’m using is the
same I sent you.

time=2016-02-25T15:24:06.215CET | lvl=DEBUG |
trans=1456410234-62-0000000000 | svc=fiwaredemos | subsvc=frbtest |
function=wire | comp=Cygnus | msg=org.apache.http.impl.conn.Wire[86] : <<
"{"help":
"https://data.lab.fiware.org/api/3/action/help_show?name=datastore_upsert",
"success": true, "result": {"records": [

], "method": "insert",
"resource_id": "f8051abb-3ef8-4a74-81cb-eaf8226fb74e"}}"

Then, I’ve tried to append data to the fiwaredemos_def_servpath dataset by
means of Cygnus and the same error than using the API (as I as expecting):

time=2016-02-25T15:24:31.870CET | lvl=DEBUG |
trans=1456410234-62-0000000001 | svc=fiwaredemos | subsvc=def_servpath |
function=wire | comp=Cygnus | msg=org.apache.http.impl.conn.Wire[86] : <<
"{"help":
"https://data.lab.fiware.org/api/3/action/help_show?name=package_show",
"success": false, "error": {"message": "Access denied: User
e170190b41724b298862fdc89d32f8e7 not authorized to read package
47206b46-2bd0-4ebe-b135-87b792cdc9dc", "__type": "Authorization Error"}}"

Thus, as I told you in my previous email, simply use a non “burned”
service path within fiwaredemos.

Regards,
Francisco

El 25/2/16 15:00, "FRANCISCO ROMERO BUENO"

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Hello Francisco,

Remving serv and service path from Cygnus conf did work(we are sending them in (Orion aswell, so no need them twice)

I managed to create dataset and send notifications from Cygnus to CKan finally

https://data.lab.fiware.org/dataset/fiwaredemos_ul20httptest/resource/bb21b554-cabb-4798-9279-99fceb512f13

One last question please, I have sent 2 notifications to Ckan(success as above) than tried for a 3rd time with another value, but I checked the logs and nothing happens on Cygnus side

and see these stop signals, please check in poastebin: http://pastebin.com/W9Cs2Wd2

And now it seems Cygnus becomes dull, do you have anyidea?

Hi,

We have been doing some tests and you are right, there is some kind of bug
(not yet identified) in our custom Flume node (which is named
CygnusApplication). It is the problem of using the develop version
Nevertheless, there is an easy workaround: not using our custom
implementation of the Flume node and use the native one. Nothing will
change except for the Cygnus Management Interface… it will not work But
that’s a minor problem right now.

So, in order to implement the workaroud:

1. Stop Cygnus
2. Edit /usr/cygnus/bin/cygnus-flume-ng and replace
FLUME_AGENT_CLASS=“com.telefonica.iot.cygnus.nodes.CygnusApplication” with
FLUME_AGENT_CLASS=“org.apache.flume.node.Application"
3. Start Cygnus

Let me know any progress.

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Good morning, thanks a lot Francisco, gonna do the changes now and will test in a couple of hours and inform you soon hopefully

aaaaaaand here I got the exception while starting cygnus after the change

26 Feb 2016 08:58:50,460 ERROR [main] (org.apache.flume.node.Application.main:307) - A fatal error occurred while running. Exception follows.
org.apache.commons.cli.UnrecognizedOptionException: Unrecognized option: -p
at org.apache.commons.cli.Parser.processOption(Parser.java:363)
at org.apache.commons.cli.Parser.parse(Parser.java:199)
at org.apache.commons.cli.Parser.parse(Parser.java:85)
at org.apache.flume.node.Application.main(Application.java:252)

A correction to the command to be run:

$ /usr/cygnus/bin/cygnus-flume-ng agent —conf /usr/cygnus/conf -f
/usr/cygnus/conf/<your_agent_conf_file> -n cygnusagent
-Dflume.root.logger=INFO,console

El 26/2/16 10:19, "FRANCISCO ROMERO BUENO"

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

A correction to the command to be run:

$ /usr/cygnus/bin/cygnus-flume-ng agent —conf /usr/cygnus/conf -f
/usr/cygnus/conf/<your_agent_conf_file> -n cygnusagent
-Dflume.root.logger=INFO,console

El 26/2/16 10:24, "FW External User (JIRA)" <jira-help-desk@fi-ware.org>

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição

Hello Francisco,

We just finished testing all the flows and it seems Cygnus is working well, thanks a lot again for your help

So would you suggest me to use Cygnus this way till the new release?

Yeah! Nice to hear that.

Yes, until we fix everything and produce a new rlease (0.13.0).

Cygnus works the same as a process, the only differenc is you don’t have
services like start, stop, restart, and everything must e done by
yourself (looking for the PID, killing the process, restartin the
command, etc). But the functionality is the same (that’s the importan
stuff).

Anything you may need, please contact me

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help

Thanks a lot Francisco, much appreciated )

Have a nice weekend..

PS:I guess we can close the ticket now

FYI, this is the bug description:
https://github.com/telefonicaid/fiware-cygnus/issues/826

Have a nice weekend as well!

Regards,
Francisco

________________________________

Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
Since January 1st, old domains won't be supported and messages sent to any domain different to @lists.fiware.org will be lost.
Please, send your messages using the new domain (Fiware-tech-help@lists.fiware.org) instead of the old one.
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fiware.org
https://lists.fiware.org/listinfo/fiware-tech-help