Details
-
Type:
extRequest
-
Status: Closed
-
Priority:
Critical
-
Resolution: Done
-
Fix Version/s: 2021
-
Component/s: FIWARE-TECH-HELP
-
Labels:None
-
Sender Email:
-
HD-Chapter:Data
-
HD-Enabler:Cosmos
Description
Hello Fi-Ware Support team
We have an urgent issue with Cosmos as it seems to be in Safe mode, we have a demo/investor presentation Monday morning and we are completely blocked in getting the system to work right now as we cannot write to the GE.
We have tried to setup a VM but due to restrictions on HTTP ports we cannot access Hadoop from our external system. Can you please advise when COSMOS will be back up and also if there is a ready made script to install Hadoop on a single VM on FiWare Cloud/Lab
Thank you for the support.
YSK
_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help
[Created via e-mail received from: Yasir Khokhar <yasirk@connecterra.io>]
Activity
Hi Yasir,
I’m happy to hear everything went well 
Your quota has been increased to 10 GB.
Regards,
Francisco
De: Yasir Khokhar <yasirk@connecterra.io<yasirk@connecterra.io
>>
Fecha: lunes, 13 de julio de 2015, 22:28
Para: Francisco Romero Bueno <francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>>
CC: "fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>" <fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>>
Asunto: RE: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Thanks so much, the demo went superb! Looking forward to continuing our development on COSMOS.
Could we get 10GB to be on the safe side? The use is saada and yasirk
Thank you!
From: FRANCISCO ROMERO BUENO francisco.romerobueno@telefonica.com
Sent: Monday, July 13, 2015 9:31 AM
To: Yasir Khokhar
Cc: fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>
Subject: Re: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Fine, I’ll keep an (extra) eye to the cluster around that hour, in order everything goes well, and this midnight I’ll do the maintenance task.
Regarding the quota increasing, how much do you need?
Regards,
Francisco
De: Yasir Khokhar <yasirk@connecterra.io<yasirk@connecterra.io>>
Fecha: lunes, 13 de julio de 2015, 9:27
Para: Francisco Romero Bueno <francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>>
CC: "fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>" <fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>>
Asunto: RE: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Yes we have a demo 1600 today, tomorrow is ok. Thanks!!
Sent from my Windows Phone
Hey Francisco,
Quick question for you and the team—how can we access object store from COSMOS? If we are storing all our data on object store containers, do we have to copy them to COSMOS HDFS for processing?
Regards,
YSK
From: FRANCISCO ROMERO BUENO francisco.romerobueno@telefonica.com
Sent: Tuesday, July 14, 2015 10:30 AM
To: Yasir Khokhar <yasirk@connecterra.io>
Cc: fiware-tech-help@lists.fi-ware.org
Subject: Re: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Hi Yasir,
I’m happy to hear everything went well
Your quota has been increased to 10 GB.
Regards,
Francisco
De: Yasir Khokhar <yasirk@connecterra.io<yasirk@connecterra.io>>
Fecha: lunes, 13 de julio de 2015, 22:28
Para: Francisco Romero Bueno <francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>>
CC: "fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>" <fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>>
Asunto: RE: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Thanks so much, the demo went superb! Looking forward to continuing our development on COSMOS.
Could we get 10GB to be on the safe side? The use is saada and yasirk
Thank you!
From: FRANCISCO ROMERO BUENO francisco.romerobueno@telefonica.com
Sent: Monday, July 13, 2015 9:31 AM
To: Yasir Khokhar
Cc: fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>
Subject: Re: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Fine, I’ll keep an (extra) eye to the cluster around that hour, in order everything goes well, and this midnight I’ll do the maintenance task.
Regarding the quota increasing, how much do you need?
Regards,
Francisco
De: Yasir Khokhar <yasirk@connecterra.io<yasirk@connecterra.io>>
Fecha: lunes, 13 de julio de 2015, 9:27
Para: Francisco Romero Bueno <francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>>
CC: "fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>" <fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>>
Asunto: RE: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Yes we have a demo 1600 today, tomorrow is ok. Thanks!!
Sent from my Windows Phone
Hi Yasir,
The Object Storage cannot be currently accessed from Cosmos, thus if you want to use it, you’ll have to copy the data to your HDFS space. Nevertheless, this kind of integration is in our roadmap:
- On the one hand, our aim is Cygnus may persist Orion context data in the Object Storage/Swift: https://github.com/telefonicaid/fiware-cygnus/issues/189
- On the other hand, we have started extending Hadoop libraries in order to use other external non-HDFS sources of data such as CKAN ones: https://github.com/telefonicaid/fiware-tidoop/tree/develop/tidoop-hadoop-ext. The Object Storage/Swift must definitely be among the external sources we are integrating. I’ll add an issue to https://github.com/telefonicaid/fiware-tidoop.
The question is: when it would be ready? Sadly, I cannot answer that right now since there are currently other priorities.
Best regards,
Francisco
De: Yasir Khokhar <yasirk@connecterra.io<yasirk@connecterra.io>>
Fecha: jueves, 20 de agosto de 2015, 11:56
Para: Francisco Romero Bueno <francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>>
CC: "fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>" <fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>>, Saad Ansari <saada@connecterra.io<saada@connecterra.io>>
Asunto: RE: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Hey Francisco,
Quick question for you and the team—how can we access object store from COSMOS? If we are storing all our data on object store containers, do we have to copy them to COSMOS HDFS for processing?
Regards,
YSK
From: FRANCISCO ROMERO BUENO francisco.romerobueno@telefonica.com
Sent: Tuesday, July 14, 2015 10:30 AM
To: Yasir Khokhar <yasirk@connecterra.io<yasirk@connecterra.io>>
Cc: fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>
Subject: Re: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Hi Yasir,
I’m happy to hear everything went well
Your quota has been increased to 10 GB.
Regards,
Francisco
De: Yasir Khokhar <yasirk@connecterra.io<yasirk@connecterra.io>>
Fecha: lunes, 13 de julio de 2015, 22:28
Para: Francisco Romero Bueno <francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>>
CC: "fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>" <fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>>
Asunto: RE: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Thanks so much, the demo went superb! Looking forward to continuing our development on COSMOS.
Could we get 10GB to be on the safe side? The use is saada and yasirk
Thank you!
From: FRANCISCO ROMERO BUENO francisco.romerobueno@telefonica.com
Sent: Monday, July 13, 2015 9:31 AM
To: Yasir Khokhar
Cc: fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>
Subject: Re: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Fine, I’ll keep an (extra) eye to the cluster around that hour, in order everything goes well, and this midnight I’ll do the maintenance task.
Regarding the quota increasing, how much do you need?
Regards,
Francisco
De: Yasir Khokhar <yasirk@connecterra.io<yasirk@connecterra.io>>
Fecha: lunes, 13 de julio de 2015, 9:27
Para: Francisco Romero Bueno <francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>>
CC: "fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>" <fiware-tech-help@lists.fi-ware.org<fiware-tech-help@lists.fi-ware.org>>
Asunto: RE: [FI-WARE-JIRA] (HELP-3538) FIWARE.Request.Lab.Data.BigData-Analysis.SafeMode
Yes we have a demo 1600 today, tomorrow is ok. Thanks!!
Sent from my Windows Phone
Hi again,
After some quick research, I¹ve noticed the FIWARE¹s Object Storage is
based on Openstack¹s Swift. And the most interesting thing, people from
Openstack (specifically the Sahara group, in which we are very interested)
have already done some effort through this direction. I¹ll keep an eye and
perform some tests, I¹ll get you informed (this may be in one week or one
month 
).
Regards,
Francisco
El 21/8/15 12:24, "FW External User (JIRA)" <jira-help-desk@fi-ware.org>
________________________________
Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.
The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.
Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-tech-help
Thanks, we'll stay tuned on this one then...
Hi
It should be working now. It automatically entered in safe mode due to the
cluster usage is close to 100%.
About accessing the Cosmos ports from a machine outside FIWARE Lab, it
should be possible now; these commands have been executed in my laptop:
$ telnet cosmos.lab.fiware.org 10000
Trying 130.206.80.46...
Connected to cosmos.lab.fiware.org.
Escape character is '^]'.
^C
Connection closed by foreign host.
$ telnet cosmos.lab.fiware.org 14000
Trying 130.206.80.46...
Connected to cosmos.lab.fiware.org.
Escape character is '^]'.
^C
Connection closed by foreign host.
$ telnet cosmos.lab.fiware.org 11000
Trying 130.206.80.46...
Connected to cosmos.lab.fiware.org.
Escape character is '^]'.
^C
Connection closed by foreign host.
Regarding the installation of an instance by your side, there is no means
on installing it in FIWARE Lab nor a single machine since it is composed
of a large set of machines (that¹s why I mention the word ³cluster²).
Cosmos is meant to be used as a service through a Global Instance.
Regards,
Francisco
El 10/7/15 8:35, "Manuel Escriche (JIRA)" <jira-help-desk@fi-ware.org>
________________________________
Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.
The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.
Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição
_______________________________________________
Fiware-tech-help mailing list
Fiware-tech-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-tech-help