Details
-
Type: extRequest
-
Status: Closed
-
Priority: Major
-
Resolution: Done
-
Fix Version/s: 2021
-
Component/s: FIWARE-TECH-HELP
-
Labels:None
-
Sender Email:
-
HD-Chapter:Data
-
HD-Enabler:Cosmos
Description
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Dario Pellegrino
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help
[Created via e-mail received from: Pellegrino Dario <dario.pellegrino@eng.it>]
Activity
Hi Miguel,
Why do we have to wait until Tuesday... Is it not possible restart shark/spark today?
Please, let us know as soon as possible.
Thanks,
Dario
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com
Inviato: venerdì 9 gennaio 2015 12:50
A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org
Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Hi,
Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.
Regards,
Miguel
El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Dario Pellegrino
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
–
Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
----------------------------------------------------------------------
/ _// Miguel Carrillo Pacheco
_/ _/ _/ _/ Telefónica Distrito Telefónica
/ _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9
_/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N
/ _// 28050 Madrid (Spain)
Tel: (+34) 91 483 26 77
e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
Follow FIWARE on the net
Website: http://www.fiware.org
Facebook: https://www.facebook.com/eu.fiware
Twitter: http://twitter.com/Fiware
LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932
----------------------------------------------------------------------
Dear Dario,
Unfortunately, this is the case.
Best regards,
Miguel
El 09/01/2015 a las 15:02, Pellegrino Dario escribió:
Hi Miguel,
Why do we have to wait until Tuesday… Is it not possible restart shark/spark today?
Please, let us know as soon as possible.
Thanks,
Dario
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com
Inviato: venerdì 9 gennaio 2015 12:50
A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>
Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com<sergio.garciagomez@telefonica.com>); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Hi,
Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.
Regards,
Miguel
El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Dario Pellegrino
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
–
Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
----------------------------------------------------------------------
/ _// Miguel Carrillo Pacheco
_/ _/ _/ _/ Telefónica Distrito Telefónica
/ _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9
_/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N
/ _// 28050 Madrid (Spain)
Tel: (+34) 91 483 26 77
e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
Follow FIWARE on the net
Website: http://www.fiware.org
Facebook: https://www.facebook.com/eu.fiware
Twitter: http://twitter.com/Fiware
LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932
----------------------------------------------------------------------
Hi all,
As I'll probably have warned you several times, the Shark server seems to have some kind of memory leak. I programmed a crontab-based watchdog in order to restart it each 24 hours at midnight, but this is clearly not enough because full memory usage has been demonstrated can be reached before midnight. Thus, I have to program a Monit-like watchdog in order to restart it each time certain memory consumption is reached.
Nevertheless, from midnight it is working again.
Regards,
Francisco
De: MIGUEL CARRILLO PACHECO
Enviado el: viernes, 09 de enero de 2015 15:26
Para: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org
CC: SERGIO GARCIA GOMEZ; FRANCISCO ROMERO BUENO; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
Asunto: Re: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear Dario,
Unfortunately, this is the case.
Best regards,
Miguel
El 09/01/2015 a las 15:02, Pellegrino Dario escribió:
Hi Miguel,
Why do we have to wait until Tuesday... Is it not possible restart shark/spark today?
Please, let us know as soon as possible.
Thanks,
Dario
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com
Inviato: venerdì 9 gennaio 2015 12:50
A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>
Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com<sergio.garciagomez@telefonica.com>); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Hi,
Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.
Regards,
Miguel
El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Dario Pellegrino
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
–
Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
----------------------------------------------------------------------
/ _// Miguel Carrillo Pacheco
_/ _/ _/ _/ Telefónica Distrito Telefónica
/ _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9
_/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N
/ _// 28050 Madrid (Spain)
Tel: (+34) 91 483 26 77
e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
Follow FIWARE on the net
Website: http://www.fiware.org
Facebook: https://www.facebook.com/eu.fiware
Twitter: http://twitter.com/Fiware
LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932
----------------------------------------------------------------------
Hi Francisco,
It is working properly, thanks for your support.
Regards,
Dario
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
Da: FRANCISCO ROMERO BUENO francisco.romerobueno@telefonica.com
Inviato: martedì 13 gennaio 2015 07:59
A: MIGUEL CARRILLO PACHECO; Pellegrino Dario; fiware-lab-help@lists.fi-ware.org
Cc: SERGIO GARCIA GOMEZ; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
Oggetto: RE: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Hi all,
As I'll probably have warned you several times, the Shark server seems to have some kind of memory leak. I programmed a crontab-based watchdog in order to restart it each 24 hours at midnight, but this is clearly not enough because full memory usage has been demonstrated can be reached before midnight. Thus, I have to program a Monit-like watchdog in order to restart it each time certain memory consumption is reached.
Nevertheless, from midnight it is working again.
Regards,
Francisco
De: MIGUEL CARRILLO PACHECO
Enviado el: viernes, 09 de enero de 2015 15:26
Para: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>
CC: SERGIO GARCIA GOMEZ; FRANCISCO ROMERO BUENO; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
Asunto: Re: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear Dario,
Unfortunately, this is the case.
Best regards,
Miguel
El 09/01/2015 a las 15:02, Pellegrino Dario escribió:
Hi Miguel,
Why do we have to wait until Tuesday... Is it not possible restart shark/spark today?
Please, let us know as soon as possible.
Thanks,
Dario
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com
Inviato: venerdì 9 gennaio 2015 12:50
A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>
Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com<sergio.garciagomez@telefonica.com>); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Hi,
Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.
Regards,
Miguel
El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Dario Pellegrino
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
–
Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
----------------------------------------------------------------------
/ _// Miguel Carrillo Pacheco
_/ _/ _/ _/ Telefónica Distrito Telefónica
/ _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9
_/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N
/ _// 28050 Madrid (Spain)
Tel: (+34) 91 483 26 77
e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
Follow FIWARE on the net
Website: http://www.fiware.org
Facebook: https://www.facebook.com/eu.fiware
Twitter: http://twitter.com/Fiware
LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932
----------------------------------------------------------------------
Hi,
Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.
Regards,
Miguel
El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Dario Pellegrino
Dario Pellegrino
Direzione Ricerca e Innovazione - R&D Lab
dario.pellegrino@eng.it<dario.pellegrino@eng.it>
Engineering Ingegneria Informatica spa
Viale Regione Siciliana, 7275 - 90146 Palermo
Tel. +39-091.7511847
Mob. +39-346.5325257
www.eng.it<http://www.eng.it/>
–
Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
----------------------------------------------------------------------
/ _// Miguel Carrillo Pacheco
_/ _/ _/ _/ Telefónica Distrito Telefónica
/ _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9
_/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N
/ _// 28050 Madrid (Spain)
Tel: (+34) 91 483 26 77
e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>
Follow FIWARE on the net
Website: http://www.fiware.org
Facebook: https://www.facebook.com/eu.fiware
Twitter: http://twitter.com/Fiware
LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932
----------------------------------------------------------------------