Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-1884

FIWARE.Request.Tech.Data.BigData-Analysis.SharkConnectionTimeout3

        Details

        • Type: extRequest
        • Status: Closed
        • Priority: Major
        • Resolution: Done
        • Fix Version/s: 2021
        • Component/s: FIWARE-TECH-HELP
        • Labels:
          None

          Description

          Dear all,
          we have been facing a connection issue on COSMOS instance.
          This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
          Waiting for your feedback, thank you in advance.
          Best regards,
          Dario Pellegrino

          Dario Pellegrino
          Direzione Ricerca e Innovazione - R&D Lab
          dario.pellegrino@eng.it<dario.pellegrino@eng.it>

          Engineering Ingegneria Informatica spa
          Viale Regione Siciliana, 7275 - 90146 Palermo
          Tel. +39-091.7511847
          Mob. +39-346.5325257
          www.eng.it<http://www.eng.it/>

          _______________________________________________
          Fiware-lab-help mailing list
          Fiware-lab-help@lists.fi-ware.org
          https://lists.fi-ware.org/listinfo/fiware-lab-help

          [Created via e-mail received from: Pellegrino Dario <dario.pellegrino@eng.it>]

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            mcp Miguel Carrillo added a comment -

            Hi,

            Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.

            Regards,

            Miguel

            El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
            Dear all,
            we have been facing a connection issue on COSMOS instance.
            This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
            Waiting for your feedback, thank you in advance.
            Best regards,
            Dario Pellegrino

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            –

            Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            ----------------------------------------------------------------------
            / _// Miguel Carrillo Pacheco
            _/ _/ _/ _/ Telefónica Distrito Telefónica
            / _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9
            _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N
            / _// 28050 Madrid (Spain)
            Tel: (+34) 91 483 26 77

            e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            Follow FIWARE on the net

            Website: http://www.fiware.org
            Facebook: https://www.facebook.com/eu.fiware
            Twitter: http://twitter.com/Fiware
            LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932
            ----------------------------------------------------------------------

            Show
            mcp Miguel Carrillo added a comment - Hi, Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then. Regards, Miguel El 09/01/2015 a las 11:33, Pellegrino Dario escribió: Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Dario Pellegrino Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > – Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > ---------------------------------------------------------------------- / _/ / Miguel Carrillo Pacheco _/ _/ _/ _/ Telefónica Distrito Telefónica / _/ /_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9 _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N / _/ / 28050 Madrid (Spain) Tel: (+34) 91 483 26 77 e-mail: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > Follow FIWARE on the net Website: http://www.fiware.org Facebook: https://www.facebook.com/eu.fiware Twitter: http://twitter.com/Fiware LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932 ----------------------------------------------------------------------
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            Hi Miguel,
            Why do we have to wait until Tuesday... Is it not possible restart shark/spark today?
            Please, let us know as soon as possible.
            Thanks,
            Dario

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com
            Inviato: venerdì 9 gennaio 2015 12:50
            A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org
            Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
            Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

            Hi,

            Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.

            Regards,

            Miguel

            El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
            Dear all,
            we have been facing a connection issue on COSMOS instance.
            This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
            Waiting for your feedback, thank you in advance.
            Best regards,
            Dario Pellegrino

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            –

            Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            ----------------------------------------------------------------------

            / _// Miguel Carrillo Pacheco

            _/ _/ _/ _/ Telefónica Distrito Telefónica

            / _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9

            _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N

            / _// 28050 Madrid (Spain)

            Tel: (+34) 91 483 26 77

            e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            Follow FIWARE on the net

            Website: http://www.fiware.org

            Facebook: https://www.facebook.com/eu.fiware

            Twitter: http://twitter.com/Fiware

            LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932

            ----------------------------------------------------------------------

            Show
            fw.ext.user FW External User added a comment - Hi Miguel, Why do we have to wait until Tuesday... Is it not possible restart shark/spark today? Please, let us know as soon as possible. Thanks, Dario Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com Inviato: venerdì 9 gennaio 2015 12:50 A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Hi, Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then. Regards, Miguel El 09/01/2015 a las 11:33, Pellegrino Dario escribió: Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Dario Pellegrino Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > – Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > ---------------------------------------------------------------------- / _/ / Miguel Carrillo Pacheco _/ _/ _/ _/ Telefónica Distrito Telefónica / _/ /_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9 _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N / _/ / 28050 Madrid (Spain) Tel: (+34) 91 483 26 77 e-mail: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > Follow FIWARE on the net Website: http://www.fiware.org Facebook: https://www.facebook.com/eu.fiware Twitter: http://twitter.com/Fiware LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932 ----------------------------------------------------------------------
            Hide
            Permalink
            mcp Miguel Carrillo added a comment -

            Dear Dario,

            Unfortunately, this is the case.

            Best regards,

            Miguel
            El 09/01/2015 a las 15:02, Pellegrino Dario escribió:
            Hi Miguel,
            Why do we have to wait until Tuesday… Is it not possible restart shark/spark today?
            Please, let us know as soon as possible.
            Thanks,
            Dario

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com
            Inviato: venerdì 9 gennaio 2015 12:50
            A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>
            Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com<sergio.garciagomez@telefonica.com>); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
            Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

            Hi,

            Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.

            Regards,

            Miguel

            El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
            Dear all,
            we have been facing a connection issue on COSMOS instance.
            This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
            Waiting for your feedback, thank you in advance.
            Best regards,
            Dario Pellegrino

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            –

            Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            ----------------------------------------------------------------------

            / _// Miguel Carrillo Pacheco

            _/ _/ _/ _/ Telefónica Distrito Telefónica

            / _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9

            _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N

            / _// 28050 Madrid (Spain)

            Tel: (+34) 91 483 26 77

            e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            Follow FIWARE on the net

            Website: http://www.fiware.org

            Facebook: https://www.facebook.com/eu.fiware

            Twitter: http://twitter.com/Fiware

            LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932

            ----------------------------------------------------------------------

            Show
            mcp Miguel Carrillo added a comment - Dear Dario, Unfortunately, this is the case. Best regards, Miguel El 09/01/2015 a las 15:02, Pellegrino Dario escribió: Hi Miguel, Why do we have to wait until Tuesday… Is it not possible restart shark/spark today? Please, let us know as soon as possible. Thanks, Dario Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com Inviato: venerdì 9 gennaio 2015 12:50 A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org > Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com< sergio.garciagomez@telefonica.com >); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Hi, Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then. Regards, Miguel El 09/01/2015 a las 11:33, Pellegrino Dario escribió: Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Dario Pellegrino Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > – Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > ---------------------------------------------------------------------- / _/ / Miguel Carrillo Pacheco _/ _/ _/ _/ Telefónica Distrito Telefónica / _/ /_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9 _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N / _/ / 28050 Madrid (Spain) Tel: (+34) 91 483 26 77 e-mail: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > Follow FIWARE on the net Website: http://www.fiware.org Facebook: https://www.facebook.com/eu.fiware Twitter: http://twitter.com/Fiware LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932 ----------------------------------------------------------------------
            Hide
            Permalink
            frb Francisco Romero added a comment -

            Hi all,

            As I'll probably have warned you several times, the Shark server seems to have some kind of memory leak. I programmed a crontab-based watchdog in order to restart it each 24 hours at midnight, but this is clearly not enough because full memory usage has been demonstrated can be reached before midnight. Thus, I have to program a Monit-like watchdog in order to restart it each time certain memory consumption is reached.

            Nevertheless, from midnight it is working again.

            Regards,
            Francisco

            De: MIGUEL CARRILLO PACHECO
            Enviado el: viernes, 09 de enero de 2015 15:26
            Para: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org
            CC: SERGIO GARCIA GOMEZ; FRANCISCO ROMERO BUENO; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
            Asunto: Re: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

            Dear Dario,

            Unfortunately, this is the case.

            Best regards,

            Miguel
            El 09/01/2015 a las 15:02, Pellegrino Dario escribió:
            Hi Miguel,
            Why do we have to wait until Tuesday... Is it not possible restart shark/spark today?
            Please, let us know as soon as possible.
            Thanks,
            Dario

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com
            Inviato: venerdì 9 gennaio 2015 12:50
            A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>
            Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com<sergio.garciagomez@telefonica.com>); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
            Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

            Hi,

            Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.

            Regards,

            Miguel

            El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
            Dear all,
            we have been facing a connection issue on COSMOS instance.
            This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
            Waiting for your feedback, thank you in advance.
            Best regards,
            Dario Pellegrino

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            –

            Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            ----------------------------------------------------------------------

            / _// Miguel Carrillo Pacheco

            _/ _/ _/ _/ Telefónica Distrito Telefónica

            / _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9

            _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N

            / _// 28050 Madrid (Spain)

            Tel: (+34) 91 483 26 77

            e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            Follow FIWARE on the net

            Website: http://www.fiware.org

            Facebook: https://www.facebook.com/eu.fiware

            Twitter: http://twitter.com/Fiware

            LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932

            ----------------------------------------------------------------------

            Show
            frb Francisco Romero added a comment - Hi all, As I'll probably have warned you several times, the Shark server seems to have some kind of memory leak. I programmed a crontab-based watchdog in order to restart it each 24 hours at midnight, but this is clearly not enough because full memory usage has been demonstrated can be reached before midnight. Thus, I have to program a Monit-like watchdog in order to restart it each time certain memory consumption is reached. Nevertheless, from midnight it is working again. Regards, Francisco De: MIGUEL CARRILLO PACHECO Enviado el: viernes, 09 de enero de 2015 15:26 Para: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org CC: SERGIO GARCIA GOMEZ; FRANCISCO ROMERO BUENO; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo Asunto: Re: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear Dario, Unfortunately, this is the case. Best regards, Miguel El 09/01/2015 a las 15:02, Pellegrino Dario escribió: Hi Miguel, Why do we have to wait until Tuesday... Is it not possible restart shark/spark today? Please, let us know as soon as possible. Thanks, Dario Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com Inviato: venerdì 9 gennaio 2015 12:50 A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org > Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com< sergio.garciagomez@telefonica.com >); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Hi, Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then. Regards, Miguel El 09/01/2015 a las 11:33, Pellegrino Dario escribió: Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Dario Pellegrino Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > – Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > ---------------------------------------------------------------------- / _/ / Miguel Carrillo Pacheco _/ _/ _/ _/ Telefónica Distrito Telefónica / _/ /_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9 _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N / _/ / 28050 Madrid (Spain) Tel: (+34) 91 483 26 77 e-mail: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > Follow FIWARE on the net Website: http://www.fiware.org Facebook: https://www.facebook.com/eu.fiware Twitter: http://twitter.com/Fiware LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932 ----------------------------------------------------------------------
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            Hi Francisco,
            It is working properly, thanks for your support.
            Regards,
            Dario

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            Da: FRANCISCO ROMERO BUENO francisco.romerobueno@telefonica.com
            Inviato: martedì 13 gennaio 2015 07:59
            A: MIGUEL CARRILLO PACHECO; Pellegrino Dario; fiware-lab-help@lists.fi-ware.org
            Cc: SERGIO GARCIA GOMEZ; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
            Oggetto: RE: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

            Hi all,

            As I'll probably have warned you several times, the Shark server seems to have some kind of memory leak. I programmed a crontab-based watchdog in order to restart it each 24 hours at midnight, but this is clearly not enough because full memory usage has been demonstrated can be reached before midnight. Thus, I have to program a Monit-like watchdog in order to restart it each time certain memory consumption is reached.

            Nevertheless, from midnight it is working again.

            Regards,
            Francisco

            De: MIGUEL CARRILLO PACHECO
            Enviado el: viernes, 09 de enero de 2015 15:26
            Para: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>
            CC: SERGIO GARCIA GOMEZ; FRANCISCO ROMERO BUENO; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
            Asunto: Re: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

            Dear Dario,

            Unfortunately, this is the case.

            Best regards,

            Miguel
            El 09/01/2015 a las 15:02, Pellegrino Dario escribió:
            Hi Miguel,
            Why do we have to wait until Tuesday... Is it not possible restart shark/spark today?
            Please, let us know as soon as possible.
            Thanks,
            Dario

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com
            Inviato: venerdì 9 gennaio 2015 12:50
            A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>
            Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com<sergio.garciagomez@telefonica.com>); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com<francisco.romerobueno@telefonica.com>); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo
            Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

            Hi,

            Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then.

            Regards,

            Miguel

            El 09/01/2015 a las 11:33, Pellegrino Dario escribió:
            Dear all,
            we have been facing a connection issue on COSMOS instance.
            This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
            Waiting for your feedback, thank you in advance.
            Best regards,
            Dario Pellegrino

            Dario Pellegrino
            Direzione Ricerca e Innovazione - R&D Lab
            dario.pellegrino@eng.it<dario.pellegrino@eng.it>

            Engineering Ingegneria Informatica spa
            Viale Regione Siciliana, 7275 - 90146 Palermo
            Tel. +39-091.7511847
            Mob. +39-346.5325257
            www.eng.it<http://www.eng.it/>

            –

            Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            ----------------------------------------------------------------------

            / _// Miguel Carrillo Pacheco

            _/ _/ _/ _/ Telefónica Distrito Telefónica

            / _//_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9

            _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N

            / _// 28050 Madrid (Spain)

            Tel: (+34) 91 483 26 77

            e-mail: miguel.carrillopacheco@telefonica.com<miguel.carrillopacheco@telefonica.com>

            Follow FIWARE on the net

            Website: http://www.fiware.org

            Facebook: https://www.facebook.com/eu.fiware

            Twitter: http://twitter.com/Fiware

            LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932

            ----------------------------------------------------------------------

            Show
            fw.ext.user FW External User added a comment - Hi Francisco, It is working properly, thanks for your support. Regards, Dario Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > Da: FRANCISCO ROMERO BUENO francisco.romerobueno@telefonica.com Inviato: martedì 13 gennaio 2015 07:59 A: MIGUEL CARRILLO PACHECO; Pellegrino Dario; fiware-lab-help@lists.fi-ware.org Cc: SERGIO GARCIA GOMEZ; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo Oggetto: RE: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Hi all, As I'll probably have warned you several times, the Shark server seems to have some kind of memory leak. I programmed a crontab-based watchdog in order to restart it each 24 hours at midnight, but this is clearly not enough because full memory usage has been demonstrated can be reached before midnight. Thus, I have to program a Monit-like watchdog in order to restart it each time certain memory consumption is reached. Nevertheless, from midnight it is working again. Regards, Francisco De: MIGUEL CARRILLO PACHECO Enviado el: viernes, 09 de enero de 2015 15:26 Para: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org > CC: SERGIO GARCIA GOMEZ; FRANCISCO ROMERO BUENO; Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo Asunto: Re: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear Dario, Unfortunately, this is the case. Best regards, Miguel El 09/01/2015 a las 15:02, Pellegrino Dario escribió: Hi Miguel, Why do we have to wait until Tuesday... Is it not possible restart shark/spark today? Please, let us know as soon as possible. Thanks, Dario Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > Da: MIGUEL CARRILLO PACHECO miguel.carrillopacheco@telefonica.com Inviato: venerdì 9 gennaio 2015 12:50 A: Pellegrino Dario; fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org > Cc: SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com< sergio.garciagomez@telefonica.com >); FRANCISCO ROMERO BUENO (francisco.romerobueno@telefonica.com< francisco.romerobueno@telefonica.com >); Pasquale Andriani; Massimiliano Nigrelli; Luigi Briguglio; Leandro Lombardo Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Hi, Francisco will take care of this one but he will not be in on Monday. I assume that he will look at it on Tuesday, I will try to send him a reminder then. Regards, Miguel El 09/01/2015 a las 11:33, Pellegrino Dario escribió: Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Dario Pellegrino Dario Pellegrino Direzione Ricerca e Innovazione - R&D Lab dario.pellegrino@eng.it< dario.pellegrino@eng.it > Engineering Ingegneria Informatica spa Viale Regione Siciliana, 7275 - 90146 Palermo Tel. +39-091.7511847 Mob. +39-346.5325257 www.eng.it< http://www.eng.it/ > – Please update your address book with my new e-mail address: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > ---------------------------------------------------------------------- / _/ / Miguel Carrillo Pacheco _/ _/ _/ _/ Telefónica Distrito Telefónica / _/ /_/ _/ _/ Investigación y Edifico Oeste 1, Planta 9 _/ _/ _/ _/ Desarrollo Ronda de la Comunicación S/N / _/ / 28050 Madrid (Spain) Tel: (+34) 91 483 26 77 e-mail: miguel.carrillopacheco@telefonica.com< miguel.carrillopacheco@telefonica.com > Follow FIWARE on the net Website: http://www.fiware.org Facebook: https://www.facebook.com/eu.fiware Twitter: http://twitter.com/Fiware LinkedIn: https://www.linkedin.com/groups/FIWARE-4239932 ----------------------------------------------------------------------

              People

              • Assignee:
                frb Francisco Romero
                Reporter:
                fw.ext.user FW External User
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: