[HELP-2070] FIWARE.Request.Tech.Data.BigData-Analysis.SharkConnectionTimeout7 - JIRA

Hide

Permalink

FW External User added a comment - 03/Feb/15 3:35 PM

Dear Massimiliano,

Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state.

Regards,
Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 11:44
Para: fiware-lab-help@lists.fi-ware.org; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario
Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli

–

===============================================================

Massimiliano Nigrelli

Direzione Ricerca e Innovazione - R&D Lab

massimiliano.nigrelli@eng.it<massimiliano.nigrelli@eng.it>

Engineering Ingegneria Informatica S.p.A.

Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

Show

FW External User added a comment - 03/Feb/15 3:35 PM Dear Massimiliano, Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state. Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: martes, 03 de febrero de 2015 11:44 Para: fiware-lab-help@lists.fi-ware.org; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Massimiliano Nigrelli – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it< massimiliano.nigrelli@eng.it > Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================

Hide

Permalink

FW External User added a comment - 03/Feb/15 3:51 PM

Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.

Thank you,

Regards

M.

–
===============================================================

Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it

Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help

Show

FW External User added a comment - 03/Feb/15 3:51 PM Dear Francisco, I am sorry but retrieving data by using Shark is still not working. Thank you, Regards M. – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help

Hide

Permalink

FW External User added a comment - 04/Feb/15 7:20 AM

Hi Massimiliano,

HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be).

Regards,
Francisco

----~~Mensaje original~~----
De: FW External User (JIRA) jira-help-desk@fi-ware.org
Enviado el: martes, 03 de febrero de 2015 15:53
Para: FRANCISCO ROMERO BUENO
Asunto: [FI-WARE-JIRA] (~~HELP-2070~~) [Fiware-lab-help] [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

[ http://jira.fiware.org/browse/HELP-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16454#comment-16454 ]

FW External User commented on ~~HELP-2070~~:
----------------------------------------

Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.

Thank you,

Regards

M.

–
===============================================================

Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it

Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

Show

FW External User added a comment - 04/Feb/15 7:20 AM Hi Massimiliano, HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be). Regards, Francisco ---- Mensaje original ---- De: FW External User (JIRA) jira-help-desk@fi-ware.org Enviado el: martes, 03 de febrero de 2015 15:53 Para: FRANCISCO ROMERO BUENO Asunto: [FI-WARE-JIRA] ( HELP-2070 ) [Fiware-lab-help] [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask [ http://jira.fiware.org/browse/HELP-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16454#comment-16454 ] FW External User commented on HELP-2070 : ---------------------------------------- Dear Francisco, I am sorry but retrieving data by using Shark is still not working. Thank you, Regards M. – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================

Hide

Permalink

FW External User added a comment - 04/Feb/15 7:22 AM

Hi Massimiliano,

HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be).

Regards,

Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 15:54
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.

Thank you,

Regards

M.
Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto:
Dear Massimiliano,

Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state.

Regards,
Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 11:44
Para: fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli

–

===============================================================

Massimiliano Nigrelli

Direzione Ricerca e Innovazione - R&D Lab

massimiliano.nigrelli@eng.it<massimiliano.nigrelli@eng.it>

Engineering Ingegneria Informatica S.p.A.

Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

Show

FW External User added a comment - 04/Feb/15 7:22 AM Hi Massimiliano, HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be). Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: martes, 03 de febrero de 2015 15:54 Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear Francisco, I am sorry but retrieving data by using Shark is still not working. Thank you, Regards M. Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto: Dear Massimiliano, Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state. Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: martes, 03 de febrero de 2015 11:44 Para: fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org >; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it< Pasquale.Andriani@eng.it >; Leandro Lombardo; Pellegrino Dario Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Massimiliano Nigrelli – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it< massimiliano.nigrelli@eng.it > Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================

Hide

Permalink

FW External User added a comment - 04/Feb/15 3:40 PM

Dear Francisco,
thank you for the effort but unfortunately it is still not working.

From our java client, we get the same error:
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED:
Execution Error, return code -101 from shark.execution.SparkTask

Let us know, please.

Regards,

Massimiliano

–
===============================================================

Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it

Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help

Show

FW External User added a comment - 04/Feb/15 3:40 PM Dear Francisco, thank you for the effort but unfortunately it is still not working. From our java client, we get the same error: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Let us know, please. Regards, Massimiliano – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help

Hide

Permalink

FW External User added a comment - 04/Feb/15 3:46 PM

Massimiliano,

Which is the table you are having problems with?

Regards,
Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: miércoles, 04 de febrero de 2015 15:43
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear Francisco,
thank you for the effort but unfortunately it is still not working.

From our java client, we get the same error:
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask

Let us know, please.

Regards,

Massimiliano
Il 04/02/2015 07:20, FRANCISCO ROMERO BUENO ha scritto:

Hi Massimiliano,

HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be).

Regards,

Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 15:54
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.

Thank you,

Regards

M.
Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto:
Dear Massimiliano,

Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state.

Regards,
Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 11:44
Para: fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli

–

===============================================================

Massimiliano Nigrelli

Direzione Ricerca e Innovazione - R&D Lab

massimiliano.nigrelli@eng.it<massimiliano.nigrelli@eng.it>

Engineering Ingegneria Informatica S.p.A.

Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

Show

FW External User added a comment - 04/Feb/15 3:46 PM Massimiliano, Which is the table you are having problems with? Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: miércoles, 04 de febrero de 2015 15:43 Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear Francisco, thank you for the effort but unfortunately it is still not working. From our java client, we get the same error: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Let us know, please. Regards, Massimiliano Il 04/02/2015 07:20, FRANCISCO ROMERO BUENO ha scritto: Hi Massimiliano, HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be). Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: martes, 03 de febrero de 2015 15:54 Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org >; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it< Pasquale.Andriani@eng.it >; Leandro Lombardo; Pellegrino Dario Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear Francisco, I am sorry but retrieving data by using Shark is still not working. Thank you, Regards M. Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto: Dear Massimiliano, Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state. Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: martes, 03 de febrero de 2015 11:44 Para: fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org >; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it< Pasquale.Andriani@eng.it >; Leandro Lombardo; Pellegrino Dario Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Massimiliano Nigrelli – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it< massimiliano.nigrelli@eng.it > Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================

Hide

Permalink

FW External User added a comment - 04/Feb/15 4:38 PM

Hi Francisco,
after your last email, we made some tests on we finally found out that
in TERNI_LOAD there was a currupted file.

Thank you for your support

M.

–
===============================================================

Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it

Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help

Show

FW External User added a comment - 04/Feb/15 4:38 PM Hi Francisco, after your last email, we made some tests on we finally found out that in TERNI_LOAD there was a currupted file. Thank you for your support M. – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help

Hide

Permalink

FW External User added a comment - 05/Feb/15 9:48 AM

Dear Massimiliano,

Did you get managed with the corrupted file by yourself? After a quick inspection yesterday it seemed everything was ok within hdfs:///user/FINESCE-WP4/input/Load. If not, I can find the problematic file.

Regards,
Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: miércoles, 04 de febrero de 2015 16:41
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Hi Francisco,
after your last email, we made some tests on we finally found out that in TERNI_LOAD there was a currupted file.

Thank you for your support

M.
Il 04/02/2015 15:44, FRANCISCO ROMERO BUENO ha scritto:
Massimiliano,

Which is the table you are having problems with?

Regards,
Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: miércoles, 04 de febrero de 2015 15:43
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear Francisco,
thank you for the effort but unfortunately it is still not working.

From our java client, we get the same error:
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask

Let us know, please.

Regards,

Massimiliano
Il 04/02/2015 07:20, FRANCISCO ROMERO BUENO ha scritto:

Hi Massimiliano,

HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be).

Regards,

Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 15:54
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.

Thank you,

Regards

M.
Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto:
Dear Massimiliano,

Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state.

Regards,
Francisco

De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 11:44
Para: fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask

Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli

–

===============================================================

Massimiliano Nigrelli

Direzione Ricerca e Innovazione - R&D Lab

massimiliano.nigrelli@eng.it<massimiliano.nigrelli@eng.it>

Engineering Ingegneria Informatica S.p.A.

Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

Show

FW External User added a comment - 05/Feb/15 9:48 AM Dear Massimiliano, Did you get managed with the corrupted file by yourself? After a quick inspection yesterday it seemed everything was ok within hdfs:///user/FINESCE-WP4/input/Load. If not, I can find the problematic file. Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: miércoles, 04 de febrero de 2015 16:41 Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Hi Francisco, after your last email, we made some tests on we finally found out that in TERNI_LOAD there was a currupted file. Thank you for your support M. Il 04/02/2015 15:44, FRANCISCO ROMERO BUENO ha scritto: Massimiliano, Which is the table you are having problems with? Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: miércoles, 04 de febrero de 2015 15:43 Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org >; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it< Pasquale.Andriani@eng.it >; Leandro Lombardo; Pellegrino Dario Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear Francisco, thank you for the effort but unfortunately it is still not working. From our java client, we get the same error: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Let us know, please. Regards, Massimiliano Il 04/02/2015 07:20, FRANCISCO ROMERO BUENO ha scritto: Hi Massimiliano, HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be). Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: martes, 03 de febrero de 2015 15:54 Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org >; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it< Pasquale.Andriani@eng.it >; Leandro Lombardo; Pellegrino Dario Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear Francisco, I am sorry but retrieving data by using Shark is still not working. Thank you, Regards M. Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto: Dear Massimiliano, Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state. Regards, Francisco De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it Enviado el: martes, 03 de febrero de 2015 11:44 Para: fiware-lab-help@lists.fi-ware.org< fiware-lab-help@lists.fi-ware.org >; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ CC: Pasquale.Andriani@eng.it< Pasquale.Andriani@eng.it >; Leandro Lombardo; Pellegrino Dario Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask Dear all, we have been facing a connection issue on COSMOS instance. This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask Waiting for your feedback, thank you in advance. Best regards, Massimiliano Nigrelli – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it< massimiliano.nigrelli@eng.it > Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================

Hide

Permalink

FW External User added a comment - 05/Feb/15 9:56 AM

Dear Francisco,
my colleague Leandro have finally found out the corrupted file and
renamed it.

Thank you for your help.

Regards,

Massimiliano

–
===============================================================

Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it

Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)

Phone: +39 091.75.11.847

============================================================

_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help

Show

FW External User added a comment - 05/Feb/15 9:56 AM Dear Francisco, my colleague Leandro have finally found out the corrupted file and renamed it. Thank you for your help. Regards, Massimiliano – =============================================================== Massimiliano Nigrelli Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it Engineering Ingegneria Informatica S.p.A. Viale Regione Siciliana, 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help

FIWARE.Request.Tech.Data.BigData-Analysis.SharkConnectionTimeout7

Details

Description

Activity

People

Dates

Agile