Details
-
Type: extRequest
-
Status: Closed
-
Priority: Major
-
Resolution: Done
-
Fix Version/s: 2021
-
Component/s: FIWARE-TECH-HELP
-
Labels:None
-
Sender Email:
-
HD-Chapter:Data
-
HD-Enabler:Cosmos
Description
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query
launched by our Java Client: *_java.sql.SQLException: Query returned
non-zero code: 9, cause: FAILED: Execution Error, return code -101 from
shark.execution.SparkTask_*
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help
[Created via e-mail received from: Massimiliano Nigrelli <massimiliano.nigrelli@eng.it>]
Activity
Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.
Thank you,
Regards
M.
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help
Hi Massimiliano,
HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be).
Regards,
Francisco
----Mensaje original----
De: FW External User (JIRA) jira-help-desk@fi-ware.org
Enviado el: martes, 03 de febrero de 2015 15:53
Para: FRANCISCO ROMERO BUENO
Asunto: [FI-WARE-JIRA] (HELP-2070) [Fiware-lab-help] [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
FW External User commented on HELP-2070:
----------------------------------------
Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.
Thank you,
Regards
M.
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab massimiliano.nigrelli@eng.it
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
Hi Massimiliano,
HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be).
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 15:54
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.
Thank you,
Regards
M.
Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto:
Dear Massimiliano,
Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state.
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 11:44
Para: fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it<massimiliano.nigrelli@eng.it>
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
Dear Francisco,
thank you for the effort but unfortunately it is still not working.
From our java client, we get the same error:
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED:
Execution Error, return code -101 from shark.execution.SparkTask
Let us know, please.
Regards,
Massimiliano
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help
Massimiliano,
Which is the table you are having problems with?
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: miércoles, 04 de febrero de 2015 15:43
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear Francisco,
thank you for the effort but unfortunately it is still not working.
From our java client, we get the same error:
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Let us know, please.
Regards,
Massimiliano
Il 04/02/2015 07:20, FRANCISCO ROMERO BUENO ha scritto:
Hi Massimiliano,
HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be).
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 15:54
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.
Thank you,
Regards
M.
Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto:
Dear Massimiliano,
Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state.
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 11:44
Para: fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it<massimiliano.nigrelli@eng.it>
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
Hi Francisco,
after your last email, we made some tests on we finally found out that
in TERNI_LOAD there was a currupted file.
Thank you for your support
M.
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help
Dear Massimiliano,
Did you get managed with the corrupted file by yourself? After a quick inspection yesterday it seemed everything was ok within hdfs:///user/FINESCE-WP4/input/Load. If not, I can find the problematic file.
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: miércoles, 04 de febrero de 2015 16:41
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Hi Francisco,
after your last email, we made some tests on we finally found out that in TERNI_LOAD there was a currupted file.
Thank you for your support
M.
Il 04/02/2015 15:44, FRANCISCO ROMERO BUENO ha scritto:
Massimiliano,
Which is the table you are having problems with?
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: miércoles, 04 de febrero de 2015 15:43
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear Francisco,
thank you for the effort but unfortunately it is still not working.
From our java client, we get the same error:
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Let us know, please.
Regards,
Massimiliano
Il 04/02/2015 07:20, FRANCISCO ROMERO BUENO ha scritto:
Hi Massimiliano,
HDFS automatically entered in safe mode due to the Namenode HDD was running out of space. We have been deleting some stuff, such as temporal files, ancient logs, etc... Hope it has been definitely solved (currently it seems to be).
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 15:54
Para: FRANCISCO ROMERO BUENO; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: Re: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear Francisco,
I am sorry but retrieving data by using Shark is still not working.
Thank you,
Regards
M.
Il 03/02/2015 15:33, FRANCISCO ROMERO BUENO ha scritto:
Dear Massimiliano,
Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state.
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 11:44
Para: fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it<Pasquale.Andriani@eng.it>; Leandro Lombardo; Pellegrino Dario
Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it<massimiliano.nigrelli@eng.it>
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
Dear Francisco,
my colleague Leandro have finally found out the corrupted file and
renamed it.
Thank you for your help.
Regards,
Massimiliano
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================
_______________________________________________
Fiware-lab-help mailing list
Fiware-lab-help@lists.fi-ware.org
https://lists.fi-ware.org/listinfo/fiware-lab-help
Dear Massimiliano,
Are you still experiencing the issue? I mean, I’ve tested the Hive/Shark interface and it is working properly. If the issue continues, I’ll take a look to the HDFS files, someone may be in an inconsistent/corrupted state.
Regards,
Francisco
De: Massimiliano Nigrelli massimiliano.nigrelli@eng.it
Enviado el: martes, 03 de febrero de 2015 11:44
Para: fiware-lab-help@lists.fi-ware.org; FRANCISCO ROMERO BUENO; MIGUEL CARRILLO PACHECO; SERGIO GARCIA GOMEZ
CC: Pasquale.Andriani@eng.it; Leandro Lombardo; Pellegrino Dario
Asunto: [FINESCE WP4] COSMOS : Execution Error, return code -101 from shark.execution.SparkTask
Dear all,
we have been facing a connection issue on COSMOS instance.
This is the error message related to the execution of hive query launched by our Java Client: java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code -101 from shark.execution.SparkTask
Waiting for your feedback, thank you in advance.
Best regards,
Massimiliano Nigrelli
–
===============================================================
Massimiliano Nigrelli
Direzione Ricerca e Innovazione - R&D Lab
massimiliano.nigrelli@eng.it<massimiliano.nigrelli@eng.it>
Engineering Ingegneria Informatica S.p.A.
Viale Regione Siciliana, 7275 - 90146 Palermo (Italy)
Phone: +39 091.75.11.847
============================================================