Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-1470

FIWARE.Request.Tech.Data.BigData-Analysis.SharkConnectionTimeout

    Details

      Description

      Dear Sergio, Francisco,
      from this morning we have been facing a connection timeout on Cosmos instance.
      Could you please solve the issue?
      Waiting for your feedback, thank you in advance.
      BR,
      Dario

      Dario Pellegrino
      Direzione Ricerca e Innovazione - R&D Lab
      dario.pellegrino@eng.it<dario.pellegrino@eng.it>

      Engineering Ingegneria Informatica spa
      Viale Regione Siciliana, 7275 - 90146 Palermo
      Tel. +39-091.7511847
      Mob. +39-346.5325257
      www.eng.it<http://www.eng.it/>

      Da: Pellegrino Dario
      Inviato: giovedì 13 novembre 2014 09:43
      A: 'JOSE IGNACIO CARRETERO GUARDE'; Massimiliano Nigrelli; FRANCISCO ROMERO BUENO
      Cc: Leandro Lombardo; Luigi Briguglio; fiware-lab-help@lists.fi-ware.org; Pasquale Andriani
      Oggetto: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Very Slow Shark connection

      Hi Jose,
      nothing has changed, we have been having the same connection problem (connection refused).
      I think shark/spark service is down.
      Waiting for your feedback, thank you in advanced.
      BR,
      Dario Pellegrino

      Dario Pellegrino
      Direzione Ricerca e Innovazione - R&D Lab
      dario.pellegrino@eng.it<dario.pellegrino@eng.it>

      Engineering Ingegneria Informatica spa
      Viale Regione Siciliana, 7275 - 90146 Palermo
      Tel. +39-091.7511847
      Mob. +39-346.5325257
      www.eng.it<http://www.eng.it/>

      Da: JOSE IGNACIO CARRETERO GUARDE joseignacio.carreteroguarde@telefonica.com
      Inviato: mercoledì 12 novembre 2014 19:48
      A: Massimiliano Nigrelli; FRANCISCO ROMERO BUENO
      Cc: Leandro Lombardo; Luigi Briguglio; Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; Pasquale Andriani
      Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Very Slow Shark connection

      Dear Massimiliano,

      I've been trying to improve our (Spain node) network performance — I think it is a little bit better now.

      Best regards,
      José Ignacio.
      El 11/11/14 a las 16:28, Massimiliano Nigrelli escribió:
      Dear Francisco,
      I have written on Stack Overflow (https://stackoverflow.com/questions/26867234/fiware-ge-cosmos-shark-is-not-working), I have just sent you two emails and I am trying again.

      Could you please solve the issue related to Shark?
      We are close to a review and no data can be retrieved from COSMOS, at all.

      I hope you to let us know asap.

      Regards,

      Massimiliano
      Il 11/11/2014 09:46, Massimiliano Nigrelli ha scritto:
      Dear Francisco,
      now it turned to no connection. SHARK seems to be stuck.

      I kindly ask you to solve the issue and I would like to remind you that next week we will be in Aachen in front of the commission for 3rd FINESCE Review.

      Regards,

      Massimiliano
      Il 10/11/2014 15:09, Pellegrino Dario ha scritto:
      Hi Francisco,
      from this morning we have been a connection issue on COSMOS (the query response time is very high!!!).
      Are you doing a maintenance activity?
      Waiting for you feedback, thank you in advanced.
      Regards,
      Dario

      Dario Pellegrino
      Direzione Ricerca e Innovazione - R&D Lab
      dario.pellegrino@eng.it<dario.pellegrino@eng.it>

      Engineering Ingegneria Informatica spa
      Viale Regione Siciliana, 7275 - 90146 Palermo
      Tel. +39-091.7511847
      Mob. +39-346.5325257
      www.eng.it<http://www.eng.it/>

      ===============================================================

      Massimiliano Nigrelli - R&D Lab

      Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

      Phone: +39 091.75.11.847

      ============================================================

      ===============================================================

      Massimiliano Nigrelli - R&D Lab

      Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

      Phone: +39 091.75.11.847

      ============================================================

      _______________________________________________

      Fiware-lab-help mailing list

      Fiware-lab-help@lists.fi-ware.org<Fiware-lab-help@lists.fi-ware.org>

      https://lists.fi-ware.org/listinfo/fiware-lab-help

      ________________________________

      Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

      The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

      Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição

      _______________________________________________
      Fiware-lab-help mailing list
      Fiware-lab-help@lists.fi-ware.org
      https://lists.fi-ware.org/listinfo/fiware-lab-help

      [Created via e-mail received from: Pellegrino Dario <dario.pellegrino@eng.it>]

        Activity

        Hide
        fermin Fermín Galán added a comment -

        As addiitonal info, spark process is also up and running:

        [root@cosmosmaster-gi ~]# ps ax | grep spark | grep -v grep
        8537 ? Sl 61:07 /usr/java/jdk1.6.0_45//bin/java -cp /usr/local/spark-0.8/tools/target/scala-2.9.3/spark-tools-assembly-0.8.1-incubating.jar::/usr/local/spark-0.8/conf:/usr/local/spark-0.8/assembly/target/scala-2.9.3/spark-assembly-0.8.1-incubating-hadoop0.20.2-cdh3u6.jar -Dspark.akka.logLifecycleEvents=true -Djava.library.path= -Xms512m -Xmx512m org.apache.spark.deploy.master.Master --ip cosmosmaster-gi --port 7077 --webui-port 8080
        8948 ? Sl 235:10 /usr/java/jdk1.6.0_45//bin/java -Dspark.local.dir=/tmp -Dspark.kryoserializer.buffer.mb=10 -verbose:gc -XX:-PrintGCDetails -XX:+PrintGCTimeStamps -Djava.library.path= -Xms6g -Xmx6g shark.SharkServer

        Show
        fermin Fermín Galán added a comment - As addiitonal info, spark process is also up and running: [root@cosmosmaster-gi ~] # ps ax | grep spark | grep -v grep 8537 ? Sl 61:07 /usr/java/jdk1.6.0_45//bin/java -cp /usr/local/spark-0.8/tools/target/scala-2.9.3/spark-tools-assembly-0.8.1-incubating.jar::/usr/local/spark-0.8/conf:/usr/local/spark-0.8/assembly/target/scala-2.9.3/spark-assembly-0.8.1-incubating-hadoop0.20.2-cdh3u6.jar -Dspark.akka.logLifecycleEvents=true -Djava.library.path= -Xms512m -Xmx512m org.apache.spark.deploy.master.Master --ip cosmosmaster-gi --port 7077 --webui-port 8080 8948 ? Sl 235:10 /usr/java/jdk1.6.0_45//bin/java -Dspark.local.dir=/tmp -Dspark.kryoserializer.buffer.mb=10 -verbose:gc -XX:-PrintGCDetails -XX:+PrintGCTimeStamps -Djava.library.path= -Xms6g -Xmx6g shark.SharkServer
        Hide
        fermin Fermín Galán added a comment -

        I have checked now (see comment date) that the shark process is up and running in the Cosmos machine:

        [root@cosmosmaster-gi ~]# ps -ef | grep shark | grep -v grep
        root 8948 1 1 Nov17 ? 03:55:02 /usr/java/jdk1.6.0_45//bin/java -Dspark.local.dir=/tmp -Dspark.kryoserializer.buffer.mb=10 -verbose:gc -XX:-PrintGCDetails -XX:+PrintGCTimeStamps -Djava.library.path= -Xms6g -Xmx6g shark.SharkServer

        Moreover, the Malaga Plague sample aplications (which is based on Shark) is working perfectly at: http://130.206.81.65/plague-tracker/

        Show
        fermin Fermín Galán added a comment - I have checked now (see comment date) that the shark process is up and running in the Cosmos machine: [root@cosmosmaster-gi ~] # ps -ef | grep shark | grep -v grep root 8948 1 1 Nov17 ? 03:55:02 /usr/java/jdk1.6.0_45//bin/java -Dspark.local.dir=/tmp -Dspark.kryoserializer.buffer.mb=10 -verbose:gc -XX:-PrintGCDetails -XX:+PrintGCTimeStamps -Djava.library.path= -Xms6g -Xmx6g shark.SharkServer Moreover, the Malaga Plague sample aplications (which is based on Shark) is working perfectly at: http://130.206.81.65/plague-tracker/
        Hide
        fw.ext.user FW External User added a comment -

        To whom it may concern,
        following all the emails (shown below), I would like to highlight a big
        issue related to the Shark interface of COSMOS.

        Shark is not available so it is not possible to execute SQL-like queries
        to retrieve data stored on COSMOS.
        It has been down since last Monday (Nov 24th), while we were having the
        3rd FINESCE review in Aachen.

        PLEASE, could someone let us know what is happening?

        Regards,

        Massimiliano

        -------- Messaggio Inoltrato --------
        Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Shark connection
        timeout
        Data: Wed, 26 Nov 2014 09:39:03 +0100
        Mittente: Massimiliano Nigrelli <massimiliano.nigrelli@eng.it>
        A: Pellegrino Dario <dario.pellegrino@eng.it>, SERGIO GARCIA GOMEZ
        (sergio.garciagomez@telefonica.com) <sergio.garciagomez@telefonica.com>,
        FRANCISCO ROMERO BUENO <francisco.romerobueno@telefonica.com>
        CC: Leandro Lombardo <Leandro.Lombardo@eng.it>, Luigi Briguglio
        <luigi.briguglio@eng.it>, fiware-lab-help@lists.fi-ware.org
        <fiware-lab-help@lists.fi-ware.org>, Pasquale Andriani
        <pasquale.andriani@eng.it>

        Dear Sergio, Dear Francisco,
        I keep on asking about when Shark will be available
        again............with no getting any answer.

        It would be really "nice and polite" if you would reply to the "tons" of
        email we have been sending in the last weeks.
        Even by saying........"There is an issue......We have been working on it".

        In front of the FINESCE reviewers (actually one is a FIWARE reviewer,
        too!) we have highlighted the importance of having a point of contact
        when considering GEs compared to alternative products on the market.
        So, please, reply!

        Regards,

        Massimiliano


        ===============================================================

        Massimiliano Nigrelli - R&D Lab

        Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

        Phone: +39 091.75.11.847

        ============================================================

        _______________________________________________
        Fiware-lab-help mailing list
        Fiware-lab-help@lists.fi-ware.org
        https://lists.fi-ware.org/listinfo/fiware-lab-help

        Show
        fw.ext.user FW External User added a comment - To whom it may concern, following all the emails (shown below), I would like to highlight a big issue related to the Shark interface of COSMOS. Shark is not available so it is not possible to execute SQL-like queries to retrieve data stored on COSMOS. It has been down since last Monday (Nov 24th), while we were having the 3rd FINESCE review in Aachen. PLEASE, could someone let us know what is happening? Regards, Massimiliano -------- Messaggio Inoltrato -------- Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Shark connection timeout Data: Wed, 26 Nov 2014 09:39:03 +0100 Mittente: Massimiliano Nigrelli <massimiliano.nigrelli@eng.it> A: Pellegrino Dario <dario.pellegrino@eng.it>, SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com) <sergio.garciagomez@telefonica.com>, FRANCISCO ROMERO BUENO <francisco.romerobueno@telefonica.com> CC: Leandro Lombardo <Leandro.Lombardo@eng.it>, Luigi Briguglio <luigi.briguglio@eng.it>, fiware-lab-help@lists.fi-ware.org <fiware-lab-help@lists.fi-ware.org>, Pasquale Andriani <pasquale.andriani@eng.it> Dear Sergio, Dear Francisco, I keep on asking about when Shark will be available again............with no getting any answer. It would be really "nice and polite" if you would reply to the "tons" of email we have been sending in the last weeks. Even by saying........"There is an issue......We have been working on it". In front of the FINESCE reviewers (actually one is a FIWARE reviewer, too!) we have highlighted the importance of having a point of contact when considering GEs compared to alternative products on the market. So, please, reply! Regards, Massimiliano – =============================================================== Massimiliano Nigrelli - R&D Lab Viale Regione Siciliana 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
        Hide
        fw.ext.user FW External User added a comment -

        Dear Sergio, Dear Francisco,
        I keep on asking about when Shark will be available
        again............with no getting any answer.

        It would be really "nice and polite" if you would reply to the "tons" of
        email we have been sending in the last weeks.
        Even by saying........"There is an issue......We have been working on it".

        In front of the FINESCE reviewers (actually one is a FIWARE reviewer,
        too!) we have highlighted the importance of having a point of contact
        when considering GEs compared to alternative products on the market.
        So, please, reply!

        Regards,

        Massimiliano


        ===============================================================

        Massimiliano Nigrelli - R&D Lab

        Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

        Phone: +39 091.75.11.847

        ============================================================

        _______________________________________________
        Fiware-lab-help mailing list
        Fiware-lab-help@lists.fi-ware.org
        https://lists.fi-ware.org/listinfo/fiware-lab-help

        Show
        fw.ext.user FW External User added a comment - Dear Sergio, Dear Francisco, I keep on asking about when Shark will be available again............with no getting any answer. It would be really "nice and polite" if you would reply to the "tons" of email we have been sending in the last weeks. Even by saying........"There is an issue......We have been working on it". In front of the FINESCE reviewers (actually one is a FIWARE reviewer, too!) we have highlighted the importance of having a point of contact when considering GEs compared to alternative products on the market. So, please, reply! Regards, Massimiliano – =============================================================== Massimiliano Nigrelli - R&D Lab Viale Regione Siciliana 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
        Hide
        fw.ext.user FW External User added a comment -

        Again, any news?

        Shark DOES NOT WORK!!!!!!!!!

        Have you got an idea of when it will be available again?

        Massimiliano


        ===============================================================

        Massimiliano Nigrelli - R&D Lab

        Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

        Phone: +39 091.75.11.847

        ============================================================

        _______________________________________________
        Fiware-lab-help mailing list
        Fiware-lab-help@lists.fi-ware.org
        https://lists.fi-ware.org/listinfo/fiware-lab-help

        Show
        fw.ext.user FW External User added a comment - Again, any news? Shark DOES NOT WORK!!!!!!!!! Have you got an idea of when it will be available again? Massimiliano – =============================================================== Massimiliano Nigrelli - R&D Lab Viale Regione Siciliana 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
        Hide
        fw.ext.user FW External User added a comment -

        Any news on the issue?

        Shark is still not working.

        Could you please let us know what is happening?

        Regards,

        Massimiliano


        ===============================================================

        Massimiliano Nigrelli - R&D Lab

        Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

        Phone: +39 091.75.11.847

        ============================================================

        _______________________________________________
        Fiware-lab-help mailing list
        Fiware-lab-help@lists.fi-ware.org
        https://lists.fi-ware.org/listinfo/fiware-lab-help

        Show
        fw.ext.user FW External User added a comment - Any news on the issue? Shark is still not working. Could you please let us know what is happening? Regards, Massimiliano – =============================================================== Massimiliano Nigrelli - R&D Lab Viale Regione Siciliana 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
        Hide
        UPRC PiraeusU Node Helpdesk added a comment -

        Please send the answer to this request to dario.pellegrino@eng.it

        Show
        UPRC PiraeusU Node Helpdesk added a comment - Please send the answer to this request to dario.pellegrino@eng.it

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: