Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-1470

FIWARE.Request.Tech.Data.BigData-Analysis.SharkConnectionTimeout

        Details

          Description

          Dear Sergio, Francisco,
          from this morning we have been facing a connection timeout on Cosmos instance.
          Could you please solve the issue?
          Waiting for your feedback, thank you in advance.
          BR,
          Dario

          Dario Pellegrino
          Direzione Ricerca e Innovazione - R&D Lab
          dario.pellegrino@eng.it<dario.pellegrino@eng.it>

          Engineering Ingegneria Informatica spa
          Viale Regione Siciliana, 7275 - 90146 Palermo
          Tel. +39-091.7511847
          Mob. +39-346.5325257
          www.eng.it<http://www.eng.it/>

          Da: Pellegrino Dario
          Inviato: giovedì 13 novembre 2014 09:43
          A: 'JOSE IGNACIO CARRETERO GUARDE'; Massimiliano Nigrelli; FRANCISCO ROMERO BUENO
          Cc: Leandro Lombardo; Luigi Briguglio; fiware-lab-help@lists.fi-ware.org; Pasquale Andriani
          Oggetto: R: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Very Slow Shark connection

          Hi Jose,
          nothing has changed, we have been having the same connection problem (connection refused).
          I think shark/spark service is down.
          Waiting for your feedback, thank you in advanced.
          BR,
          Dario Pellegrino

          Dario Pellegrino
          Direzione Ricerca e Innovazione - R&D Lab
          dario.pellegrino@eng.it<dario.pellegrino@eng.it>

          Engineering Ingegneria Informatica spa
          Viale Regione Siciliana, 7275 - 90146 Palermo
          Tel. +39-091.7511847
          Mob. +39-346.5325257
          www.eng.it<http://www.eng.it/>

          Da: JOSE IGNACIO CARRETERO GUARDE joseignacio.carreteroguarde@telefonica.com
          Inviato: mercoledì 12 novembre 2014 19:48
          A: Massimiliano Nigrelli; FRANCISCO ROMERO BUENO
          Cc: Leandro Lombardo; Luigi Briguglio; Pellegrino Dario; fiware-lab-help@lists.fi-ware.org<fiware-lab-help@lists.fi-ware.org>; Pasquale Andriani
          Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Very Slow Shark connection

          Dear Massimiliano,

          I've been trying to improve our (Spain node) network performance — I think it is a little bit better now.

          Best regards,
          José Ignacio.
          El 11/11/14 a las 16:28, Massimiliano Nigrelli escribió:
          Dear Francisco,
          I have written on Stack Overflow (https://stackoverflow.com/questions/26867234/fiware-ge-cosmos-shark-is-not-working), I have just sent you two emails and I am trying again.

          Could you please solve the issue related to Shark?
          We are close to a review and no data can be retrieved from COSMOS, at all.

          I hope you to let us know asap.

          Regards,

          Massimiliano
          Il 11/11/2014 09:46, Massimiliano Nigrelli ha scritto:
          Dear Francisco,
          now it turned to no connection. SHARK seems to be stuck.

          I kindly ask you to solve the issue and I would like to remind you that next week we will be in Aachen in front of the commission for 3rd FINESCE Review.

          Regards,

          Massimiliano
          Il 10/11/2014 15:09, Pellegrino Dario ha scritto:
          Hi Francisco,
          from this morning we have been a connection issue on COSMOS (the query response time is very high!!!).
          Are you doing a maintenance activity?
          Waiting for you feedback, thank you in advanced.
          Regards,
          Dario

          Dario Pellegrino
          Direzione Ricerca e Innovazione - R&D Lab
          dario.pellegrino@eng.it<dario.pellegrino@eng.it>

          Engineering Ingegneria Informatica spa
          Viale Regione Siciliana, 7275 - 90146 Palermo
          Tel. +39-091.7511847
          Mob. +39-346.5325257
          www.eng.it<http://www.eng.it/>

          –

          ===============================================================

          Massimiliano Nigrelli - R&D Lab

          Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

          Phone: +39 091.75.11.847

          ============================================================

          –

          ===============================================================

          Massimiliano Nigrelli - R&D Lab

          Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

          Phone: +39 091.75.11.847

          ============================================================

          _______________________________________________

          Fiware-lab-help mailing list

          Fiware-lab-help@lists.fi-ware.org<Fiware-lab-help@lists.fi-ware.org>

          https://lists.fi-ware.org/listinfo/fiware-lab-help

          ________________________________

          Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de que la lectura, utilización, divulgación y/o copia sin autorización puede estar prohibida en virtud de la legislación vigente. Si ha recibido este mensaje por error, le rogamos que nos lo comunique inmediatamente por esta misma vía y proceda a su destrucción.

          The information contained in this transmission is privileged and confidential information intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this transmission in error, do not read it. Please immediately reply to the sender that you have received this communication in error and then delete it.

          Esta mensagem e seus anexos se dirigem exclusivamente ao seu destinatário, pode conter informação privilegiada ou confidencial e é para uso exclusivo da pessoa ou entidade de destino. Se não é vossa senhoria o destinatário indicado, fica notificado de que a leitura, utilização, divulgação e/ou cópia sem autorização pode estar proibida em virtude da legislação vigente. Se recebeu esta mensagem por erro, rogamos-lhe que nos o comunique imediatamente por esta mesma via e proceda a sua destruição

          _______________________________________________
          Fiware-lab-help mailing list
          Fiware-lab-help@lists.fi-ware.org
          https://lists.fi-ware.org/listinfo/fiware-lab-help

          [Created via e-mail received from: Pellegrino Dario <dario.pellegrino@eng.it>]

            Activity

            Ascending order - Click to sort in descending order
            fw.ext.user FW External User created issue -
            UPRC PiraeusU Node Helpdesk made changes -
            Field Original Value New Value
            Assignee Francisco Romero Bueno [ frb ]
            Hide
            Permalink
            UPRC PiraeusU Node Helpdesk added a comment -

            Please send the answer to this request to dario.pellegrino@eng.it

            Show
            UPRC PiraeusU Node Helpdesk added a comment - Please send the answer to this request to dario.pellegrino@eng.it
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            Any news on the issue?

            Shark is still not working.

            Could you please let us know what is happening?

            Regards,

            Massimiliano

            –
            ===============================================================

            Massimiliano Nigrelli - R&D Lab

            Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

            Phone: +39 091.75.11.847

            ============================================================

            _______________________________________________
            Fiware-lab-help mailing list
            Fiware-lab-help@lists.fi-ware.org
            https://lists.fi-ware.org/listinfo/fiware-lab-help

            Show
            fw.ext.user FW External User added a comment - Any news on the issue? Shark is still not working. Could you please let us know what is happening? Regards, Massimiliano – =============================================================== Massimiliano Nigrelli - R&D Lab Viale Regione Siciliana 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            Again, any news?

            Shark DOES NOT WORK!!!!!!!!!

            Have you got an idea of when it will be available again?

            Massimiliano

            –
            ===============================================================

            Massimiliano Nigrelli - R&D Lab

            Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

            Phone: +39 091.75.11.847

            ============================================================

            _______________________________________________
            Fiware-lab-help mailing list
            Fiware-lab-help@lists.fi-ware.org
            https://lists.fi-ware.org/listinfo/fiware-lab-help

            Show
            fw.ext.user FW External User added a comment - Again, any news? Shark DOES NOT WORK!!!!!!!!! Have you got an idea of when it will be available again? Massimiliano – =============================================================== Massimiliano Nigrelli - R&D Lab Viale Regione Siciliana 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            Dear Sergio, Dear Francisco,
            I keep on asking about when Shark will be available
            again............with no getting any answer.

            It would be really "nice and polite" if you would reply to the "tons" of
            email we have been sending in the last weeks.
            Even by saying........"There is an issue......We have been working on it".

            In front of the FINESCE reviewers (actually one is a FIWARE reviewer,
            too!) we have highlighted the importance of having a point of contact
            when considering GEs compared to alternative products on the market.
            So, please, reply!

            Regards,

            Massimiliano

            –
            ===============================================================

            Massimiliano Nigrelli - R&D Lab

            Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

            Phone: +39 091.75.11.847

            ============================================================

            _______________________________________________
            Fiware-lab-help mailing list
            Fiware-lab-help@lists.fi-ware.org
            https://lists.fi-ware.org/listinfo/fiware-lab-help

            Show
            fw.ext.user FW External User added a comment - Dear Sergio, Dear Francisco, I keep on asking about when Shark will be available again............with no getting any answer. It would be really "nice and polite" if you would reply to the "tons" of email we have been sending in the last weeks. Even by saying........"There is an issue......We have been working on it". In front of the FINESCE reviewers (actually one is a FIWARE reviewer, too!) we have highlighted the importance of having a point of contact when considering GEs compared to alternative products on the market. So, please, reply! Regards, Massimiliano – =============================================================== Massimiliano Nigrelli - R&D Lab Viale Regione Siciliana 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
            Hide
            Permalink
            fw.ext.user FW External User added a comment -

            To whom it may concern,
            following all the emails (shown below), I would like to highlight a big
            issue related to the Shark interface of COSMOS.

            Shark is not available so it is not possible to execute SQL-like queries
            to retrieve data stored on COSMOS.
            It has been down since last Monday (Nov 24th), while we were having the
            3rd FINESCE review in Aachen.

            PLEASE, could someone let us know what is happening?

            Regards,

            Massimiliano

            -------- Messaggio Inoltrato --------
            Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Shark connection
            timeout
            Data: Wed, 26 Nov 2014 09:39:03 +0100
            Mittente: Massimiliano Nigrelli <massimiliano.nigrelli@eng.it>
            A: Pellegrino Dario <dario.pellegrino@eng.it>, SERGIO GARCIA GOMEZ
            (sergio.garciagomez@telefonica.com) <sergio.garciagomez@telefonica.com>,
            FRANCISCO ROMERO BUENO <francisco.romerobueno@telefonica.com>
            CC: Leandro Lombardo <Leandro.Lombardo@eng.it>, Luigi Briguglio
            <luigi.briguglio@eng.it>, fiware-lab-help@lists.fi-ware.org
            <fiware-lab-help@lists.fi-ware.org>, Pasquale Andriani
            <pasquale.andriani@eng.it>

            Dear Sergio, Dear Francisco,
            I keep on asking about when Shark will be available
            again............with no getting any answer.

            It would be really "nice and polite" if you would reply to the "tons" of
            email we have been sending in the last weeks.
            Even by saying........"There is an issue......We have been working on it".

            In front of the FINESCE reviewers (actually one is a FIWARE reviewer,
            too!) we have highlighted the importance of having a point of contact
            when considering GEs compared to alternative products on the market.
            So, please, reply!

            Regards,

            Massimiliano

            –
            ===============================================================

            Massimiliano Nigrelli - R&D Lab

            Viale Regione Siciliana 7275 - 90146 Palermo (Italy)

            Phone: +39 091.75.11.847

            ============================================================

            _______________________________________________
            Fiware-lab-help mailing list
            Fiware-lab-help@lists.fi-ware.org
            https://lists.fi-ware.org/listinfo/fiware-lab-help

            Show
            fw.ext.user FW External User added a comment - To whom it may concern, following all the emails (shown below), I would like to highlight a big issue related to the Shark interface of COSMOS. Shark is not available so it is not possible to execute SQL-like queries to retrieve data stored on COSMOS. It has been down since last Monday (Nov 24th), while we were having the 3rd FINESCE review in Aachen. PLEASE, could someone let us know what is happening? Regards, Massimiliano -------- Messaggio Inoltrato -------- Oggetto: Re: [Fiware-lab-help] [FINESCE-WP4] COSMOS : Shark connection timeout Data: Wed, 26 Nov 2014 09:39:03 +0100 Mittente: Massimiliano Nigrelli <massimiliano.nigrelli@eng.it> A: Pellegrino Dario <dario.pellegrino@eng.it>, SERGIO GARCIA GOMEZ (sergio.garciagomez@telefonica.com) <sergio.garciagomez@telefonica.com>, FRANCISCO ROMERO BUENO <francisco.romerobueno@telefonica.com> CC: Leandro Lombardo <Leandro.Lombardo@eng.it>, Luigi Briguglio <luigi.briguglio@eng.it>, fiware-lab-help@lists.fi-ware.org <fiware-lab-help@lists.fi-ware.org>, Pasquale Andriani <pasquale.andriani@eng.it> Dear Sergio, Dear Francisco, I keep on asking about when Shark will be available again............with no getting any answer. It would be really "nice and polite" if you would reply to the "tons" of email we have been sending in the last weeks. Even by saying........"There is an issue......We have been working on it". In front of the FINESCE reviewers (actually one is a FIWARE reviewer, too!) we have highlighted the importance of having a point of contact when considering GEs compared to alternative products on the market. So, please, reply! Regards, Massimiliano – =============================================================== Massimiliano Nigrelli - R&D Lab Viale Regione Siciliana 7275 - 90146 Palermo (Italy) Phone: +39 091.75.11.847 ============================================================ _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
            Hide
            Permalink
            fermin Fermín Galán added a comment -

            I have checked now (see comment date) that the shark process is up and running in the Cosmos machine:

            [root@cosmosmaster-gi ~]# ps -ef | grep shark | grep -v grep
            root 8948 1 1 Nov17 ? 03:55:02 /usr/java/jdk1.6.0_45//bin/java -Dspark.local.dir=/tmp -Dspark.kryoserializer.buffer.mb=10 -verbose:gc -XX:-PrintGCDetails -XX:+PrintGCTimeStamps -Djava.library.path= -Xms6g -Xmx6g shark.SharkServer

            Moreover, the Malaga Plague sample aplications (which is based on Shark) is working perfectly at: http://130.206.81.65/plague-tracker/

            Show
            fermin Fermín Galán added a comment - I have checked now (see comment date) that the shark process is up and running in the Cosmos machine: [root@cosmosmaster-gi ~] # ps -ef | grep shark | grep -v grep root 8948 1 1 Nov17 ? 03:55:02 /usr/java/jdk1.6.0_45//bin/java -Dspark.local.dir=/tmp -Dspark.kryoserializer.buffer.mb=10 -verbose:gc -XX:-PrintGCDetails -XX:+PrintGCTimeStamps -Djava.library.path= -Xms6g -Xmx6g shark.SharkServer Moreover, the Malaga Plague sample aplications (which is based on Shark) is working perfectly at: http://130.206.81.65/plague-tracker/
            Hide
            Permalink
            fermin Fermín Galán added a comment -

            As addiitonal info, spark process is also up and running:

            [root@cosmosmaster-gi ~]# ps ax | grep spark | grep -v grep
            8537 ? Sl 61:07 /usr/java/jdk1.6.0_45//bin/java -cp /usr/local/spark-0.8/tools/target/scala-2.9.3/spark-tools-assembly-0.8.1-incubating.jar::/usr/local/spark-0.8/conf:/usr/local/spark-0.8/assembly/target/scala-2.9.3/spark-assembly-0.8.1-incubating-hadoop0.20.2-cdh3u6.jar -Dspark.akka.logLifecycleEvents=true -Djava.library.path= -Xms512m -Xmx512m org.apache.spark.deploy.master.Master --ip cosmosmaster-gi --port 7077 --webui-port 8080
            8948 ? Sl 235:10 /usr/java/jdk1.6.0_45//bin/java -Dspark.local.dir=/tmp -Dspark.kryoserializer.buffer.mb=10 -verbose:gc -XX:-PrintGCDetails -XX:+PrintGCTimeStamps -Djava.library.path= -Xms6g -Xmx6g shark.SharkServer

            Show
            fermin Fermín Galán added a comment - As addiitonal info, spark process is also up and running: [root@cosmosmaster-gi ~] # ps ax | grep spark | grep -v grep 8537 ? Sl 61:07 /usr/java/jdk1.6.0_45//bin/java -cp /usr/local/spark-0.8/tools/target/scala-2.9.3/spark-tools-assembly-0.8.1-incubating.jar::/usr/local/spark-0.8/conf:/usr/local/spark-0.8/assembly/target/scala-2.9.3/spark-assembly-0.8.1-incubating-hadoop0.20.2-cdh3u6.jar -Dspark.akka.logLifecycleEvents=true -Djava.library.path= -Xms512m -Xmx512m org.apache.spark.deploy.master.Master --ip cosmosmaster-gi --port 7077 --webui-port 8080 8948 ? Sl 235:10 /usr/java/jdk1.6.0_45//bin/java -Dspark.local.dir=/tmp -Dspark.kryoserializer.buffer.mb=10 -verbose:gc -XX:-PrintGCDetails -XX:+PrintGCTimeStamps -Djava.library.path= -Xms6g -Xmx6g shark.SharkServer
            frb Francisco Romero made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            frb Francisco Romero made changes -
            Status In Progress [ 3 ] Answered [ 10104 ]
            frb Francisco Romero made changes -
            Resolution Done [ 10000 ]
            Status Answered [ 10104 ] Closed [ 6 ]
            mev Manuel Escriche made changes -
            Fix Version/s Sprint 4.1.3 [ 10739 ]
            mev Manuel Escriche made changes -
            Component/s FIWARE-LAB-HELP [ 10279 ]
            frb Francisco Romero made changes -
            Summary [Fiware-lab-help] [FINESCE-WP4] COSMOS : Shark connection timeout FIWARE.Request.Lab.Data.BigData-Analysis.SharkConnectionTimeout
            mev Manuel Escriche made changes -
            Component/s FIWARE-TECH-HELP [ 10278 ]
            Component/s FIWARE-LAB-HELP [ 10279 ]
            mev Manuel Escriche made changes -
            Summary FIWARE.Request.Lab.Data.BigData-Analysis.SharkConnectionTimeout FIWARE.Request.Tech.Data.BigData-Analysis.SharkConnectionTimeout
            mev Manuel Escriche made changes -
            Sender Email dario.pellegrino@eng.it
            mev Manuel Escriche made changes -
            HD-Enabler Cosmos [ 10872 ]
            HD-Chapter Data [ 10838 ]
            Transition Time In Source Status Execution Times Last Executer Last Execution Date
            Open Open In Progress In Progress
            		6d 22h 1 Francisco Romero 01/Dec/14 12:57 PM
            In Progress In Progress Answered Answered
            		8s 1 Francisco Romero 01/Dec/14 12:57 PM
            Answered Answered Closed Closed
            		13d 18h 56m 1 Francisco Romero 15/Dec/14 7:53 AM

              People

              • Assignee:
                frb Francisco Romero
                Reporter:
                fw.ext.user FW External User
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: