Dear node team,

Could you provide some assistance to this FI-ADOPT SME?

They find the performance of the Object storage quite slow. i.e. for an 18 MB file the average load time is 7 minutes.

Is this the expected performance values? or are there any issues at the moment with the Object storage installation on budapest node?

Many thanks for your help,

ilknur

Dear Massimo and Ilknur,

Sorry for the delay. The time you mentioned is extremaly high. We have started identifying the problem and localizing the bottleneck. We will come back with the answer soon.

Thanks you for reporting the issue!

Best,
Sandor

Dear Sandor,

Have you been able to find the problem/solution regarding this? many thanks again,

ilknur

Dear Sandor,

Any updates? Many thanks again..

Dear All,

One of my colleague checked it and we do not managed to reproduce this large latencies you experience. We tried the object storage service from different locations. Could you please elaborate more on how do you use this service? From which IP address/domain do you want to access?

Any additional information is welcomed that help us to reproduce the issue.

Best,
Sandor

Dear Massimo,

Here is an inquiry from the Budapest node team. could you kindly provide us more info?

"Dear All,
One of my colleague checked it and we do not managed to reproduce this large latencies you experience. We tried the object storage service from different locations. Could you please elaborate more on how do you use this service? From which IP address/domain do you want to access?
Any additional information is welcomed that help us to reproduce the issue.
Best,
Sandor"

Thanks,

ilknur

Hi Massimo,

Can you please provide your comments for the question below?

Dear Massimo,

Can you please provide the information requested by the Budapest Node team below?

??"Dear All,
One of my colleague checked it and we do not managed to reproduce this large latencies you experience. We tried the object storage service from different locations. Could you please elaborate more on how do you use this service? From which IP address/domain do you want to access?
Any additional information is welcomed that help us to reproduce the issue.

Best,

Sandor"??

Regards,

Burak

Hello
I apologize for the delay in the response but I have been absent for
problems.

The tests I made ​​through a virtual machine created under the node of
budapest and responsible to this address 148.6.81.194.

Other tests I have done from the office computer with adsl 7 mb and use of
the client restclient - ui 3.5 - jar with- dependencies.jar
probably our ADSL line has a slow upload it does not know if this
information you might find helpful . I thank you and I apologize for the
delayed response.

Thankyou
Massimo Corna

–

Massimo Corna
Developer

Krill Srl
Via Copernico, 38
20125 Milano
Tel: +39 02 8907 5413
Fax: +39 02 3206 6978
Mob: +39 393 911 3793
Skype: massimo.corna
http://www. <http://www.e-levelcom.com/>krill.eu

Please consider the environment before printing this e-mail.
This email and any attachments are confidential to the intended recipient
and may also be privileged. If you are not the intended recipient please
delete it from your system and notify the sender. You should not copy it or
use it for any purpose nor disclose or distribute its contents to any other
person. Any improper use of this email and its attachments will lead to the
person responsible having to deal with all the associated civil and
criminal consequences of their actions (Legislative Decree 196/03 and
Directive 2002/58/EC). The sender shall not be liable for the improper or
incomplete transmission of the information contained in this communication
nor for any delay in its receipt or damage to your system. The sender does
not guarantee that the integrity of this communication has been maintained
nor that this communication is free of viruses, interceptions or
interference.

Hi Massimo,

Thank you for the information.

With a 1Mbps upload rate, "ideally" you should be able to upload a 18MB file in 3 to 4 minutes.

Can you please clarify if 7Mbps is the download or upload rate of your ADSL connection? And if it is your download rate can you please tell us the upload rate? It would be helpful for the node to figure out what is wrong.

Regards,

Burak

I did a speed test of my ADSL and upload the needed results is 0.5 mbps .
But I do not know the speed of the virtual server that I created on the
fiware lab budapest node . It seems to me that the virtual machine network
speed is low . Our app teachbyapp server side that communicates with
objectstorage is currently installed on the virtual server fiware lab
budapest node.

Thankyou
Massimo corna

–

Massimo Corna
Developer

Krill Srl
Via Copernico, 38
20125 Milano
Tel: +39 02 8907 5413
Fax: +39 02 3206 6978
Mob: +39 393 911 3793
Skype: massimo.corna
http://www. <http://www.e-levelcom.com/>krill.eu

Please consider the environment before printing this e-mail.
This email and any attachments are confidential to the intended recipient
and may also be privileged. If you are not the intended recipient please
delete it from your system and notify the sender. You should not copy it or
use it for any purpose nor disclose or distribute its contents to any other
person. Any improper use of this email and its attachments will lead to the
person responsible having to deal with all the associated civil and
criminal consequences of their actions (Legislative Decree 196/03 and
Directive 2002/58/EC). The sender shall not be liable for the improper or
incomplete transmission of the information contained in this communication
nor for any delay in its receipt or damage to your system. The sender does
not guarantee that the integrity of this communication has been maintained
nor that this communication is free of viruses, interceptions or
interference.

Hi Massimo,

I see, so you are uploading a file from a VM, which is on Fiware Lab, to the Object Storage. In this case, your office network speed seems to be irrelevant.

Can you please try and see if you can reproduce the same issue? And if you are able to do so, can you please give us a detailed explanation of your operations? A step by step description would be perfect.

@Sandor do you need any further information from Massimo?

Regards,

Burak

I thank you for your reply
as soon as I can I will build a test method with Node.js ( we use this
technology to develop our teachbyapp ) that takes a file in virtual machine
(in fiware lab) and upload in object storage , I hope next week ( I have
many commitments ) , once that i will send you the source code and all the
steps .
Thank you for the support you are giving me.

Massimo Corna

–

Massimo Corna
Developer

Krill Srl
Via Copernico, 38
20125 Milano
Tel: +39 02 8907 5413
Fax: +39 02 3206 6978
Mob: +39 393 911 3793
Skype: massimo.corna
http://www. <http://www.e-levelcom.com/>krill.eu

Please consider the environment before printing this e-mail.
This email and any attachments are confidential to the intended recipient
and may also be privileged. If you are not the intended recipient please
delete it from your system and notify the sender. You should not copy it or
use it for any purpose nor disclose or distribute its contents to any other
person. Any improper use of this email and its attachments will lead to the
person responsible having to deal with all the associated civil and
criminal consequences of their actions (Legislative Decree 196/03 and
Directive 2002/58/EC). The sender shall not be liable for the improper or
incomplete transmission of the information contained in this communication
nor for any delay in its receipt or damage to your system. The sender does
not guarantee that the integrity of this communication has been maintained
nor that this communication is free of viruses, interceptions or
interference.

Hi Massimo,

No problem, we are here to help.

We will be looking forward for your updates.

Regards,

Burak

Dear Massimo,

Were you able produce a test case?

We will close the ticket if we do not hear back from you until next Tuesday.

Kind regards,

ilknur

Good morning
I apologize for the delay but I'm very busy on the various projects. I did
a further test using the code you find below developed with Node Js
technology. I loaded in object storage a 1.6 MB file in 36 seconds and a
4.1 MB file in 1 minute and 40 seconds.

It seems to me than when I had made test ,the situation has greatly
improved.

This is the code that I used for testing

function uploadobject(usr, dir, filename, response) {
var init = new Date().getTime();
console.log("Start");
var body = JSON.stringify({
auth: {
tenantId: tenantId,
passwordCredentials:

},
});
var options = {
hostname: 'cloud.lab.fi-ware.org',
port: 4730,
path: '/v2.0/tokens',
method: 'POST',
headers:

};
var req2 = http.request(options, function (res2) {
var data = '';
res2.setEncoding('utf8');
res2.on('data', function (chunk)

);
res2.on('end', function () {
if (res2.statusCode == 200) {
var resu = JSON.parse(data);
var token = resu.access.token.id;
//upload file to objectstorage
var file = fs.createReadStream(dir + '/' + filename)
.pipe(request.put({
url: '
http://148.6.80.5:8080/v1/AUTH_6b5e128ba10b47cc905b1ad66fd01c4f/' + usr +
"/" + filename,
headers:

}, function (err, res, body) {
if (err)

else {
//console.log('status', res.statusCode);
if (res.statusCode === 201) {
console.log("Finish");
var finit = new Date().getTime();
console.log(finit-init);
//elimino il file zip nella directory
temporanea
fs.unlink(dir + '/' + filename,
function ()

);
} else

}
}));

} else

});

});
req2.write(body);
req2.end();
}

For me now, the situation would be fine.

Thank you so much for your time and help

Massimo Corna

–

Massimo Corna
Developer

Krill Srl
Via Copernico, 38
20125 Milano
Tel: +39 02 8907 5413
Fax: +39 02 3206 6978
Mob: +39 393 911 3793
Skype: massimo.corna
http://www. <http://www.e-levelcom.com/>krill.eu

Please consider the environment before printing this e-mail.
This email and any attachments are confidential to the intended recipient
and may also be privileged. If you are not the intended recipient please
delete it from your system and notify the sender. You should not copy it or
use it for any purpose nor disclose or distribute its contents to any other
person. Any improper use of this email and its attachments will lead to the
person responsible having to deal with all the associated civil and
criminal consequences of their actions (Legislative Decree 196/03 and
Directive 2002/58/EC). The sender shall not be liable for the improper or
incomplete transmission of the information contained in this communication
nor for any delay in its receipt or damage to your system. The sender does
not guarantee that the integrity of this communication has been maintained
nor that this communication is free of viruses, interceptions or
interference.

Hi Massimo,

Thank you for the test case. I am not very clear about the next steps though. Do you mean to say you are ok now with the performance of the Object storage? Should we close the ticket? or do you still need further investigation?

Thankyou for me now is ok for the performance of the Object storage you
close the ticket.

Thankyou very much

Bye

Ing.Massimo Corna

–

Massimo Corna
Developer

Krill Srl
Via Copernico, 38
20125 Milano
Tel: +39 02 8907 5413
Fax: +39 02 3206 6978
Mob: +39 393 911 3793
Skype: massimo.corna
http://www. <http://www.e-levelcom.com/>krill.eu

Please consider the environment before printing this e-mail.
This email and any attachments are confidential to the intended recipient
and may also be privileged. If you are not the intended recipient please
delete it from your system and notify the sender. You should not copy it or
use it for any purpose nor disclose or distribute its contents to any other
person. Any improper use of this email and its attachments will lead to the
person responsible having to deal with all the associated civil and
criminal consequences of their actions (Legislative Decree 196/03 and
Directive 2002/58/EC). The sender shall not be liable for the improper or
incomplete transmission of the information contained in this communication
nor for any delay in its receipt or damage to your system. The sender does
not guarantee that the integrity of this communication has been maintained
nor that this communication is free of viruses, interceptions or
interference.