Details
-
Type:
Monitor
-
Status: Closed
-
Priority:
Major
-
Resolution: Done
-
Affects Version/s: None
-
Fix Version/s: 2021
-
Component/s: FIWARE-TECH-HELP
-
Labels:
-
HD-Enabler:Orion
Description
Created question in FIWARE Q/A platform on 17-12-2018 at 16:12
Please, ANSWER this question AT https://stackoverflow.com/questions/53818381/how-can-i-improve-socket-hang-up-when-connecting-many-devices
Question:
How can I improve socket hang up when connecting many devices?
Description:
I am testing to connect many devices to FIWARE in the following environment.
Each component is deployed in a container on a physical server.
-------------------------------------------------
| Comet - Cygnus - Orion - IoTAgentJSON - Mosquitto |
|
Under the condition that each device transmits data at 1 msg/sec, the following error occurs at IoTAgent when the number of devices is 350.(That is, 350 msg/sec)
{"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentNGSI.NGSIService | srv=n/a | subsrv=n/a | msg=Error found executing update action in Context Broker: Error: socket hang up | comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.81037597Z"}{"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentNGSI.Alarms | srv=n/a | subsrv=n/a | msg=Raising [ORION-ALARM]:
{\"code\":\"ECONNRESET\"}| comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.810440213Z"}
{"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentJSON.MQTTBinding | srv=n/a | subsrv=n/a | msg=MEASURES-002: Couldn't send the updated values to the Context Broker due to an error: Error: socket hang up | comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.810526916Z"}Question 1: Where is the cause? IoTAgent? Or Orion?
Error found executing update action in Context Broker: Error: socket hang up but there is no error log displayed in Orion.
Question 2: How can I improve the processing performance of FIWARE?
Do you need the scale of IoTAgent?
Do you need to consider Orion's parameters?
I need to consider values such as reqPoolSize and maxConnections with reference to the following URL?
https://fiware-orion.readthedocs.io/en/master/admin/perf_tuning/#http-server-tuning
Do you need the scale of Orion?
How to scale Orion GE?
Question 3: Is there a batch operation on IoT Agent?
On the following page, you should do a batch operation instead of opening a new connection for each entity, but is there such a function in IoTAgent?
ECONNRESET when opening a large number of connection in small time period
Activity
| Transition | Time In Source Status | Execution Times | Last Executer | Last Execution Date | |||||
|---|---|---|---|---|---|---|---|---|---|
|
4d 3h | 1 | Backlog Manager | 21/Dec/18 9:05 PM | |||||
|
2h 59m | 1 | Backlog Manager | 22/Dec/18 12:05 AM | |||||
|
20d 17h 17m | 1 | Jose Manuel Cantera | 11/Jan/19 5:23 PM |
| Fix Version/s | 2021 [ 12600 ] |
| Resolution | Done [ 10000 ] | |
| Status | Answered [ 10104 ] | Closed [ 6 ] |
| Status | In Progress [ 3 ] | Answered [ 10104 ] |
2018-12-21 21:05|UPDATED status: transition Answer| # answers= 1, accepted answer= False
| Status | Open [ 1 ] | In Progress [ 3 ] |
| HD-Enabler | Orion [ 10875 ] | |
| Description |
Created question in FIWARE Q/A platform on 17-12-2018 at 16:12 {color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/53818381/how-can-i-improve-socket-hang-up-when-connecting-many-devices +Question:+ How can I improve socket hang up when connecting many devices? +Description:+ I am testing to connect many devices to FIWARE in the following environment. Each component is deployed in a container on a physical server. +-------------------------------------------------+ |Comet - Cygnus - Orion - IoTAgentJSON - Mosquitto| - device*N +-------------------------------------------------+ Under the condition that each device transmits data at 1 msg/sec, the following error occurs at IoTAgent when the number of devices is 350.(That is, 350 msg/sec) {"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentNGSI.NGSIService | srv=n/a | subsrv=n/a | msg=Error found executing update action in Context Broker: Error: socket hang up | comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.81037597Z"} {"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentNGSI.Alarms | srv=n/a | subsrv=n/a | msg=Raising [ORION-ALARM]: {\"code\":\"ECONNRESET\"} | comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.810440213Z"} {"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentJSON.MQTTBinding | srv=n/a | subsrv=n/a | msg=MEASURES-002: Couldn't send the updated values to the Context Broker due to an error: Error: socket hang up | comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.810526916Z"} Question 1: Where is the cause? IoTAgent? Or Orion? Error found executing update action in Context Broker: Error: socket hang up but there is no error log displayed in Orion. Question 2: How can I improve the processing performance of FIWARE? Do you need the scale of IoTAgent? Do you need to consider Orion's parameters? I need to consider values such as reqPoolSize and maxConnections with reference to the following URL? https://fiware-orion.readthedocs.io/en/master/admin/perf_tuning/#http-server-tuning Do you need the scale of Orion? How to scale Orion GE? Question 3: Is there a batch operation on IoT Agent? On the following page, you should do a batch operation instead of opening a new connection for each entity, but is there such a function in IoTAgent? ECONNRESET when opening a large number of connection in small time period |
Created question in FIWARE Q/A platform on 17-12-2018 at 16:12
{color: red}Please, ANSWER this question AT{color} https://stackoverflow.com/questions/53818381/how-can-i-improve-socket-hang-up-when-connecting-many-devices +Question:+ How can I improve socket hang up when connecting many devices? +Description:+ I am testing to connect many devices to FIWARE in the following environment. Each component is deployed in a container on a physical server. +-------------------------------------------------+ |Comet - Cygnus - Orion - IoTAgentJSON - Mosquitto| - device*N +-------------------------------------------------+ Under the condition that each device transmits data at 1 msg/sec, the following error occurs at IoTAgent when the number of devices is 350.(That is, 350 msg/sec) {"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentNGSI.NGSIService | srv=n/a | subsrv=n/a | msg=Error found executing update action in Context Broker: Error: socket hang up | comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.81037597Z"} {"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentNGSI.Alarms | srv=n/a | subsrv=n/a | msg=Raising [ORION-ALARM]: {\"code\":\"ECONNRESET\"} | comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.810440213Z"} {"log":"time=2018-12-16T14:57:24.810Z | lvl=ERROR | corr=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | trans=ec11c37f-5194-4cb3-8d79-e04a2d1e745c | op=IoTAgentJSON.MQTTBinding | srv=n/a | subsrv=n/a | msg=MEASURES-002: Couldn't send the updated values to the Context Broker due to an error: Error: socket hang up | comp=IoTAgent\n","stream":"stdout","time":"2018-12-16T14:57:24.810526916Z"} Question 1: Where is the cause? IoTAgent? Or Orion? Error found executing update action in Context Broker: Error: socket hang up but there is no error log displayed in Orion. Question 2: How can I improve the processing performance of FIWARE? Do you need the scale of IoTAgent? Do you need to consider Orion's parameters? I need to consider values such as reqPoolSize and maxConnections with reference to the following URL? https://fiware-orion.readthedocs.io/en/master/admin/perf_tuning/#http-server-tuning Do you need the scale of Orion? How to scale Orion GE? Question 3: Is there a batch operation on IoT Agent? On the following page, you should do a batch operation instead of opening a new connection for each entity, but is there such a function in IoTAgent? ECONNRESET when opening a large number of connection in small time period |
| Assignee | Jose Manuel Cantera [ jmcantera ] |
| Field | Original Value | New Value |
|---|---|---|
| Component/s | FIWARE-TECH-HELP [ 10278 ] |
2018-12-17 18:05|CREATED monitor | # answers= 0, accepted answer= False
2018-12-22 00:05|UPDATED status: transition Answered| # answers= 1, accepted answer= False