Avatar

Please consider registering
guest

sp_LogInOut Log In sp_Registration Register

Register | Lost password?
Advanced Search

— Forum Scope —




— Match —





— Forum Options —





Minimum search word length is 3 characters - maximum search word length is 84 characters

sp_Feed Topic RSS sp_TopicIcon
Slow subscription updates in a big system
February 2, 2015
23:17, EET
Avatar
David
Member
Members
Forum Posts: 14
Member Since:
July 22, 2014
sp_UserOfflineSmall Offline

Hi,

I have a server and a client both implemented with Prosys SDK. I have many data points grouped in 20 subscriptions. There are more or less 2500 monitored data points in each subscription. This results in a very slowly updated system

The thing is, trying to speed up things I have implemented each listener in a different thread, but the result is almost the same as if everything was in a single thread, it updates very slowly. Is this normal? Debugging II’ve seen a single ‘PublishTask’ thread. Does it means that the system will update as single-threaded? Is there any way to speed this up?

Thank you very much in advance,

David

February 3, 2015
10:22, EET
Avatar
Jouni Aro
Moderator
Moderators
Forum Posts: 1026
Member Since:
December 21, 2011
sp_UserOfflineSmall Offline

The client is using several threads for the communications. The PublishTask is used to drain incoming notifications from the incoming data buffer independent of the communication threads. But the slowness may very probably originate from the server. Or have you been able to analyse the performance of your client application any more. If the incoming buffer overflows, you will get an onBufferOverflow notification to the SubscriptionNotificationListener, which you can add to the subscriptions. This will be a real indicator that the client side cannot handle data as fast as it is coming in from the server.

Which server are you connecting to?

February 3, 2015
10:46, EET
Avatar
David
Member
Members
Forum Posts: 14
Member Since:
July 22, 2014
sp_UserOfflineSmall Offline

Hi, thank you for our answer.

I am connecting to a server developed with the Prosys SDK 2.0.2-275.

In fact I got buffer overflows, so I had to raise the default NotificationBufferSize to avoid these overflows. Now I don’t get any of these.

February 3, 2015
15:05, EET
Avatar
Jouni Aro
Moderator
Moderators
Forum Posts: 1026
Member Since:
December 21, 2011
sp_UserOfflineSmall Offline

OK, sounds like your client application doesn’t manage to handle the changes fast enough. What kind of action do you perform in the change handlers yourself? Can you profile the application to find out where the actual bottle neck is?

In practice, it may not be fatal, if the data is handled with a delay, as long as everything is handled. Unless of course you need to react to the changes somehow with a certain response time.

February 4, 2015
18:37, EET
Avatar
David
Member
Members
Forum Posts: 14
Member Since:
July 22, 2014
sp_UserOfflineSmall Offline

I’ve made some tests and now it’s clear that my client application processing has a bottleneck. If I only get notified of the change in the subsctipion, the application runs very fat. But when I try to make my processing it goes very slow for 2800 data points. So I will have to upgrade my processes.

Thank you very much for your explanation.

Regards

February 5, 2015
8:30, EET
Avatar
Jouni Aro
Moderator
Moderators
Forum Posts: 1026
Member Since:
December 21, 2011
sp_UserOfflineSmall Offline

OK, thanks for the note. Good to hear that you found the problem.

Forum Timezone: Europe/Helsinki

Most Users Ever Online: 1919

Currently Online:
22 Guest(s)

Currently Browsing this Page:
1 Guest(s)

Top Posters:

Heikki Tahvanainen: 402

hbrackel: 144

rocket science: 88

pramanj: 86

Francesco Zambon: 83

Ibrahim: 78

Sabari: 62

kapsl: 57

gjevremovic: 49

Xavier: 43

Member Stats:

Guest Posters: 0

Members: 738

Moderators: 7

Admins: 1

Forum Stats:

Groups: 3

Forums: 15

Topics: 1524

Posts: 6451

Newest Members:

jonathonmcintyre, fannielima, kristiewinkle8, rust, christamcdowall, redaahern07571, nigelbdhmp, travistimmons, AnnelCib, dalenegettinger

Moderators: Jouni Aro: 1026, Pyry: 1, Petri: 0, Bjarne Boström: 1026, Jimmy Ni: 26, Matti Siponen: 346, Lusetti: 0

Administrators: admin: 1