Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
python question: sync big object tree between processes?
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
fpemud
Guru
Guru


Joined: 15 Feb 2012
Posts: 349

PostPosted: Mon Jun 17, 2013 11:45 am    Post subject: python question: sync big object tree between processes? Reply with quote

I want to sync a big object tree between two processes, the sync is one way, from proc A to proc B.
Changes to the object tree are small, frequent and in transaction.

How do I do this effectively?
In fact proc A is using zodb for object tree management and persistent.

The simplest solution comes into my head currently is to transfer delta of object tree.
Is there any lib to do that?

The two processes can be on same PC or different PC connected by network.
I want it be more effecient when on same machine.
So I must use socket in the different PC case, and switch to use shared memory in the same PC case?
Back to top
View user's profile Send private message
vaxbrat
l33t
l33t


Joined: 05 Oct 2005
Posts: 731
Location: DC Burbs

PostPosted: Fri Jun 21, 2013 9:21 pm    Post subject: you probably want to do message passing Reply with quote

You might want to look into a publish/subscribe message passing model with something like http://www.zeromq.org/ for the transport. Use this to notify object transactions from A to B.
Back to top
View user's profile Send private message
dol-sen
Retired Dev
Retired Dev


Joined: 30 Jun 2002
Posts: 2805
Location: Richmond, BC, Canada

PostPosted: Sun Jun 23, 2013 7:23 am    Post subject: Reply with quote

There is also dev-python/pydispatcher for passing info around.
_________________
Brian
Porthole, the Portage GUI frontend irc@freenode: #gentoo-guis, #porthole, Blog
layman, gentoolkit, CoreBuilder, esearch...
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum