Ticket #52 (new idea)

Opened 6 years ago

Last modified 6 years ago

explore more scalable parallel mapping algorithm

Reported by: mmckerns Owned by: mmckerns
Priority: minor Milestone: pathos-dev
Component: pyina Keywords:


explore the potentially more scalable parallel mapping algorithm idea Michael Aivazis sent me:

The basic idea is to form a ring of managers that maintain a distributed
worklist. Each of the managers manages some workers that can pull
work off the list by reserving a task (which allows you to communicate
that it is going to be worked on), followed by actually being assigned the
task by their local manager.  The improvement is in breaking the task
assignment in two and allowing the manager ring to synchronize their
view of the global task list.

Change History

comment:1 Changed 6 years ago by mmckerns

moved from  mystic ticket #57

Note: See TracTickets for help on using tickets.