Multiple project processing...

Message boards : Number crunching : Multiple project processing...

To post messages, you must log in.

AuthorMessage
Profile Gen_X_Accord
Avatar

Send message
Joined: 5 Jun 06
Posts: 154
Credit: 279,018
RAC: 0
Message 23879 - Posted: 20 Aug 2006, 19:31:42 UTC

I just added World Community Grit to my Boinc program. It looks like a good one too. My question is...is it possible for the Boinc to run both Rosetta and the World Community Grid at the same time? And if so, how do I do that? It seems that the Boinc will only run one at time now. Is that what the preference option of "Switch between programs...60 min." means? Is it possible to run both at once?
ID: 23879 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile John Hunt
Avatar

Send message
Joined: 18 Sep 05
Posts: 446
Credit: 200,755
RAC: 0
Message 23882 - Posted: 20 Aug 2006, 19:34:24 UTC


The only way you can crunch two projects simultaneously is if you have two CPUs.
Check my profile, look at 'view computers' and you'll see what I mean.

My PC regularly crunches two totally different projects simultaneously!



ID: 23882 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile [B^S] thierry@home
Avatar

Send message
Joined: 17 Sep 05
Posts: 182
Credit: 281,902
RAC: 0
Message 23883 - Posted: 20 Aug 2006, 19:34:40 UTC

No, If you have only one CPU, it's one project after the other. And yes the" Switch between..." is the key to switch from one app to the other.
ID: 23883 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
John McLeod VII
Avatar

Send message
Joined: 17 Sep 05
Posts: 108
Credit: 195,137
RAC: 0
Message 23886 - Posted: 20 Aug 2006, 19:38:09 UTC

Also resource share dictates how much of your CPU time to give to each project over the long term. Example. Project A share 50 and Project B share 100. Project A will have the CPU 1/3 of the time and Project B will have the CPU 2/3 of the time. If possible, it will be 2 hours of B and 1 of A (depending on the switch time). If one of the projects has anticipated deadline trouble, that project will get extra CPU time now, but will not be allowed to download new work for some time in order to let the other project catch up on its CPU time.


BOINC WIKI
ID: 23886 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Tallbill

Send message
Joined: 23 Jul 06
Posts: 12
Credit: 101,854
RAC: 0
Message 23891 - Posted: 20 Aug 2006, 19:48:17 UTC - in response to Message 23886.  

Also resource share dictates how much of your CPU time to give to each project over the long term. Example. Project A share 50 and Project B share 100. Project A will have the CPU 1/3 of the time and Project B will have the CPU 2/3 of the time. If possible, it will be 2 hours of B and 1 of A (depending on the switch time). If one of the projects has anticipated deadline trouble, that project will get extra CPU time now, but will not be allowed to download new work for some time in order to let the other project catch up on its CPU time.



Thats pretty cool, I didn't know that. I just set one of my rigs onto 3 smaller projects to run for probably a year without me being able to touch them.
ID: 23891 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
John McLeod VII
Avatar

Send message
Joined: 17 Sep 05
Posts: 108
Credit: 195,137
RAC: 0
Message 23918 - Posted: 20 Aug 2006, 22:03:15 UTC - in response to Message 23891.  

Also resource share dictates how much of your CPU time to give to each project over the long term. Example. Project A share 50 and Project B share 100. Project A will have the CPU 1/3 of the time and Project B will have the CPU 2/3 of the time. If possible, it will be 2 hours of B and 1 of A (depending on the switch time). If one of the projects has anticipated deadline trouble, that project will get extra CPU time now, but will not be allowed to download new work for some time in order to let the other project catch up on its CPU time.



Thats pretty cool, I didn't know that. I just set one of my rigs onto 3 smaller projects to run for probably a year without me being able to touch them.

Thank you.

I was the developer that did most of the work on the current CPU scheduler.


BOINC WIKI
ID: 23918 · Rating: 1 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Gen_X_Accord
Avatar

Send message
Joined: 5 Jun 06
Posts: 154
Credit: 279,018
RAC: 0
Message 24011 - Posted: 21 Aug 2006, 5:18:45 UTC

Well phooy. I guess I'll just crunch Rossetta by itself then.
ID: 24011 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
John McLeod VII
Avatar

Send message
Joined: 17 Sep 05
Posts: 108
Credit: 195,137
RAC: 0
Message 24197 - Posted: 21 Aug 2006, 22:47:54 UTC - in response to Message 24011.  

Well phooy. I guess I'll just crunch Rossetta by itself then.

Always a choice.


BOINC WIKI
ID: 24197 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
tralala

Send message
Joined: 8 Apr 06
Posts: 376
Credit: 581,806
RAC: 0
Message 24263 - Posted: 22 Aug 2006, 11:44:15 UTC - in response to Message 23918.  

Also resource share dictates how much of your CPU time to give to each project over the long term. Example. Project A share 50 and Project B share 100. Project A will have the CPU 1/3 of the time and Project B will have the CPU 2/3 of the time. If possible, it will be 2 hours of B and 1 of A (depending on the switch time). If one of the projects has anticipated deadline trouble, that project will get extra CPU time now, but will not be allowed to download new work for some time in order to let the other project catch up on its CPU time.



Thats pretty cool, I didn't know that. I just set one of my rigs onto 3 smaller projects to run for probably a year without me being able to touch them.

Thank you.

I was the developer that did most of the work on the current CPU scheduler.


Cool. Can you confirm that the 5.5.x versions switch only after a checkpoint and try to finish a WU before switching if it is near completion?
ID: 24263 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
John McLeod VII
Avatar

Send message
Joined: 17 Sep 05
Posts: 108
Credit: 195,137
RAC: 0
Message 24319 - Posted: 22 Aug 2006, 23:25:14 UTC - in response to Message 24263.  

Also resource share dictates how much of your CPU time to give to each project over the long term. Example. Project A share 50 and Project B share 100. Project A will have the CPU 1/3 of the time and Project B will have the CPU 2/3 of the time. If possible, it will be 2 hours of B and 1 of A (depending on the switch time). If one of the projects has anticipated deadline trouble, that project will get extra CPU time now, but will not be allowed to download new work for some time in order to let the other project catch up on its CPU time.



Thats pretty cool, I didn't know that. I just set one of my rigs onto 3 smaller projects to run for probably a year without me being able to touch them.

Thank you.

I was the developer that did most of the work on the current CPU scheduler.


Cool. Can you confirm that the 5.5.x versions switch only after a checkpoint and try to finish a WU before switching if it is near completion?

1) There is no attempt made to wait for a task to finish other than waiting for the next checkpoint. So, if things are running normally, and there is no checkpoint between the re-schedule and the end of the task, it does wait.

2) Tasks normally wait for the first checkpoint after their first allotted time slice since a start from paused. The exception to waiting is if a project requires extra CPU time, in which case it is more important to get started on that task than to wait for a checkpoint that might never come. The second exception is if the task has checkpointed within the last 10 seconds (seconds, not minutes).

Yes, this is in the later 5.5 versions starting, around 5.5.7 I believe. However, please note that 5.5 builds are for Alpha testing, and carry a higher risk of severe problems (for example, the current build will not install on Win 9X).


BOINC WIKI
ID: 24319 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
NJMHoffmann

Send message
Joined: 17 Dec 05
Posts: 45
Credit: 45,891
RAC: 0
Message 24426 - Posted: 23 Aug 2006, 19:56:32 UTC - in response to Message 24319.  

1) There is no attempt made to wait for a task to finish other than waiting for the next checkpoint. So, if things are running normally, and there is no checkpoint between the re-schedule and the end of the task, it does wait.
At Rosetta this leads to WUs stopping at 100% and waiting for the next timeslice for Rosetta. This is not the fault of the scheduler but a consequence of the Rosetta code, that seems at the end to:
- tell Boinc "I'm at 100%"
- write a checkpoint (why?)
- want to clean up and exit, but is replaced by another app before this.
At the next start it loads the checkpoint, cleans up and exits :-)

Norbert

ID: 24426 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
FluffyChicken
Avatar

Send message
Joined: 1 Nov 05
Posts: 1260
Credit: 369,635
RAC: 0
Message 24440 - Posted: 23 Aug 2006, 20:53:02 UTC

Just a quick question.

How does the sceduler cope with WCG. Since (at the moment) WCG is effectively 3 different project (HPF-II, Cancer and HIV) inder the WCG banner. can the current or the 5.5.x series cope with intraproject & interproject scheduling well.

i.e. If I set each of WCG project to 100share (if it has such a thing for it's projects?) and Rosetta to 100% would it do each 4 project equally.
Or would you have to set the overall share at WCG to 300 and hope WCG have figured a server side sharing.

Does the BOINC platform provide for this?
Team mauisun.org
ID: 24440 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Astro
Avatar

Send message
Joined: 2 Oct 05
Posts: 987
Credit: 500,253
RAC: 0
Message 24441 - Posted: 23 Aug 2006, 21:02:56 UTC
Last modified: 23 Aug 2006, 21:04:28 UTC

WCG is treated as ONE project. The fact there are 3 apps for it makes no difference. Just as other projects with have multiple applications under it's umbrella. Well, that's how I understand it. I have crunched for WCG but they won't show you your "work in progress" via the results page, so you have no way of knowing if/when you'll get credit or even the status of your work. This is the reason they don't have a spot on my "cross project credit parity" spreadsheet. Leiden Classical runs the purger/deleter immediately after validation, so all you can see is "pending" then they're gone. This is why Leiden isn't on my spreadsheet either.

tony
ID: 24441 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Feet1st
Avatar

Send message
Joined: 30 Dec 05
Posts: 1755
Credit: 4,690,520
RAC: 0
Message 24444 - Posted: 23 Aug 2006, 21:06:44 UTC - in response to Message 24440.  

...If I set each of WCG project to 100share (if it has such a thing for it's projects?) and Rosetta to 100% would it do each 4 project equally.
Or would you have to set the overall share at WCG to 300 and hope WCG have figured a server side sharing.

Does the BOINC platform provide for this?


Not clear how they did it, but WCG handles their own subprojects. You simply elect which you'd like to participate in and they schedule those types of WUs to you. I don't believe they allow you to designate resource share within their projects.

So, if you wanted to do all 4 equally, you'd do a BOINC resource share like Rosetta 100, and WCG 300. And then hope that WCG gives you a roughly equal amount of work for each subproject.
Add this signature to your EMail:
Running Microsoft's "System Idle Process" will never help cure cancer, AIDS nor Alzheimer's. But running Rosetta@home just might!
https://boinc.bakerlab.org/rosetta/
ID: 24444 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Ingleside

Send message
Joined: 25 Sep 05
Posts: 107
Credit: 1,514,472
RAC: 0
Message 24661 - Posted: 24 Aug 2006, 10:49:20 UTC - in response to Message 24441.  

I have crunched for WCG but they won't show you your "work in progress" via the results page, so you have no way of knowing if/when you'll get credit or even the status of your work.

Actually, while it's more difficult to come by, they do show this info for your results, and clicking on a wu shows the status and claims and so on from the other computers also crunching same wu. But, there's no listing of which computer these other results belongs to, so you've no idea if you've been paired-off with a slow p3, or someone running with a 6-day cache...
"I make so many mistakes. But then just think of all the mistakes I don't make, although I might."
ID: 24661 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : Multiple project processing...



©2024 University of Washington
https://www.bakerlab.org