does Rosetta/BOINC support a 'networked install'

Message boards : Rosetta@home Science : does Rosetta/BOINC support a 'networked install'

To post messages, you must log in.

AuthorMessage
PresterJohn
Avatar

Send message
Joined: 4 Nov 05
Posts: 24
Credit: 2,121,609
RAC: 0
Message 2281 - Posted: 4 Nov 2005, 19:43:17 UTC
Last modified: 4 Nov 2005, 19:45:49 UTC

is there another option to running Rosetta besides installing it on every machine?

in other words, if i have a bunch of machines networked together, can i install the core (BOINC Manager) to a shared folder on one machine and have all the other machines map to this folder and run the client remotely or some sort of 'stub' program.

having this ability would facilitate multiple installs and i imagine it would cut down on unnecessary WU redundancy.

thanks.
- team XPC - 'Where merry times and good crunching meet head-on!'
ID: 2281 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile stephan_t
Avatar

Send message
Joined: 20 Oct 05
Posts: 129
Credit: 35,464
RAC: 0
Message 2287 - Posted: 4 Nov 2005, 20:10:41 UTC

Not that I'm aware of - but I never tried. You should give it a go and let us know.
Team CFVault.com
http://www.cfvault.com

ID: 2287 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Housing and Food Services

Send message
Joined: 1 Jul 05
Posts: 85
Credit: 155,098,531
RAC: 0
Message 2290 - Posted: 4 Nov 2005, 20:31:13 UTC

I don't believe this is possible due to the security processes built into the client. We have about 200 machines and did an automated install via startup script on our domain. . it went very smoothly.
ID: 2290 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Morphy375
Avatar

Send message
Joined: 2 Nov 05
Posts: 86
Credit: 1,629,758
RAC: 0
Message 2291 - Posted: 4 Nov 2005, 20:42:48 UTC - in response to Message 2290.  

I don't believe this is possible due to the security processes built into the client. We have about 200 machines and did an automated install via startup script on our domain. . it went very smoothly.


That's bad and I don't understand that there will be security reasons...

I have some GHz crunchonlies but only one machine can connect to the internet.
At FAD there was no problem at all....
Teddies....
ID: 2291 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Bok

Send message
Joined: 17 Sep 05
Posts: 54
Credit: 3,514,973
RAC: 0
Message 2299 - Posted: 4 Nov 2005, 22:41:51 UTC

So set up a proxy on that machine and point all of the other boinc clients through it...
Free-DC

Stats for all projects

Custom Stats
ID: 2299 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Paul D. Buck

Send message
Joined: 17 Sep 05
Posts: 815
Credit: 1,812,737
RAC: 0
Message 2332 - Posted: 5 Nov 2005, 11:16:58 UTC

At the moment there is no way to indirectly connect machines (except via a proxy as stated), where machines physically isolated from the internet can be used. There is a tentative plan to add this capability in the future, but it is of very low priority as it is felt that there are not that many places that need this.

If you do need this, well, the current thought is that the people that need it will develop it and make the changes available to all ...
ID: 2332 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
DigiK-oz

Send message
Joined: 8 Nov 05
Posts: 13
Credit: 333,730
RAC: 0
Message 2744 - Posted: 9 Nov 2005, 20:15:21 UTC
Last modified: 9 Nov 2005, 20:19:48 UTC

I would like something like this as well. At work, I am allowed to run DC projects on some 50 or so machines, but if, and only if :

- There's no install on the machines
- It doesn't use an internet connection

Coming from find-a-drug, I just shared the find-a-drug directory on one machine (which WAS allowed to have an install and internet connection). So, this machine, called let's say "fadserver" would share it's find-a-drug directory with sharename "fad". On any machine I'd want to run find-a-drug on, i'd type a single command :

\fadserverfadloader.exe

And the machine would start crunching, getting it's work from, and returning the result to, the machine called fadserver which took care of downloading/uploading work.

Any suggestions for setting up BOINC in this fashion? Using third-party software maybe? Or hints on writing a program which would make this possible? Any thoughts on the matter would be appreciated, and might help me contribute way more power...
ID: 2744 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Housing and Food Services

Send message
Joined: 1 Jul 05
Posts: 85
Credit: 155,098,531
RAC: 0
Message 2749 - Posted: 9 Nov 2005, 20:24:24 UTC - in response to Message 2744.  

I would like something like this as well. At work, I am allowed to run DC projects on some 50 or so machines, but if, and only if :

- There's no install on the machines
- It doesn't use an internet connection


We wanted to do a similar install, but ended up deploying it via active directory and installing it on each machine. . . since the functionality wasn't supported.

Would they allow you to create a Ram drive on your workstations and connect via a proxy? The ram drive wouldn't need to be that large, I have a dual cpu workstation with 30 work units queued and the entire Boinc directory takes up 25 megs.

You could create the batch file that creates the ram drive, installs boinc, and connects to rosetta (we do the latter two via AD) and have it on your proxy server, that way nothing is ever installed on the workstations.
ID: 2749 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dgnuff
Avatar

Send message
Joined: 1 Nov 05
Posts: 350
Credit: 24,773,605
RAC: 0
Message 3051 - Posted: 13 Nov 2005, 3:16:03 UTC - in response to Message 2749.  

I would like something like this as well. At work, I am allowed to run DC projects on some 50 or so machines, but if, and only if :

- There's no install on the machines
- It doesn't use an internet connection


Would they allow you to create a Ram drive on your workstations and connect via a proxy? The ram drive wouldn't need to be that large, I have a dual cpu workstation with 30 work units queued and the entire Boinc directory takes up 25 megs.


The problem with the ramdrive approach is saving the contents of it when the machine resets or powers down, and more importantly, what do you reload the ramdrive with when the systems comes back up? While we're at it, there are very few ramdrives available for 2K/XP, the only one that is free is a FAT 12 critter, so it'll be capped at about 30 MB. In it's current state, Boinc REFUSES to download unless there's at least a couple of hundred megs available, irrespective of what you set on your config page.

The other option is to create 50 or so copies of boinc on the "server" (ugh, hell of a waste of disk space), and just map to them on the network clients.

As for doing 50 installations, you don't need to. Install it once, and then just make 49 more copies of the folder. It'll take a while to settle, since the duplicates will need to assign themselves new host identifiers, but it should work itself out eventually.

25 MB is plenty enough to run Rosetta and one backup project, provided you steer clear of the "disk hogs" like climateprediction. 50 copies of that would be 1.25 Gb, to a first order approximation at least. You'd still have to do the proxy thing to talk to the outside world.

To be brutally honest, I suspect that a good many people could use this, I know it was a VERY common setup over at FaD.
ID: 3051 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
DigiK-oz

Send message
Joined: 8 Nov 05
Posts: 13
Credit: 333,730
RAC: 0
Message 3210 - Posted: 14 Nov 2005, 19:34:16 UTC

Thanks for the suggestion. A ramdrive isn't ideal, since that approach would still be an install, leaving entries in control panel etc even when the ramdrive is long gone. Not to mention stalled jobs after reboot and who knows what else.

As for the bunch of copies of the install directory and sharing those, one for each client, that sounds promising. I already tried sharing a directory and running multiple clients from that single directory, but that failed miserably, with error messages, project resets and more issues. Having a seperate directory for each client is a little more of a hassle, but since that should be a one-time setup (maybe again when and if more clients are added) that's ok.

One more question about this : should every client, after a reboot for instance, reconnect to it's own directory (the one it used before)? Or would it be ok if it connected to some other directory (continuing the work some other client started), as long as there is always only one client connected to any single directory?

I'll be testing this somewhere later this week. Thanks again!
ID: 3210 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile FZB

Send message
Joined: 17 Sep 05
Posts: 84
Credit: 4,948,999
RAC: 0
Message 3212 - Posted: 14 Nov 2005, 19:39:57 UTC

as some projects give out work units depending on os and processor, it would be best to have each host connect to the same share over and over again
--
Florian
www.domplatz1.de
ID: 3212 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile dgnuff
Avatar

Send message
Joined: 1 Nov 05
Posts: 350
Credit: 24,773,605
RAC: 0
Message 3216 - Posted: 14 Nov 2005, 20:09:43 UTC - in response to Message 3210.  


One more question about this : should every client, after a reboot for instance, reconnect to it's own directory (the one it used before)? Or would it be ok if it connected to some other directory (continuing the work some other client started), as long as there is always only one client connected to any single directory?


It would probably be preferable for each client to connect to the same folder, but it's by no means mandatory. I get a similar effect by having a small boinc installation that travels with me on a thumb drive. It gets thrown at all sorts of varied machines, and doesn't seem to suffer any ill effects.

ID: 3216 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
DigiK-oz

Send message
Joined: 8 Nov 05
Posts: 13
Credit: 333,730
RAC: 0
Message 3217 - Posted: 14 Nov 2005, 20:27:58 UTC

Thanks for the quick replies. I will try to have the clients reconnect to their previous share after reboot. However, clients come and go in this setup, so occasionally the need may arise (or some stupid error on my part may cause it) to have a different client connect to some directory. I don't want to end up with a bunch of directories that "were used once, and might be again in the near or distant future". What I would like to do in the case of some client being removed/replaced or whatever, is reuse that client's directory.

Well, from your replies I read that this shouldn't pose a real problem, but that a re-use by the same client would be preferred if possible.

Ok, I'll see if I can get it setup that way and take it from there.
ID: 3217 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Rosetta@home Science : does Rosetta/BOINC support a 'networked install'



©2024 University of Washington
https://www.bakerlab.org