Message boards : Number crunching : Rosetta WU delivery out of control
Previous · 1 · 2
Author | Message |
---|---|
Admin Project administrator Send message Joined: 1 Jul 05 Posts: 4805 Credit: 0 RAC: 0 |
I updated the scheduler so please post here if you are continuing to have issues with crazy cache sizes. The scheduler now uses the cpu run time preference as the estimated job duration when determining how many jobs to send to a host. Hopefully this should improve the job cache size. |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1680 Credit: 17,841,115 RAC: 22,993 |
I updated the scheduler so please post here if you are continuing to have issues with crazy cache sizes. The scheduler now uses the cpu run time preference as the estimated job duration when determining how many jobs to send to a host. Hopefully this should improve the job cache size.Good to hear. Thank you for your efforts. Grant Darwin NT |
Grant (SSSF) Send message Joined: 28 Mar 20 Posts: 1680 Credit: 17,841,115 RAC: 22,993 |
I doubt there was a sudden increase in the number of users signing up, so this graph shows just how bad the issue was. Almost 600k more Tasks in progress than usual, over a 50% increase. As tasks miss deadlines & get resent, over the next week or so the number should end up back around the 1 to 1.1 million mark. The next new application release (or surge in new users) should result in a much smaller jump in In progress Tasks, and no mass missing of deadlines or Tasks being aborted. Good for the project & good for the crunchers. Grant Darwin NT |
Admin Project administrator Send message Joined: 1 Jul 05 Posts: 4805 Credit: 0 RAC: 0 |
Hopefully the updates I made fixed this issue. Thanks! Edit: When I reattached, the appropriate amount of jobs were downloaded so that's a good sign. |
Message boards :
Number crunching :
Rosetta WU delivery out of control
©2024 University of Washington
https://www.bakerlab.org