Rosetta tasks completing but using very little CPU

Questions and Answers : Windows : Rosetta tasks completing but using very little CPU

To post messages, you must log in.

AuthorMessage
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105005 - Posted: 19 Feb 2022, 18:33:38 UTC

I started running BOINC on my new AMD 16 thread PC and Rosetta@home tasks are running to completion but using very little CPU. Task Manager details show only 2 processes running while BOINC manager shows 12 and there are 16 slots available. Other project tasks run fine. Anyone else seen this issue?
Regards,
Rich

Link to screenshot; https://www.dropbox.com/s/ispci3u7ivn69sx/Screenshot%202022-02-19%2012.21.35.png?dl=0
ID: 105005 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Bryn Mawr

Send message
Joined: 26 Dec 18
Posts: 393
Credit: 12,113,928
RAC: 4,486
Message 105008 - Posted: 19 Feb 2022, 19:11:47 UTC - in response to Message 105005.  

I started running BOINC on my new AMD 16 thread PC and Rosetta@home tasks are running to completion but using very little CPU. Task Manager details show only 2 processes running while BOINC manager shows 12 and there are 16 slots available. Other project tasks run fine. Anyone else seen this issue?
Regards,
Rich

Link to screenshot; https://www.dropbox.com/s/ispci3u7ivn69sx/Screenshot%202022-02-19%2012.21.35.png?dl=0


Is your task manager set to show tasks from all users? Most of the Boinc tasks are under a user called Boinc which would not ordinarily show.
ID: 105008 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105025 - Posted: 19 Feb 2022, 20:53:51 UTC - in response to Message 105008.  

Yes I selected show all processes in the details tab in task manager. Sorry in the screen shot I posted the BOINC manager is covering up the message to show fewer details.
ID: 105025 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105026 - Posted: 19 Feb 2022, 21:18:30 UTC

I just looked again and now there are no Rosetta processes but the Rosetta@home tasks are still running. What are they doing without a process to run them? I don't know what I am uploading as complete. How could it be valid? I am not accepting anymore tasks and I am debating whether to abort the ones that are still running. The milkyway tasks are running fine.

New Screen Shot; https://www.dropbox.com/s/9kl4g2ergdt9x2s/Screenshot%202022-02-19%2015.05.02.png?dl=0
ID: 105026 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1684
Credit: 17,932,402
RAC: 22,946
Message 105032 - Posted: 19 Feb 2022, 22:57:12 UTC - in response to Message 105026.  

I just looked again and now there are no Rosetta processes but the Rosetta@home tasks are still running. What are they doing without a process to run them?
They are Python Tasks which run in a VritualBox Virtual Machine.
Grant
Darwin NT
ID: 105032 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1684
Credit: 17,932,402
RAC: 22,946
Message 105033 - Posted: 19 Feb 2022, 23:03:33 UTC

Is your task manager set to show tasks from all users? Most of the Boinc tasks are under a user called Boinc which would not ordinarily show.
WIth Task Manager, if the BOINC Manager is open, then all the running Tasks will be the Task list under Apps, and then in the BOINC Manager for Widows folder.
If the BOINC Manager is closed, then they will show up as the application file name (eg rosetta_4.20_windows_x86_64.exe) in the Task list under Background Processes.
Grant
Darwin NT
ID: 105033 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105040 - Posted: 20 Feb 2022, 1:03:55 UTC - in response to Message 105033.  

Grant,
The Rosetta processes would have showed up in the resource monitor utilizing CPU. The only processes using the CPU were Milkyway@home. I ended up aborting all Rosetta tasks as they were running to completion using no CPU at all. I am not going crazy. The screen shots I provided earlier prove my point.
Regards,
Rich
ID: 105040 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1684
Credit: 17,932,402
RAC: 22,946
Message 105042 - Posted: 20 Feb 2022, 1:56:38 UTC - in response to Message 105040.  

as they were running to completion using no CPU at all.
If they weren't using the CPU then they never would have completed; that is a known issue with some Python Tasks. If they are completing, then they are using the CPU. They may no be using much of it, but they are using it. Most Python Tasks are finishing in around 5 hours at present.

And whatever system you did the screen shots on is on a different account to the one you are posting with- the account you are posting with hasn't had a system contact the Rosetta servers in almost 2 years.
Grant
Darwin NT
ID: 105042 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105111 - Posted: 21 Feb 2022, 20:36:49 UTC - in response to Message 105042.  

Grant,

I am using Science United as the account manager. The projects were assigned by them so that may be why the accounts look different. I used my Rosetta account again to post this question on the message board. I have turned off using the project manager temporarily to control the Rosetta tasks. I believe the tasks ran from start to finish without any CPU activity going on. I will allow some tasks to download and run to verify this. The problem also seemed to affect the Milkyway@home tasks that were running along with them. There were 2 of these tasks running and they should have been using 2 CPU threads at 100%. The screenshot of the CPU utilization shows different. I will post my results.
Regards,
Rich
ID: 105111 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1684
Credit: 17,932,402
RAC: 22,946
Message 105117 - Posted: 22 Feb 2022, 7:23:02 UTC - in response to Message 105111.  

I believe the tasks ran from start to finish without any CPU activity going on. I will allow some tasks to download and run to verify this. The problem also seemed to affect the Milkyway@home tasks that were running along with them. There were 2 of these tasks running and they should have been using 2 CPU threads at 100%. The screenshot of the CPU utilization shows different. I will post my results.
Under Windows Task Manager, you will see the Virtual Machine using the CPU. There won't be any sign of Rosetta or whatever it is that's running in the VM as those applications aren't using the CPU under Windows- they are using the CPU provided by the Virtual Machines, running under Windows, Managed by VirtualBox.
Windows hasn't got the slightest idea of what is running in the VMs. Just that the VMs themselves are running & using it's resources.
Grant
Darwin NT
ID: 105117 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105136 - Posted: 22 Feb 2022, 18:30:08 UTC

I started up Rosetta tasks last evening and the jobs ran normally using up 100% CPU on all 16 threads. They stated that they would run for 5 hours. They ran for 5 hours and said they had 5 hours to go so I went to bed. This morning only 4 Rosetta tasks were running. The event log showed "Message from server. VirtualBox jobs require hardware acceleration support. Your processor does not support the required instruction set."" No Tasks Sent". This is a brand new AMD Ryzen 7 5800x running at 4.5 ghz. It better support hardware acceleration. It should have completed these jobs in at least 5 hours as it said they would when I started them.

The 4 remaining Rosetta tasks were running on 8 CPU's this morning. I have been running BOINC tasks for 20 years and I have never seen tasks act like this. They usually run on 1 CPU maxing it out at 100% unless they are running a job on all CPU's as I have seen. I'll try a CPU benchmark or maybe a reboot to see if I can get Rosetta to send me some more tasks. Here is a screen shot of this morning. It's not on the screen but CPU 6 and 7 have the same graph as 10 through 15 only using about 50% CPU on each.

https://www.dropbox.com/s/v4e1nru2fu2gzdi/Screenshot%202022-02-22%2008.59.18.png?dl=0
ID: 105136 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
biini

Send message
Joined: 23 Sep 21
Posts: 1
Credit: 2,423,272
RAC: 18,909
Message 105137 - Posted: 22 Feb 2022, 18:37:09 UTC

Hi,

I have a similar problem.

I started Rosetta@home today at my media-pc. It has Ryzen 7 5800x. Only 1 task downloaded, and it runs veeeeery slowly. CPU usage is between little to none, estimated time to completition 1day 8hours. Any thoughts?
ID: 105137 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
jdzukley

Send message
Joined: 27 May 11
Posts: 3
Credit: 3,201,191
RAC: 0
Message 105141 - Posted: 22 Feb 2022, 20:21:53 UTC

I to have a similar situation:

I have 12 thread capacity, options set at 85% cpu, therefore 10 tasks to run, all Rosetta python. windows professional version.

9 tasks at running at +/- 9.5% of machine capacity, one task is running at 0 or 0.1%. total cpu capacity is running +/- 90%. Yes I am looking at vbox headless in the task manager. The 0.1% task is incrementing very slowly, say 0.010 % per minute, the task has a run time of 1d 04 hours.... and is currently 97.330%

task manager memory is 59%, disk usage is typically 3%

I have had this situation before, and just let the tasks finish.

task name : aagb-SAR_pp-TIQ-GGLY-LARD_pp_9_2721731_2
ID: 105141 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1684
Credit: 17,932,402
RAC: 22,946
Message 105145 - Posted: 23 Feb 2022, 6:12:23 UTC - in response to Message 105136.  

I started up Rosetta tasks last evening and the jobs ran normally using up 100% CPU on all 16 threads. They stated that they would run for 5 hours. They ran for 5 hours and said they had 5 hours to go so I went to bed. This morning only 4 Rosetta tasks were running. The event log showed "Message from server. VirtualBox jobs require hardware acceleration support. Your processor does not support the required instruction set."" No Tasks Sent". This is a brand new AMD Ryzen 7 5800x running at 4.5 ghz. It better support hardware acceleration. It should have completed these jobs in at least 5 hours as it said they would when I started them.

The 4 remaining Rosetta tasks were running on 8 CPU's this morning. I have been running BOINC tasks for 20 years and I have never seen tasks act like this. They usually run on 1 CPU maxing it out at 100% unless they are running a job on all CPU's as I have seen. I'll try a CPU benchmark or maybe a reboot to see if I can get Rosetta to send me some more tasks. Here is a screen shot of this morning. It's not on the screen but CPU 6 and 7 have the same graph as 10 through 15 only using about 50% CPU on each.

That screen shot shows 5 Tasks running. 4 Rosetta 4.20 (which don't use Virtualisation) and one GPU Grid task on the GPU but using a CPU thread to support it.
That screen shot shows total CPU utilisation at 28.7% Given that the GPUGrid CPU usage is probably less than 100% for a given thread, then 29% CPU usage is to be expected for what is just under 5 threads in use.
ie (5/15)*100=33.3% One of those 5 not fully loaded- so 29%.


There are known issues with some Python Tasks that sit there and use a core/thread, but don't produce any CPU load as they don't actually do any processing.
As to why the system that was doing VritualBox work & now isn't i've no idea.


As for what you expect to happen & what will actually happen when things are working correctly with VirtualBox, i give up.
Grant
Darwin NT
ID: 105145 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105182 - Posted: 23 Feb 2022, 21:08:18 UTC - in response to Message 105145.  

Grant,

After a reboot the Rosetta tasks started up again. Things were looking good last night and this morning as tasks were running normally so I started using Science United again as the account manager. However a new issue now, some Rosetta jobs are failing with computation errors. I have 8 of these failed tasks waiting for upload. The event log doesn't show any errors but there are dozens of these;

2/23/2022 1:21:27 PM | Rosetta@home | Computation for task PcrV8MER_PcrV_3HYF1539_000122_extract_A_SAVE_ALL_OUT_2909833_860_0 finished
2/23/2022 1:21:07 PM | Rosetta@home | Output file PcrV8MER_PcrV_3HYF1289_000106_extract_A_SAVE_ALL_OUT_2909774_194_1_r702921404_0 for task PcrV8MER_PcrV_3HYF1289_000106_extract_A_SAVE_ALL_OUT_2909774_194_1 absent.

Any ideas? Also, I see some other users are seeing strange behavior with Rosetta tasks as well. What a coincidence that there are issues with another Ryzen 7 5800X.

Regards,
Rich
ID: 105182 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Grant (SSSF)

Send message
Joined: 28 Mar 20
Posts: 1684
Credit: 17,932,402
RAC: 22,946
Message 105190 - Posted: 24 Feb 2022, 7:33:39 UTC - in response to Message 105182.  

However a new issue now, some Rosetta jobs are failing with computation errors. I have 8 of these failed tasks waiting for upload. The event log doesn't show any errors but there are dozens of these;

2/23/2022 1:21:27 PM | Rosetta@home | Computation for task PcrV8MER_PcrV_3HYF1539_000122_extract_A_SAVE_ALL_OUT_2909833_860_0 finished
2/23/2022 1:21:07 PM | Rosetta@home | Output file PcrV8MER_PcrV_3HYF1289_000106_extract_A_SAVE_ALL_OUT_2909774_194_1_r702921404_0 for task PcrV8MER_PcrV_3HYF1289_000106_extract_A_SAVE_ALL_OUT_2909774_194_1 absent.

Any ideas?
As posted many times over in the number Crunching forum- the last batch of Rosetta 4.20 work released resulted in 100% failure rate for Windows systems, the current batch of work (that is now finished) resulted in a roughly 50% failure rate.
The tasks themselves are faulty.
Grant
Darwin NT
ID: 105190 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105202 - Posted: 24 Feb 2022, 19:03:29 UTC
Last modified: 24 Feb 2022, 19:42:39 UTC

The Rosetta project does not like my CPU. Event Log keeps showing "Message from server: VirtualBox jobs require hardware acceleration support. Your processor does not support the required instruction set." This is happening about once a day. This event halts all downloads and I have been rebooting the PC in order to receive new Rosetta tasks. Anyone else see this message? Are you running an AMD Ryzen Zen3 CPU by any chance?

PS. I was able to get Rosetta reset by exiting and restarting BOINC. Also I saw this in another post on the same issue "Virtualisation needs to be on in the BIOS, Virtual Box needs to be installed, and HyperV needs to be disabled in the Operating System. And you need to make sure on your Computer page in your account that it is set to accept Python Tasks.
I have virtualisation enabled in my BIOS, Virtual Box is installed and I have not installed HyperV. I am using an account manager so I am using prefs from Science United. I do not see the option to accept Python tasks on my Rosetta home page either.
ID: 105202 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
richc

Send message
Joined: 31 Mar 20
Posts: 13
Credit: 4,055
RAC: 0
Message 105299 - Posted: 1 Mar 2022, 1:54:46 UTC - in response to Message 105137.  

Hey Biini,
Did you ever get Rosetta tasks working on your Ryzen 7 5800X? If so do you have virtualization enabled (SVM) in your BIOS? My Ryzen 7 5800X will not run them with SVM enabled. Please see and respond to my post "Why when I enabled virtualisation in the BIOS did Rosetta quit sending tasks?"
Thanks in advance,
Rich
ID: 105299 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Markus Dippner

Send message
Joined: 20 Jun 09
Posts: 1
Credit: 18,581
RAC: 0
Message 105741 - Posted: 28 Mar 2022, 16:27:01 UTC - in response to Message 105117.  

Under Windows Task Manager, you will see the Virtual Machine using the CPU. There won't be any sign of Rosetta or whatever it is that's running in the VM as those applications aren't using the CPU under Windows- they are using the CPU provided by the Virtual Machines, running under Windows, Managed by VirtualBox.
Windows hasn't got the slightest idea of what is running in the VMs. Just that the VMs themselves are running & using it's resources.


Yes, but his Screenshoots also don't show any CPU usage at all. Even not by a VM.

Same Issue by me. I've got two tasks running. They startet with an estimated runtime of 12 hours. Now I let my comupter running for a full day, that it finally completes. It's running since more than 57 hours and is at 98,928% with a remaining time of 37 minutes. As higher the progress gets, the slower it gets forward. The cpu usage time in this 57 hours is 50 minutes. The cpu is almost idle. I don't even have to look into any task manager or tool, because I hear it that my cpu cooling isn't running.

When I open the VM, it says: "Intel MKL FATAL ERROR: Error on loading function mkl_lapack_ps_mc_dystrf_l_small."

How can there be annything missing in a vm? It's am vm, that the programm runs on all pcs in a vm with the same virtualizied hard and software.
Does it run at all?
How can the task make progress, when it wouldn't be running?
It also makes checkpoints every ten minutes.

It's everytime that case. absolutly every time in Rosetta. Every other project runs fine.

I thougt, maybe this tasks run with less cpu because the task maybe primary needs RAM. But it won't get finnished.

It is really annyoing. :(
ID: 105741 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Questions and Answers : Windows : Rosetta tasks completing but using very little CPU



©2024 University of Washington
https://www.bakerlab.org