Htop is very very slow if 3proxy is up and running under heavy load


Tun Broker
 

Tun Broker

Mar 21, 2022, 12:30 MST

Hello Folks ,

 

[root@X ~]# 3proxy -v

Usage: 3proxy [conffile]

 

if conffile is missing, configuration is expected from stdin

 

3proxy tiny proxy server 3proxy-0.8.9 (170202011430)

(c)3APA3A, Vladimir Dubrovin & 3proxy.ru

Documentation and sources: http://3proxy.ru/

Please read license agreement in 'copying' file.

You may not use this program without accepting license agreement

[root@X ~]# cat /etc/redhat-release

 

CentOS Linux release 7.8.2003 (Core)

[root@X ~]#

 

htop is very very slow if 3proxy is up and running under heavy load .

 

if 3proxy is stopped , htop take 1 seconds and refresh faster .

if 3proxy is up under high load , htop take 40 seconds to work and slower refresh time .

 

 

im not sure if I need to rebuild htop with other parameters or its just a bug .

 

Thanks

 


Nathan Scott
 

Hi Tun,

On Wed, Mar 23, 2022 at 5:49 AM Tun Broker <tunbroker.io@...> wrote:

> [...]

> htop is very very slow if 3proxy is up and running under heavy load .

if 3proxy is stopped , htop take 1 seconds and refresh faster .

> if 3proxy is up under high load , htop take 40 seconds to work and slower refresh time .


I have 3proxy installed here but I don't use it myself - is there a
workload you can recommend to reproduce this?  Alternatively,
you might be able to gain some insight into where time is being
spent from a quick 'perf top' run.

Also, what version of htop are you running there at the moment?

cheers.

--
Nathan


Tun Broker
 

Yes , If no load , all is good .

The issue only happen when the load is hit on 3proxy .

 

Once 3proxy is hit with network load , I see htop , iftop , iotp ---- All those tools become very slow and take like 1 min to start with high refresh rate .

So the tools similar to htop also affected too .

 

But when htop is opened after the long time .

I see 3proxy services take 9600 CPU % which is a very high number and not accurate or not real .

 

The server is stable , only htop/ other tools above are affected .

 

A screenshot of a computer

Description automatically generated with low confidence

I have attached a screenshot Hope it simplify the problem ,

 

Thanks

 

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 4:01 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi Tun,

 

On Wed, Mar 23, 2022 at 5:49 AM Tun Broker <tunbroker.io@...> wrote:

> [...]

> htop is very very slow if 3proxy is up and running under heavy load .

> if 3proxy is stopped , htop take 1 seconds and refresh faster .

> if 3proxy is up under high load , htop take 40 seconds to work and slower refresh time .

 

I have 3proxy installed here but I don't use it myself - is there a

workload you can recommend to reproduce this?  Alternatively,

you might be able to gain some insight into where time is being

spent from a quick 'perf top' run.

 

Also, what version of htop are you running there at the moment?

 

cheers.

 

--

Nathan


Nathan Scott
 

Hi Tun,

Your system has 96 CPUs.  Looks like proxy3 is using 100% of every single one of them (96 * 100% => 9600%) all of the time.
I'd be a little wary of the values shown in the per-CPU bars in this situation since htop is unlikely to be able to complete a sample in the sampling time allotted, hence that data is possibly being calculated incorrectly (change in value over change in time - time is advancing but the values are probably not reliably)

You probably need to set aside at least a CPU or two for admin tools like htop - it looks like currently your system is over-subscribed if you want to run admin tools as well as proxy3.

What did 'perf top' say?

cheers.


On Wed, Mar 23, 2022 at 10:25 AM Tun Broker <tunbroker.io@...> wrote:

Yes , If no load , all is good .

The issue only happen when the load is hit on 3proxy .

 

Once 3proxy is hit with network load , I see htop , iftop , iotp ---- All those tools become very slow and take like 1 min to start with high refresh rate .

So the tools similar to htop also affected too .

 

But when htop is opened after the long time .

I see 3proxy services take 9600 CPU % which is a very high number and not accurate or not real .

 

The server is stable , only htop/ other tools above are affected .

 

A screenshot of a computer

Description automatically generated with low confidence

I have attached a screenshot Hope it simplify the problem ,

 

Thanks

 

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 4:01 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi Tun,

 

On Wed, Mar 23, 2022 at 5:49 AM Tun Broker <tunbroker.io@...> wrote:

> [...]

> htop is very very slow if 3proxy is up and running under heavy load .

> if 3proxy is stopped , htop take 1 seconds and refresh faster .

> if 3proxy is up under high load , htop take 40 seconds to work and slower refresh time .

 

I have 3proxy installed here but I don't use it myself - is there a

workload you can recommend to reproduce this?  Alternatively,

you might be able to gain some insight into where time is being

spent from a quick 'perf top' run.

 

Also, what version of htop are you running there at the moment?

 

cheers.

 

--

Nathan


Tun Broker
 

Hello ,

I confirm the server is stable . “Wrong htop records”

Per screenshot the load average is not Full on the server .

 

I attached , the perf top :

A picture containing table

Description automatically generated

 

Regards ,

Daniel .

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 4:37 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi Tun,

 

Your system has 96 CPUs.  Looks like proxy3 is using 100% of every single one of them (96 * 100% => 9600%) all of the time.

I'd be a little wary of the values shown in the per-CPU bars in this situation since htop is unlikely to be able to complete a sample in the sampling time allotted, hence that data is possibly being calculated incorrectly (change in value over change in time - time is advancing but the values are probably not reliably)

 

You probably need to set aside at least a CPU or two for admin tools like htop - it looks like currently your system is over-subscribed if you want to run admin tools as well as proxy3.

 

What did 'perf top' say?

 

cheers.

 

On Wed, Mar 23, 2022 at 10:25 AM Tun Broker <tunbroker.io@...> wrote:

Yes , If no load , all is good .

The issue only happen when the load is hit on 3proxy .

 

Once 3proxy is hit with network load , I see htop , iftop , iotp ----à All those tools become very slow and take like 1 min to start with high refresh rate .

So the tools similar to htop also affected too .

 

But when htop is opened after the long time .

I see 3proxy services take 9600 CPU % which is a very high number and not accurate or not real .

 

The server is stable , only htop/ other tools above are affected .

 

A screenshot of a computer

Description automatically generated with low confidence

I have attached a screenshot Hope it simplify the problem ,

 

Thanks

 

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 4:01 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi Tun,

 

On Wed, Mar 23, 2022 at 5:49 AM Tun Broker <tunbroker.io@...> wrote:

> [...]

> htop is very very slow if 3proxy is up and running under heavy load .

> if 3proxy is stopped , htop take 1 seconds and refresh faster .

> if 3proxy is up under high load , htop take 40 seconds to work and slower refresh time .

 

I have 3proxy installed here but I don't use it myself - is there a

workload you can recommend to reproduce this?  Alternatively,

you might be able to gain some insight into where time is being

spent from a quick 'perf top' run.

 

Also, what version of htop are you running there at the moment?

 

cheers.

 

--

Nathan


Nathan Scott
 

Hi there,

Sum the percentage values in the left-most column of your perf top output - this again suggests your machine is 100% CPU bound.  You'll need to look into that (there's alot of clues for you in the perf top output) - this isn't a htop problem though IMO.  htop is doing the best it can to keep up, given very little resources to work with.

cheers.

On Wed, Mar 23, 2022 at 11:16 AM Tun Broker <tunbroker.io@...> wrote:

Hello ,

I confirm the server is stable . “Wrong htop records”

Per screenshot the load average is not Full on the server .

 

I attached , the perf top :

A picture containing table

Description automatically generated

 

Regards ,

Daniel .

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 4:37 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi Tun,

 

Your system has 96 CPUs.  Looks like proxy3 is using 100% of every single one of them (96 * 100% => 9600%) all of the time.

I'd be a little wary of the values shown in the per-CPU bars in this situation since htop is unlikely to be able to complete a sample in the sampling time allotted, hence that data is possibly being calculated incorrectly (change in value over change in time - time is advancing but the values are probably not reliably)

 

You probably need to set aside at least a CPU or two for admin tools like htop - it looks like currently your system is over-subscribed if you want to run admin tools as well as proxy3.

 

What did 'perf top' say?

 

cheers.

 

On Wed, Mar 23, 2022 at 10:25 AM Tun Broker <tunbroker.io@...> wrote:

Yes , If no load , all is good .

The issue only happen when the load is hit on 3proxy .

 

Once 3proxy is hit with network load , I see htop , iftop , iotp ----à All those tools become very slow and take like 1 min to start with high refresh rate .

So the tools similar to htop also affected too .

 

But when htop is opened after the long time .

I see 3proxy services take 9600 CPU % which is a very high number and not accurate or not real .

 

The server is stable , only htop/ other tools above are affected .

 

A screenshot of a computer

Description automatically generated with low confidence

I have attached a screenshot Hope it simplify the problem ,

 

Thanks

 

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 4:01 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi Tun,

 

On Wed, Mar 23, 2022 at 5:49 AM Tun Broker <tunbroker.io@...> wrote:

> [...]

> htop is very very slow if 3proxy is up and running under heavy load .

> if 3proxy is stopped , htop take 1 seconds and refresh faster .

> if 3proxy is up under high load , htop take 40 seconds to work and slower refresh time .

 

I have 3proxy installed here but I don't use it myself - is there a

workload you can recommend to reproduce this?  Alternatively,

you might be able to gain some insight into where time is being

spent from a quick 'perf top' run.

 

Also, what version of htop are you running there at the moment?

 

cheers.

 

--

Nathan


Tun Broker
 

Thank you , I know it’s not HTOP problem .

AS I said its only an issue when 3proxy is up and under traffic .

 

Thanks for your trial and help .

 

 

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 5:42 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi there,

 

Sum the percentage values in the left-most column of your perf top output - this again suggests your machine is 100% CPU bound.  You'll need to look into that (there's alot of clues for you in the perf top output) - this isn't a htop problem though IMO.  htop is doing the best it can to keep up, given very little resources to work with.

 

cheers.

 

On Wed, Mar 23, 2022 at 11:16 AM Tun Broker <tunbroker.io@...> wrote:

Hello ,

I confirm the server is stable . “Wrong htop records”

Per screenshot the load average is not Full on the server .

 

I attached , the perf top :

A picture containing table

Description automatically generated

 

Regards ,

Daniel .

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 4:37 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi Tun,

 

Your system has 96 CPUs.  Looks like proxy3 is using 100% of every single one of them (96 * 100% => 9600%) all of the time.

I'd be a little wary of the values shown in the per-CPU bars in this situation since htop is unlikely to be able to complete a sample in the sampling time allotted, hence that data is possibly being calculated incorrectly (change in value over change in time - time is advancing but the values are probably not reliably)

 

You probably need to set aside at least a CPU or two for admin tools like htop - it looks like currently your system is over-subscribed if you want to run admin tools as well as proxy3.

 

What did 'perf top' say?

 

cheers.

 

On Wed, Mar 23, 2022 at 10:25 AM Tun Broker <tunbroker.io@...> wrote:

Yes , If no load , all is good .

The issue only happen when the load is hit on 3proxy .

 

Once 3proxy is hit with network load , I see htop , iftop , iotp ----à All those tools become very slow and take like 1 min to start with high refresh rate .

So the tools similar to htop also affected too .

 

But when htop is opened after the long time .

I see 3proxy services take 9600 CPU % which is a very high number and not accurate or not real .

 

The server is stable , only htop/ other tools above are affected .

 

A screenshot of a computer

Description automatically generated with low confidence

I have attached a screenshot Hope it simplify the problem ,

 

Thanks

 

 

 

From: htop@groups.io <htop@groups.io> on behalf of Nathan Scott <scott.nato@...>
Date: Tuesday, March 22, 2022 at 4:01 PM
To: htop@groups.io <htop@groups.io>
Subject: Re: [htop] Htop is very very slow if 3proxy is up and running under heavy load

Hi Tun,

 

On Wed, Mar 23, 2022 at 5:49 AM Tun Broker <tunbroker.io@...> wrote:

> [...]

> htop is very very slow if 3proxy is up and running under heavy load .

> if 3proxy is stopped , htop take 1 seconds and refresh faster .

> if 3proxy is up under high load , htop take 40 seconds to work and slower refresh time .

 

I have 3proxy installed here but I don't use it myself - is there a

workload you can recommend to reproduce this?  Alternatively,

you might be able to gain some insight into where time is being

spent from a quick 'perf top' run.

 

Also, what version of htop are you running there at the moment?

 

cheers.

 

--

Nathan