Discussion:
Description for Load Scaling, Usage Scaling parameters
hjmangalam
2010-12-14 18:17:31 UTC
Permalink
Is there a FAQ, whitepaper, doc, manual or wiki that describes the
individual parameters that can be set in the execution host
configuration (esp in the: 'Load Scaling' & 'Usage Scaling' section
that is offered by qmon?

[ qmon -> Host Configuration -> Add -> Scaling -> Load Scaling & Usage
Scaling]

This seems to be the same list of parameters that can be generated by
the 'qconf -sc' command.

Some of them seem to be straightforward, at least until you run into
others that seem to conflict (processors vs slots, for example).

A few others are explained in the 'complex' or 'queue_conf' man mages,
but there doesn't seem to be any doc that centralizes the explanation
of what they actually mean/imply. What's left is to randomly assign
values and wait for a job to explode and then try to do an autopsy on
the remains.

Is there such a doc? I'd be very happy to RTFM.
--
Harry Mangalam - Research Computing, NACS, Rm 225 MSTB, UC Irvine
[ZOT 2225] / 92697 Google Voice Multiplexer: (949) 478-4487
MSTB=Bldg 415 (G-5 on <http://today.uci.edu/pdf/UCI_09_map_campus.pdf>
Lat/Long: 33.642025,-117.844414 (paste into google maps)

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=305541

To unsubscribe from this discussion, e-mail: [users-***@gridengine.sunsource.net].
stephendennis
2010-12-14 19:16:23 UTC
Permalink
Hi Harry

I use a spreadsheet and mapping out the minimum and maximum values that I will
consider for load parameters and then add in some scaling parameters to check
that the resulting load results are as I expect.

The matrix of values and the applied formula makes it easier to confirm correctness
and behaviour of the load_formula.

Note that the queue load_threshold is applied first so it can be used to cap the
load factor range.

Here is an example.
https://spreadsheets.google.com/ccc?key=0AnG83huJZx_ZdElmeWd6M0lQYkhLWHZCZGFNNFYzeEE&hl=en&authkey=CPuYk8YH

Thanks
Stephen

________________________________________
From: hjmangalam [***@uci.edu]
Sent: Tuesday, December 14, 2010 1:17 PM
To: ***@gridengine.sunsource.net
Subject: [GE users] Description for Load Scaling, Usage Scaling parameters

Is there a FAQ, whitepaper, doc, manual or wiki that describes the
individual parameters that can be set in the execution host
configuration (esp in the: 'Load Scaling' & 'Usage Scaling' section
that is offered by qmon?

[ qmon -> Host Configuration -> Add -> Scaling -> Load Scaling & Usage
Scaling]

This seems to be the same list of parameters that can be generated by
the 'qconf -sc' command.

Some of them seem to be straightforward, at least until you run into
others that seem to conflict (processors vs slots, for example).

A few others are explained in the 'complex' or 'queue_conf' man mages,
but there doesn't seem to be any doc that centralizes the explanation
of what they actually mean/imply. What's left is to randomly assign
values and wait for a job to explode and then try to do an autopsy on
the remains.

Is there such a doc? I'd be very happy to RTFM.
--
Harry Mangalam - Research Computing, NACS, Rm 225 MSTB, UC Irvine
[ZOT 2225] / 92697 Google Voice Multiplexer: (949) 478-4487
MSTB=Bldg 415 (G-5 on <http://today.uci.edu/pdf/UCI_09_map_campus.pdf>
Lat/Long: 33.642025,-117.844414 (paste into google maps)

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=305541

To unsubscribe from this discussion, e-mail: [users-***@gridengine.sunsource.net].


---------------------------------------------------------------------


Notice from Univa UD Postmaster:


This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. This message has been content scanned by the Univa UD Tumbleweed MailGate.



---------------------------------------------------------------------

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=305561

To unsubscribe from this discussion, e-mail: [users-***@gridengine.sunsource.net].
reuti
2010-12-14 19:17:55 UTC
Permalink
Post by hjmangalam
Is there a FAQ, whitepaper, doc, manual or wiki that describes the
individual parameters that can be set in the execution host
configuration (esp in the: 'Load Scaling' & 'Usage Scaling' section
that is offered by qmon?
[ qmon -> Host Configuration -> Add -> Scaling -> Load Scaling & Usage
Scaling]
This seems to be the same list of parameters that can be generated by
the 'qconf -sc' command.
Some of them seem to be straightforward, at least until you run into
others that seem to conflict (processors vs slots, for example).
There is a document in "$SGE_ROOT/doc/load_parameters.asc", while it still doesn't cover all entries (but at least the load values).

AFAIK there is no central document explaining all (default) entries in one place, but it could be task to extend the complex mapage not only to list the available complexes, but to explain them too.

-- Reuti
Post by hjmangalam
A few others are explained in the 'complex' or 'queue_conf' man mages,
but there doesn't seem to be any doc that centralizes the explanation
of what they actually mean/imply. What's left is to randomly assign
values and wait for a job to explode and then try to do an autopsy on
the remains.
Is there such a doc? I'd be very happy to RTFM.
--
Harry Mangalam - Research Computing, NACS, Rm 225 MSTB, UC Irvine
[ZOT 2225] / 92697 Google Voice Multiplexer: (949) 478-4487
MSTB=Bldg 415 (G-5 on <http://today.uci.edu/pdf/UCI_09_map_campus.pdf>
Lat/Long: 33.642025,-117.844414 (paste into google maps)
------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=305541
------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=305564

To unsubscribe from this discussion, e-mail: [users-***@gridengine.sunsource.net].
Loading...