LIGO Support Ticket 17092
Ticket Information
Number: admin 17092
User: anderson@ligo.caltech.edu
Email: skoranda__AT__gravity.phys.uwm.edu
Status: new
Assigned To: tannenba
Date: Tue, 9 Oct 2007 10:01:17 -0700
From: Stuart Anderson <anderson__AT__ligo.caltech.edu>
To: condor-admin__AT__cs.wisc.edu, Zach Miller <zmiller__AT__cs.wisc.edu>
CC: Scott Koranda <skoranda__AT__gravity.phys.uwm.edu>
Subject: LIGO: Local universe scheduling latencies
X-Seen-BY: mailfromd 4.1 silica.cs.wisc.edu
Is there any way to short-cut or otherwise minimize the time spent
by a schedd waiting for the negotiator when running local universe
jobs?
The problem I would like to solve is how to run a large DAG with individual
jobs that run for only a few seconds on a schedd machine that has 16 CPU-cores.
However, this schedd is also capable of submitting jobs to a much larger
Condor pool and does not have its own dedicated negotiator. The local universe
jobs appear to get blocked waiting for negotiation cycles for the larger
pool, including jobs from another schedd that typically runs standard and
vanilla universes jobs.
Since all the current state about a particular schedd is held by that
schedd is there a way to have it make local decisions about running
local (and presumably scheduler) universe jobs?
Thanks.
--
Stuart Anderson anderson__AT__ligo.caltech.edu
http://www.ligo.caltech.edu/~anderson
===========================================================================
Date of creation: Tue Oct 9 12:01:36 2007 (1191949300)
Subject: Actions
Assigned to tannenba by cat
===========================================================================
Date of actions: Wed Oct 10 14:30:09 2007 (1192044610)
Subject: Comments added
Maybe this situation was helped by improvements to v7.0.1
where local universe jobs don't wait for the SCHEDD_INTERVAL?
Stuart tried v7.0.1 and local universe jobs seemed to startup
faster, but still seemed sluggish.
Comments added by tannenba
===========================================================================
Date comments were added: Fri Mar 14 13:35:48 2008 (1205519748)