From adesmet@cs.wisc.edu  Fri May  7 00:03:52 2004
Received: from puffin.cs.wisc.edu (puffin.cs.wisc.edu [128.105.185.14])
	by cobalt.cs.wisc.edu (8.9.2/8.9.2) with ESMTP id AAA23110;
	Fri, 7 May 2004 00:03:51 -0500 (CDT)
Received: from puffin.cs.wisc.edu (localhost [127.0.0.1])
	by puffin.cs.wisc.edu (8.9.2/8.9.2) with SMTP id AAA20553;
	Fri, 7 May 2004 00:03:51 -0500 (CDT)
Message-Id: <200405070503.AAA20553@puffin.cs.wisc.edu>
Content-Type: text/plain; charset="iso-8859-1"
Date: Fri, 7 May 2004 00:03:50 -0500
Subject: Grid Exerciser Results (2004-05-07)
From: Grid Exerciser <adesmet@cs.wisc.edu>
To: adesmet@cs.wisc.edu, weber@cs.wisc.edu, miron@cs.wisc.edu, pfc@cs.wisc.edu,
        leighg@indiana.edu
Mime-Version: 1.0
Content-Transfer-Encoding: 8bit
X-MIME-Autoconverted: from quoted-printable to 8bit by cobalt.cs.wisc.edu id AAA23110
X-Spam-Status: No, hits=-6.5 required=5.0
	tests=AWL,BAYES_01
	version=2.53
X-Spam-Level: 
X-Spam-Checker-Version: SpamAssassin 2.53 (1.174.2.15-2003-03-30-exp)
Content-Length: 16782
Lines: 243

Information on the Grid Exerciser can be found at 
	http://www.cs.wisc.edu/~adesmet/ge/

The maximum simultaneous jobs to any given site are currently throttled to 10.

Current run submitted at Wed Apr 21 10:59:57 2004.

Removed ufloridapg.phys.ufl.edu.  It's part of Grid3dev now, not Grid3.


Grid Exerciser (Experimental)
Data range: Thu May  6 00:00:06 2004 through Fri May  7 00:00:06 2004
Last Updated: Fri May  7 00:03:50 2004

Status Summary

Site                                                Simul Submit  Rec'd   Done  Holds    Run Time
Default
 a197107.n1.vanderbilt.edu/jobmanager-pbs              10      0      0      0    535        0.00
 acdc.ccr.buffalo.edu/jobmanager-pbs                   10      0      0      0      0        0.00
 atgrid.grid.umich.edu/jobmanager-condor               10      0      0      0    774        0.00
 atlas.iu.edu/jobmanager-pbs                           10    195    208    195    234       49.80
 citgrid3.cacr.caltech.edu/jobmanager-condor           10    208    226    208    315       51.42
 cluster28.knu.ac.kr/jobmanager-condor                  3     55     59     55     96       15.88
 cmssrv04.fnal.gov/jobmanager-fbsng                    10    217    225    217    228       55.06
 garlic.hep.wisc.edu/jobmanager-condor                 10      4     24      4    243       14.50
 grid.dpcc.uta.edu/jobmanager-pbs                      10    218    232    218    276       54.34
 grid02.uchicago.edu/jobmanager-condor                  3     21     29     21     87        4.87
 iuatlas.physics.indiana.edu/jobmanager-condor          4     75     84     75    122       18.78
 jermaine.cs.wisc.edu/jobmanager-condor                 8      0     35      0    204        0.00
 lldimu.alliance.unm.edu/jobmanager-pbs                10      0      0      0      0        0.00
 spider.usatlas.bnl.gov/jobmanager-condor              10    217    221    217    194       53.20
 t2cms0.sdsc.edu/jobmanager-condor                     10    198    206    196    265       50.10
 ufgrid01.phys.ufl.edu/jobmanager-condor               10      0     34      0    177        0.00
 uscmstb0.ucsd.edu/jobmanager-condor                    2     41     44     41     78       10.10
Known Bad
 tam01.fnal.gov/jobmanager-condor                      10      0      0      0    819        0.00
Site is unexpected
 ufloridaPG.phys.ufl.edu/jobmanager-condor             10      0      0      0      0        0.00

GRAND TOTAL (19 sites)                                160   1449   1627   1447   4647      378.04

Status Details

a197107.n1.vanderbilt.edu/jobmanager-pbs
  Current Status:
    Held                         10
  Historic Holds:
    Globus error 73: the job manager failed to open stdout                5
    Globus error 74: the job manager failed to open stderr              217
    Unspecified gridmanager error                                       287
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         26
acdc.ccr.buffalo.edu/jobmanager-pbs
  Current Status:
    Pending                      10
  Historic Holds:
atgrid.grid.umich.edu/jobmanager-condor
  Current Status:
    Held                         10
  Historic Holds:
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context          4
    Globus error 136: the scratch directory could not be created        770
atlas.iu.edu/jobmanager-pbs
  Current Status:
    Finished                    195
    Held                         10
  Historic Holds:
    Globus error 73: the job manager failed to open stdout               13
    Globus error 74: the job manager failed to open stderr              148
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          1
    Globus error 8: the user cancelled the job                            6
    Unspecified gridmanager error                                         2
    Globus error 130: the job manager was sent a stop signal (job is still running)          1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         59
    Globus error 121: the job state file doesn't exist                    2
    Globus error 94: the jobmanager does not accept any new requests (shutting down)          2
citgrid3.cacr.caltech.edu/jobmanager-condor
  Current Status:
    Finished                    208
    Held                         10
  Historic Holds:
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          2
    Unspecified gridmanager error                                         1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         51
    Globus error 121: the job state file doesn't exist                   14
    Globus error 94: the jobmanager does not accept any new requests (shutting down)          1
    Globus error 136: the scratch directory could not be created          1
    Globus error 73: the job manager failed to open stdout                6
    Globus error 74: the job manager failed to open stderr              230
    Globus error 8: the user cancelled the job                            7
    Globus error 130: the job manager was sent a stop signal (job is still running)          1
    Globus error 129: the standard output/error size is different          1
cluster28.knu.ac.kr/jobmanager-condor
  Current Status:
    Finished                     55
    Held                          3
  Historic Holds:
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         26
    Globus error 121: the job state file doesn't exist                    2
    Globus error 73: the job manager failed to open stdout               15
    Globus error 74: the job manager failed to open stderr               53
cmssrv04.fnal.gov/jobmanager-fbsng
  Current Status:
    Finished                    217
    Held                         10
  Historic Holds:
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          2
    Globus error 126: it is unknown if the job was submitted              3
    Unspecified gridmanager error                                         2
    Globus error 7: an authentication operation failed                    1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         50
    Globus error 121: the job state file doesn't exist                   15
    Globus error 94: the jobmanager does not accept any new requests (shutting down)          1
    Globus error 73: the job manager failed to open stdout                2
    Globus error 111: the job manager timed out while waiting for a commit signal          1
    Globus error 74: the job manager failed to open stderr              147
    Globus error 8: the user cancelled the job                            3
    Globus error 130: the job manager was sent a stop signal (job is still running)          1
garlic.hep.wisc.edu/jobmanager-condor
  Current Status:
    Finished                      4
    Held                         10
  Historic Holds:
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          3
    Unspecified gridmanager error                                         1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         88
    Globus error 76: cannot access cache files in ~/.globus/.gass_cache, check permissions, quota, and disk space          1
    Globus error 73: the job manager failed to open stdout                2
    Globus error 74: the job manager failed to open stderr              144
    Globus error 8: the user cancelled the job                            4
grid.dpcc.uta.edu/jobmanager-pbs
  Current Status:
    Finished                    218
    Held                         10
  Historic Holds:
    Unspecified gridmanager error                                         5
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         40
    Globus error 121: the job state file doesn't exist                   11
    Globus error 94: the jobmanager does not accept any new requests (shutting down)          1
    Globus error 73: the job manager failed to open stdout                8
    Globus error 74: the job manager failed to open stderr              203
    Globus error 8: the user cancelled the job                            7
    Globus error 130: the job manager was sent a stop signal (job is still running)          1
grid02.uchicago.edu/jobmanager-condor
  Current Status:
    Finished                     21
    Held                          3
  Historic Holds:
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         25
    Globus error 121: the job state file doesn't exist                    2
    Globus error 73: the job manager failed to open stdout                1
    Globus error 74: the job manager failed to open stderr               54
    Globus error 8: the user cancelled the job                            4
iuatlas.physics.indiana.edu/jobmanager-condor
  Current Status:
    Finished                     75
    Held                          4
  Historic Holds:
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          2
    Unspecified gridmanager error                                         1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         26
    Globus error 121: the job state file doesn't exist                    6
    Globus error 94: the jobmanager does not accept any new requests (shutting down)          1
    Globus error 43: the job manager failed to stage the executable          1
    Globus error 73: the job manager failed to open stdout                2
    Globus error 74: the job manager failed to open stderr               81
    Globus error 8: the user cancelled the job                            2
jermaine.cs.wisc.edu/jobmanager-condor
  Current Status:
    Pending                       1
    Held                          7
  Historic Holds:
    Unspecified gridmanager error                                         7
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         62
    Globus error 73: the job manager failed to open stdout                4
    Globus error 74: the job manager failed to open stderr              126
    Globus error 8: the user cancelled the job                            5
lldimu.alliance.unm.edu/jobmanager-pbs
  Current Status:
    Removed                      10
  Historic Holds:
spider.usatlas.bnl.gov/jobmanager-condor
  Current Status:
    Finished                    217
    Held                         10
  Historic Holds:
    Globus error 156: the job contact string does not match any which the job manager is handling          1
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          3
    Unspecified gridmanager error                                         5
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         40
    Globus error 121: the job state file doesn't exist                   13
    Globus error 94: the jobmanager does not accept any new requests (shutting down)          2
    Globus error 73: the job manager failed to open stdout                7
    Globus error 74: the job manager failed to open stderr              119
    Globus error 8: the user cancelled the job                            3
    Globus error 129: the standard output/error size is different          1
t2cms0.sdsc.edu/jobmanager-condor
  Current Status:
    Finished                    196
    Held                         10
  Historic Holds:
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          2
    Unspecified gridmanager error                                         1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         39
    Globus error 121: the job state file doesn't exist                    9
    Globus error 73: the job manager failed to open stdout                7
    Globus error 74: the job manager failed to open stderr              205
    Globus error 8: the user cancelled the job                            1
    Globus error 129: the standard output/error size is different          1
tam01.fnal.gov/jobmanager-condor
  Current Status:
    Held                         10
  Historic Holds:
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         14
    Globus error 47: the gatekeeper failed to run the job manager        805
ufgrid01.phys.ufl.edu/jobmanager-condor
  Current Status:
    Held                         10
  Historic Holds:
    Globus error 79: connecting to the job manager failed.  Possible reasons: job terminated, invalid job contact, network problems, ...          1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         46
    Globus error 73: the job manager failed to open stdout                6
    Globus error 74: the job manager failed to open stderr              115
    Globus error 8: the user cancelled the job                            9
ufloridaPG.phys.ufl.edu/jobmanager-condor
  Current Status:
    Removed                      10
  Historic Holds:
uscmstb0.ucsd.edu/jobmanager-condor
  Current Status:
    Finished                     41
    Held                          2
  Historic Holds:
    Unspecified gridmanager error                                         1
    Globus error 7: authentication failed: GSS Major Status: Authentication Failed GSS Minor Status Error Chain:  init.c:499: globus_gss_assist_init_sec_context_async: Error during context initialization init_sec_context         15
    Globus error 121: the job state file doesn't exist                    2
    Globus error 73: the job manager failed to open stdout                5
    Globus error 74: the job manager failed to open stderr               54
    Globus error 8: the user cancelled the job                            1


This report took 3.7 minutes to generate

From 