Continuous Job Submission using CRAB on OSG T2 during SC3
Description of the Activity
The goal of CMS Service Challenge 3 (SC3) was to test integrity of data transfer and service infrastructure.
There were two phases of SC3,
Phase I during Sep. - Oct. 2005,
and
Phase II during Nov. - Dec. 2005.
For Phase I, the data transfer and Grid job submission to read and analyze data occurred.
For Phase II, data flow scenario was tested, namely, data transfer from Tier0 to Tier1 with
raw and reconstructed data, transfer of Tier1 production data to Tier2 for analysis, and Tier2
production data to Tier1.
There were a total of 21 sites that were involved in the SC3: CERN(Tier0), ASGC, CNAF, FNAL,
FZK, IN2P3, PIC, RAL (7 Tier1's), DESY, Bari, Legnaro, CIEMAT, IFCA, NCU, Imperial, Caltech,
Florida, Nebraska, Purdue, UCSD, and Wisconsin (13 Tier2's).
As a part of SC3 CMS central responsibilities, we used a modified CMS Remote Analysis Builder (CRAB) to submit CMS analysis jobs through condor-G to OSG T2's (Caltech, Florida, Nebraska, Purdue, UCSD, and Wisconsin). This continuous CRAB job submission activity was to ensure data publication and Grid services in the sites. The monitoring information was centrally collected using MonALISA and presented using the ARDA Dashboard. The CRAB job submission was also monitored using a combined tool of database and php for the web-frontend presentation at the job submission host.
