AlpgenProduction2009 < Main

Tags: , view all tags
---+ Alpgen Production 2009

   * Continuation of AlpgenProduction2008, for the scale studies.

---++ Scale studies
   * Started with W+jets, =iqopt=4=, based on Maurizio's code.
   * Takes a little over one day to run for W+1,2,3,4 jets.
   * Takes a little over two days and a half to run for W+5 jets in the (0,100),(100,300),(300,800) bins.
   * Takes a little over five days and a half to run for W+5 jets in the (800,1600),(1600,infinity) bins.
      * Those two were NOT finished before New Year's Eve. Starting anew today.
   * W+0 jets will run interactively in order to understand what is going on (NOT OUTPUT).

-- Main.ThiagoTomei - 04 Jan 2009

   * Running four parameter space points: =iqopt=2=, =qfac=0.5= and =qfac=2.0=, besides what is left from =iqopt=4=.
   * %TWISTY{mode="div" showlink="Meaning of each parameter space point" hidelink="Hide meanings" remember="off" firststart="hide" showimgleft="%ICONURLPATH{toggleopen-small}%"  hideimgleft="%ICONURLPATH{toggleclose-small}%"}%
   <verbatim>
 ------
 scale option (process dependent):
 iqopt= 1
 Options for Factorization/renormalization scale Q:
 iqopt=0 => Q=qfac
 iqopt=1 => Q=qfac*sqrt{m_W^2+ sum(pt_jet^2)}
 iqopt=2 => Q=qfac*mW
 iqopt=3 => Q=qfac*sqrt{m_W^2+ pt_W^2}
 iqopt=4 => Q=qfac*sqrt{sum(pt_jet^2)}
 To select CKKW scale input 'ickkw 1' 
 (mandatory for later use of jet matching)
 In imode=2 select clustering option 'cluopt':
 cluopt=1: kperp propto pt(cluster) (default)
 cluopt=2: kperp propto mt(cluster)
 kperp is then rescaled by ktfac
 ------
 Q scale rescaling factor:
 qfac=  1.
 ------
   </verbatim>
   %ENDTWISTY%
   * Each parameter space point ensues 26 jobs. 3 X 26 = 78 jobs.
   * Plus the two leftovers from =iqopt=4=.
   * Total: 80 jobs
   * Expect everything to be ready by Sunday night. 

-- Main.ThiagoTomei - 05 Jan 2009

   * W4 (the last two bins) and W5 (five bins) are still running for =iqopt=2=,=qfac_half= and =qfac_double=. That means 3 X 7 = 21 jobs
   * The two jobs from =iqopt=4= (the last two W5 bins) are still running. That means 2 jobs.
   * The W0 bin from =iqopt=4= will be run interactively. That means 0 jobs.
   * Total: 23 jobs
   * All other jobs finished successfully! =)

%TWISTY{mode="div" showlink="Status" hidelink="Hide status" remember="off" firststart="hide" showimgleft="%ICONURLPATH{toggleopen-small}%"  hideimgleft="%ICONURLPATH{toggleclose-small}%"}%
<verbatim>
-- Submitter: access.sprace.org.br : <192.168.1.154:63543> : access.sprace.org.br
 ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD               
 731.0   trtomei         1/5  23:57   0+16:32:50 R  0   43.9 w5_800ptw1600.sh  
 732.0   trtomei         1/5  23:57   0+16:32:20 R  0   43.9 w5_1600ptw.sh     
 752.0   trtomei         1/6  00:13   0+16:11:25 R  0   43.9 w4_1600ptw.sh     
 754.0   trtomei         1/6  00:13   0+16:16:18 R  0   43.9 w4_800ptw1600.sh  
 755.0   trtomei         1/6  00:13   0+16:16:21 R  0   43.9 w5_0ptw100.sh     
 756.0   trtomei         1/6  00:13   0+16:16:21 R  0   43.9 w5_100ptw300.sh   
 757.0   trtomei         1/6  00:13   0+16:16:21 R  0   43.9 w5_1600ptw.sh     
 758.0   trtomei         1/6  00:13   0+16:16:21 R  0   43.9 w5_300ptw800.sh   
 759.0   trtomei         1/6  00:13   0+16:16:21 R  0   43.9 w5_800ptw1600.sh  
 778.0   trtomei         1/6  00:34   0+15:55:45 R  0   43.9 w4_1600ptw.sh     
 780.0   trtomei         1/6  00:34   0+15:55:44 R  0   43.9 w4_800ptw1600.sh  
 781.0   trtomei         1/6  00:34   0+15:55:42 R  0   43.9 w5_0ptw100.sh     
 782.0   trtomei         1/6  00:34   0+15:55:44 R  0   43.9 w5_100ptw300.sh   
 783.0   trtomei         1/6  00:34   0+15:55:44 R  0   43.9 w5_1600ptw.sh     
 784.0   trtomei         1/6  00:34   0+15:55:45 R  0   43.9 w5_300ptw800.sh   
 785.0   trtomei         1/6  00:34   0+15:55:42 R  0   43.9 w5_800ptw1600.sh  
 804.0   trtomei         1/6  00:34   0+15:55:45 R  0   46.4 w4_1600ptw.sh     
 806.0   trtomei         1/6  00:34   0+15:55:45 R  0   43.9 w4_800ptw1600.sh  
 807.0   trtomei         1/6  00:34   0+15:55:45 R  0   43.9 w5_0ptw100.sh     
 808.0   trtomei         1/6  00:34   0+15:55:45 R  0   43.9 w5_100ptw300.sh   
 809.0   trtomei         1/6  00:34   0+15:55:45 R  0   43.9 w5_1600ptw.sh     
 810.0   trtomei         1/6  00:34   0+15:55:44 R  0   43.9 w5_300ptw800.sh   
 811.0   trtomei         1/6  00:34   0+15:55:44 R  0   43.9 w5_800ptw1600.sh  

23 jobs; 0 idle, 23 running, 0 held
</verbatim>
%ENDTWISTY%

-- Main.ThiagoTomei - 06 Jan 2009

%TWISTY{mode="div" showlink="Status" hidelink="Hide status" remember="off" firststart="hide" showimgleft="%ICONURLPATH{toggleopen-small}%"  hideimgleft="%ICONURLPATH{toggleclose-small}%"}%
<verbatim>
-- Submitter: access.sprace.org.br : <192.168.1.154:63543> : access.sprace.org.br
 ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD               
 731.0   trtomei         1/5  23:57   1+21:42:36 R  0   43.9 w5_800ptw1600.sh  
 732.0   trtomei         1/5  23:57   1+21:42:06 R  0   43.9 w5_1600ptw.sh     
 757.0   trtomei         1/6  00:13   1+21:26:07 R  0   43.9 w5_1600ptw.sh     
 758.0   trtomei         1/6  00:13   1+21:26:07 R  0   43.9 w5_300ptw800.sh   
 759.0   trtomei         1/6  00:13   1+21:26:07 R  0   43.9 w5_800ptw1600.sh  
 783.0   trtomei         1/6  00:34   1+21:05:30 R  0   43.9 w5_1600ptw.sh     
 784.0   trtomei         1/6  00:34   1+21:05:31 R  0   43.9 w5_300ptw800.sh   
 785.0   trtomei         1/6  00:34   1+21:05:28 R  0   43.9 w5_800ptw1600.sh  
 809.0   trtomei         1/6  00:34   1+21:05:31 R  0   43.9 w5_1600ptw.sh     
 810.0   trtomei         1/6  00:34   1+21:05:30 R  0   43.9 w5_300ptw800.sh   
 811.0   trtomei         1/6  00:34   1+21:05:30 R  0   43.9 w5_800ptw1600.sh  

11 jobs; 0 idle, 11 running, 0 held
</verbatim>
%ENDTWISTY%

-- Main.ThiagoTomei - 07 Jan 2009

%TWISTY{mode="div" showlink="Status" hidelink="Hide status" remember="off" firststart="hide" showimgleft="%ICONURLPATH{toggleopen-small}%"  hideimgleft="%ICONURLPATH{toggleclose-small}%"}%
<verbatim>
-- Submitter: access.sprace.org.br : <192.168.1.154:63543> : access.sprace.org.br
 ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD               
 731.0   trtomei         1/5  23:57   4+16:27:18 R  0   43.9 w5_800ptw1600.sh  
 732.0   trtomei         1/5  23:57   4+16:26:48 R  0   43.9 w5_1600ptw.sh     
 757.0   trtomei         1/6  00:13   4+16:10:49 R  0   43.9 w5_1600ptw.sh     
 759.0   trtomei         1/6  00:13   4+16:10:49 R  0   43.9 w5_800ptw1600.sh  
 783.0   trtomei         1/6  00:34   4+15:49:50 R  0   43.9 w5_1600ptw.sh     
 785.0   trtomei         1/6  00:34   4+15:50:10 R  0   43.9 w5_800ptw1600.sh  
 809.0   trtomei         1/6  00:34   4+15:50:13 R  0   43.9 w5_1600ptw.sh     
 811.0   trtomei         1/6  00:34   4+15:50:12 R  0   43.9 w5_800ptw1600.sh  

8 jobs; 0 idle, 8 running, 0 held
</verbatim>
%ENDTWISTY%
   * The remaining jobs should finish tomorrow by 16h.

-- Main.ThiagoTomei - 10 Jan 2009

   * Every job finished correctly, EXCEPT for =qfac_double/w5_1600ptw_dir/=

%TWISTY{mode="div" showlink="Logfile" hidelink="Hide logfile" remember="off" firststart="hide" showimgleft="%ICONURLPATH{toggleopen-small}%"  hideimgleft="%ICONURLPATH{toggleclose-small}%"}%
<verbatim>   
000 (783.000.000) 01/06 00:34:04 Job submitted from host: <192.168.1.154:63543>
...
001 (783.000.000) 01/06 00:34:26 Job executing on host: <192.168.1.69:63859>
...
006 (783.000.000) 01/06 00:34:34 Image size of job updated: 43456
...
006 (783.000.000) 01/07 06:49:32 Image size of job updated: 43488
...
007 (783.000.000) 01/09 10:00:08 Shadow exception!
	Error from starter on slot3@node69.grid: ProcD has failed
	0  -  Run Bytes Sent By Job
	0  -  Run Bytes Received By Job
...
001 (783.000.000) 01/09 10:00:31 Job executing on host: <192.168.1.77:64459>
...
006 (783.000.000) 01/10 16:05:37 Image size of job updated: 42668
...
006 (783.000.000) 01/11 11:40:35 Image size of job updated: 42700
...
</verbatim>
%ENDTWISTY%

   * Expected finishing time: Jan 14, 22h
   * Tasks:
      * Contact Maurizio about the status
      * Run the W+0jets, =iqopt=4= interactively
   * Houston, we have a problem here:
      *  =iqopt=4= => Q=qfac*sqrt{sum(pt_jet^2)}
      * But, for W+0jets, that means Q is ZERO!
      * No wonder it doesn't run!!!

   * Some statistics:
      * Of 80 jobs, 79 finished correctly and on time - 98.75% efficiency
      * Of the largest jobs (the tails of W+5jets), the 7 out of 8 that finished took , on average, 4d21h to finish.
      * So five days and a half is an overestimate, but it gives a 10% safety margin.
      
-- Main.ThiagoTomei - 12 Jan 2009

   * All done. Report given to Maurizio and Christopher.
   * Consolidated results coming soon.

-- Main.ThiagoTomei - 14 Jan 2009

   * The =grid2= and =input= files are in the following links.
   * http://cmsdoc.cern.ch/~tomei/Wjets_iqopt2.tar.gz
   * http://cmsdoc.cern.ch/~tomei/Wjets_iqopt4.tar.gz
   * http://cmsdoc.cern.ch/~tomei/Wjets_qfac_double.tar.gz
   * http://cmsdoc.cern.ch/~tomei/Wjets_qfac_half.tar.gz

-- Main.ThiagoTomei - 27 Jan 2009

E-mail from Maurizio about the wrong grids:
<verbatim>
If you look at the wjetusr_800ptw1600.f files you have in your dirs, you will see
that the cut on the pt is wrong.

I am redoing the 25 grids. I have 12 of them done, in ~2h
I am running the others. Of course those that finished earlier are
the 1j, 2j, and some 3j.

I am running on lxcms127, 132, and 133

I hope they will be ready for tomorrow morning

Stay tuned because tomorrow we will have to make a new tag
they are waiting for us
</verbatim>

We ran it that same night and everything worked out.

-- Main.ThiagoTomei - 01 May 2009
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
root	Wjets_scaletudies.root	r1	manage	6.3 K	2009-02-09 - 17:26	ThiagoTomei	ROOT file
ods	Wjets_scalestudies.ods	r1	manage	27.8 K	2009-02-09 - 17:25	ThiagoTomei	ODF spreadsheet
Topic revision: r11 - 2009-05-01 - ThiagoTomei
antalya escort bursa escort eskisehir escort istanbul escort izmir escort