(r4) TriggerValidationTutorial < Main

Tags: , view all tags

---+ Exotica Trigger Validation Tutorial
<h1>
---
</h1>
---++ General Idea

The trigger validation is based on FullSim RelVal samples produced centrally for every campaign. The idea is to compare some monitor elements for the exotica trigger path in a given trigger menu. The comparison of one release is done, category by category, with respect to the efficiency of the previous validated release. There are 27 categories grouping triggers with similar features, as defined in the slides linked [[https://indico.cern.ch/event/570559/contributions/2307674/subcontributions/208213/attachments/1376476/2090347/TSG_Nov23.pdf#search=Jose%20Cupertino][here]]. The name of the sample depends on the category, and sometimes the same sample is used in several categories. 
---++ Technical Details

Each category corresponds to a CMSSW configure file, localized in following folder:

<a target="_blank" href="https://github.com/cms-sw/cmssw/tree/master/HLTriggerOffline/Exotica/python/analyses">https://github.com/cms-sw/cmssw/tree/master/HLTriggerOffline/Exotica/python/analyses</a>

It is duty of the validator to keep these configures updated according to the latest trigger menu. Every time a new trigger path is added to the menu, the validator has to include the path in the most suitable category. Usually these requests are accompanied by a JIRA ticket opened by the developers of the trigger path. 

For each CMSSW release, this RelVal sample is generated and the trigger analysis code is run centrally. The plots are them acessible on the DQM Offline system at the CMSWeb platform, as well as in the RelMon platform. Links and details on how to access will be shown in the step-by-step of a validation below.

---++ Validation step-by-step
---+++ 1. Check the available and the previous validated releases

This can be done by checking the ValDB website:

https://cms-pdmv.cern.ch/valdb/

That is how the website looks like (April/2017):

<img width="600" alt="" src="%ATTACHURL%/valdb1.png" height="304" />

To check a list of related releases, write part of the name in the "Select one release" box. For instance, for releases of the family 9_1_X, write 9_1. The website will then warn you how many releases match this search criteria:

<img width="600" alt="" src="%ATTACHURL%/valdb2.png" height="302" />

The releases to be shown will then appear in the "List of releases" item. To select all, just click on "Show all". All selected releases will then be shown in the list in the right column of the website:

<img width="600" alt="" src="%ATTACHURL%/valdb3.png" height="294" />

The status of each of the trigger validation can be seen if HLT -&gt; FullSim is selected in the gray menu in the bottom right of the page. The legend shows what each symbol means. This is where we can see which of the CMSSW releases still need validation (in this screenshot example, 9_1_0_pre1).

<img width="600" alt="" src="%ATTACHURL%/valdb4.png" height="326" />
---+++ 2. Check plots on RelMon

Click on the RelMon box in ValDB (note you need your certificate installed in the browser). Alternatively access directly through the link below:

https://cms-pdmv.cern.ch/relmon/

<img width="600" alt="relmon.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/relmon.png" title="relmon.png" height="517" />

Scroll down and localize the subcategory FullSimReport_HLT in the comparison cmssw_9_1_0_pre1_2017vscmssw_9_0_0_2017

<img width="600" alt="relmon1.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/relmon1.png" title="relmon1.png" height="517" />

Click on the subcategory FullSimReport_HLT

<img width="600" alt="relmon2.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/relmon2.png" title="relmon2.png" height="517" />

Scroll down and localize the Exotica pie charts in summary table 

<img width="600" alt="relmon3.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/relmon3.png" title="relmon3.png" height="517" />

Click on the pie chart under the RelValADDMonoJet sample

<img width="600" alt="relmon4.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/relmon4.png" title="relmon4.png" height="517" />

Scroll down and localize the sub-directory Monojet

<img width="600" alt="relmon5.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/relmon5.png" title="relmon5.png" height="517" />

Click on the pie chart and visualize the monitor elements

<img width="600" alt="relmon6.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/relmon6.png" title="relmon6.png" height="517" />

The procedure above is repeated for each category. Then, all the results have to be reported. This is done once more in the ValDB website.

---+++ ValDB report

Once more, enter the ValDB website. Click on the square corresponding to the CMSSW release to be validated, in the column of "Exotica". A new window will appear:

<img width="600" alt="valdbreport.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/valdbreport.png" title="valdbreport.png" height="517" />

Click on "Edit Information". Change the "Exotica Validation Status" to the proper value. If nothing is wrong to be reported, "OK". If something is wrong and needs attention, "Failure", and explain why next. In the field "Comments", you say if the trigger menu is the same or if the number of triggers changed, and if it did, how it changed (this is part of the output from the trigger script). In the field "Links", you paste the link to RelMon which you have obtained before, for every category. This window looks like:

<img width="600" alt="valdbreport2.png" src="https://www.sprace.org.br/twiki/pub/Main/TriggerValidationTutorial/valdbreport2.png" title="valdbreport2.png" height="517" />

You click on "Save Information" and an automated email will warn the appropriate mailing lists that this relase has been validated, and what is the result of this validation.

The Exotica trigger validation is now done. Move to the next not validated release, and repeat all the procedure.

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who
txt	EXO_900pre42017.txt	r1	manage	4.6 K	2017-04-05 - 16:31	UnknownUser
png	relmon.png	r1	manage	344.1 K	2017-04-05 - 15:58	UnknownUser
png	relmon1.png	r1	manage	266.2 K	2017-04-05 - 15:59	UnknownUser
png	relmon2.png	r1	manage	108.7 K	2017-04-05 - 15:59	UnknownUser
png	relmon3.png	r1	manage	160.3 K	2017-04-05 - 15:59	UnknownUser
png	relmon4.png	r1	manage	125.8 K	2017-04-05 - 16:00	UnknownUser
png	relmon5.png	r1	manage	105.0 K	2017-04-05 - 16:00	UnknownUser
png	relmon6.png	r1	manage	169.1 K	2017-04-05 - 16:00	UnknownUser
png	valdb1.png	r2 r1	manage	105.7 K	2017-04-05 - 15:40	UnknownUser
png	valdb2.png	r3 r2 r1	manage	113.1 K	2017-04-05 - 15:44	UnknownUser
png	valdb3.png	r2 r1	manage	76.4 K	2017-04-05 - 15:41	UnknownUser
png	valdb4.png	r2 r1	manage	103.5 K	2017-04-05 - 15:41	UnknownUser
png	valdbreport.png	r2 r1	manage	102.8 K	2017-04-05 - 15:41	UnknownUser
png	valdbreport2.png	r2 r1	manage	131.5 K	2017-04-05 - 15:41	UnknownUser

Topic revision: r4 - 2017-04-05 - jruizvar

antalya escort bursa escort eskisehir escort istanbul escort izmir escort