(r35) SpraceMonitoring < Main

Tags: , view all tags
---+!! SPRACE Monitoring
%TOC{depth="3"}%




---++CERN

---+++ CMS Site Readiness Status

<table cellspacing="3" cellpadding="1" class="twikiTable" border="0">
<tr>
<td width="45%" bgcolor="#eaeaea" class="twikiFirstCol">
Site Readiness Status has a summary of whether CMS sites are passing the different site
commissioning metrics, day by day.
</td>
<td width="25%" bgcolor="#eaeaea" align="center">
<!--
<a href="http://web.pic.es/cms/SiteReadinessReports/SiteReadinessReport.html" target="_blank"><img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/SCGS.png"></a>
-->
<a href="http://lhcweb.pic.es/cms/SiteReadinessReports/SiteReadinessReport_%SERVERTIME{"$year$mo$day"}%.html#T2_BR_SPRACE" target="_blank"><img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/SCGS.png"  width='250' height='200'></a>
</td>
<td width="3%" bgcolor="#eaeaea" align="center"> 
<a href="http://lhcweb.pic.es/~cms/" target="_blank">
<img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/info.gif"></a> 
</td>
<td width="27%" bgcolor="#eaeaea" align="center">
<a href="http://web.pic.es/cms/SiteReadinessReports/SiteReadinessReport.html#T2_BR_SPRACE" target="_blank">Site Commissioning Global Status</a>
</td>
</tr>
</table>

---+++ !HammerCloud

<table cellspacing="3" cellpadding="1" class="twikiTable" border="0">
<tr>
<td width="45%" bgcolor="#eaeaea" class="twikiFirstCol">
!HammerCloud (HC) is a Distributed Analysis testing system. It can test your site(s) and report the results obtained on that test. Used to perform basic site validation, help commission new sites, evaluate SW changes, compare site performances... 
</td>
<td width="25%" bgcolor="#eaeaea" align="center">
<a href="http://hammercloud.cern.ch/hc/app/cms/test/6079/" target="_blank"><img src="%ATTACHURLPATH%/hammercloud.png" width='250' height='200' />
</td>
 <td width="3%" bgcolor="#eaeaea" align="center"> 
<a href="https://twiki.cern.ch/twiki/bin/view/CMS/CMSHammerCloud" target="_blank">
<img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/info.gif"></a> 
</td>
<td width="27%" bgcolor="#eaeaea" align="center">
<a href="http://hammercloud.cern.ch/hc/app/cms/joberrors/?site=&cloud=5&test=&template=&start_date=&end_date=" target="_blank">HammerCloud summary page for FNAL region</a>
</td>
</tr>
</table>


---+++Generic Information Provider (GIP) Validation Service

<table cellspacing="3" cellpadding="1" class="twikiTable" border="0">
<tr>
<td width="45%" bgcolor="#eaeaea" class="twikiFirstCol">
Generic Information Provider (GIP) a configurable LDAP information provider that differentiates between static and dynamic information. OSG sites use GIP to advertise a variety of grid-related configuration data. GIP is interoperable with LCG.
</td>
<td width="25%" bgcolor="#eaeaea" align="center">
<a href="https://myosg.grid.iu.edu/rggipstatus/index?gip_status_attrs_showtestresults=on&gip_status_attrs_showwlcgstatus=on&gip_status_attrs_showresource=on&downtime_attrs_showpast=&account_type=cumulative_hours&ce_account_type=gip_vo&se_account_type=vo_transfer_volume&bdiitree_type=total_jobs&bdii_object=service&bdii_server=is-osg&start_type=yesterday&start_date=06%2F01%2F2010&end_type=now&end_date=06%2F07%2F2010&facility_10009=on&rg=on&rg_99=on&gridtype=on&gridtype_1=on&service_1=on&service_5=on&active=on&active_value=1&disable_value=1" target="_blank"><img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/GIP_Thumb.png" height="200" width="250"></a>
</td>
<td width="3%" bgcolor="#eaeaea" align="center"> 
<a href="https://twiki.grid.iu.edu/twiki/bin/view/ArchivedDocumentation/ITB/ITB050/GenericInformationProviders" target="_blank">
<img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/info.gif"></a> 
</td>
<td width="27%" bgcolor="#eaeaea" align="center">
<a href="https://myosg.grid.iu.edu/rggipstatus/index?gip_status_attrs_showtestresults=on&gip_status_attrs_showwlcgstatus=on&gip_status_attrs_showresource=on&downtime_attrs_showpast=&account_type=cumulative_hours&ce_account_type=gip_vo&se_account_type=vo_transfer_volume&bdiitree_type=total_jobs&bdii_object=service&bdii_server=is-osg&start_type=yesterday&start_date=06%2F01%2F2010&end_type=now&end_date=06%2F07%2F2010&facility_10009=on&rg=on&rg_99=on&gridtype=on&gridtype_1=on&service_1=on&service_5=on&active=on&active_value=1&disable_value=1" target="_blank">OGS-GIP Validator</a>
</td>
</tr>
</table>


---++ OSG Overview Page - Gratia

<table cellspacing="3" cellpadding="1" class="twikiTable" border="0">
<tr>
<td width="45%" bgcolor="#eaeaea" class="twikiFirstCol">
This page is designed to give outside users a view of what the OSG is currently doing.
</td>
<td width="25%" bgcolor="#eaeaea" align="center">
<a href="http://gratiaweb.grid.iu.edu/gratiastatic/today/osg_wall_hours.png" target="_blank">
<img src="http://gratiaweb.grid.iu.edu/gratiastatic/today/osg_wall_hours.png" alt="Computation Hours Per Week" border="1" height="200" width="250" /></a>
<br>
<a href="http://gratiaweb.grid.iu.edu/gratiastatic/today/facility_hours_bar_smry.png" target="_blank">
<img src="http://gratiaweb.grid.iu.edu/gratiastatic/today/facility_hours_bar_smry.png" alt="Hours Spent on Jobs by Facility" border="1" height="200" width="250" /></a>
<br>
<a href="http://gratiaweb.grid.iu.edu/gratiastatic/today/osg_wall_cumulative.png" target="_blank">
<img src="http://gratiaweb.grid.iu.edu/gratiastatic/today/osg_wall_cumulative.png" alt="Cumulative Computation Hours" border="1" height="200" width="250" /></a>
<br>
<a href="http://gratiaweb.grid.iu.edu/gratiastatic/today/facility_success_cumulative_smry.png" target="_blank">
<img src="http://gratiaweb.grid.iu.edu/gratiastatic/today/facility_success_cumulative_smry.png" alt="Comulative Hours Spent on Jobs by Facility" border="1" height="200" width="250" /></a>
</td>
<td width="3%" bgcolor="#eaeaea" align="center"> 
<a href="http://t2.unl.edu/gratia/" target="_blank">
<img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/info.gif"></a> 
</td>
<td width="27%" bgcolor="#eaeaea" align="center"> 
<a href="http://t2.unl.edu/gratia/" target="_blank">OSG Overview Page</a>
<br>
<a href="http://t2.unl.edu/gratia/main" target="_blank">OSG Storage</a>
<br>
<a href="http://gratiaweb.grid.iu.edu/gratia/wlcg_reporting" target="_blank">WLCG Reporting</a>
<br>
<a href="http://t2.unl.edu/gratia/uscms_t2_site_avail" target="_blank">USCMS T2 SAM Availability</a> 
</td>
</tr>
</table>

---++ OSG Monitoring Services: 

This [[https://twiki.grid.iu.edu/twiki/bin/view/ReleaseDocumentation/SiteMonitoringServices][twiki page]] discusses site-level service monitoring (for eg., of compute elements) that is collected and monitored centrally.

[[http://myosg.grid.iu.edu/about][MyOSG]] is a web interface for OSG Operations Information Center. Its primary goal is to provide a one-stop location for all of OSG related information by allowing you to quickly find and export the information in the format that you'd like.

The Open Science Grid (OSG) provides many [[https://twiki.grid.iu.edu/twiki/bin/view/MonitoringInformation/WebHome][monitoring and information systems]] 
to its collaborators for purposes of gathering data about available Resources on the grid.

---+++ Resource and Service Validation (RSV) Service:

<table cellspacing="3" cellpadding="1" class="twikiTable" border="0">
<tr>
<td width="45%" bgcolor="#eaeaea" class="twikiFirstCol">
In OSG, the RSV system, as installed on OSG 0.8.0 compute elements, reports locally scheduled probe results to a central collector operated by the GOC.
</td>
<td width="25%" bgcolor="#eaeaea" align="center">
At present there is no web-visible monitor for this service, but the data upload into the collector is monitored by the GOC staff.
</td>
<td width="3%" bgcolor="#eaeaea" align="center"> 
<a href="https://twiki.grid.iu.edu/twiki/bin/view/MonitoringInformation/RSV" target="_blank">
<img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/info.gif"></a> 
</td>
<td width="27%" bgcolor="#eaeaea" align="center"> 
<a href="https://twiki.grid.iu.edu/twiki/bin/view/MonitoringInformation/RSV" target="_blank">RSV</a>
</td>
</tr>
</table>

---+++ VO Resource Selector (VORS)

<table cellspacing="3" cellpadding="1" class="twikiTable" border="0">
<tr>
<td width="45%" bgcolor="#eaeaea" class="twikiFirstCol"> 
This tests critical health of the resource. (Ping, Hello World, !GridFTP, and Looks to see a Job Manager is available and running. Many VOs have more requirements, so this does not always equal jobs.)
</td>
<td width="25%" bgcolor="#eaeaea" align="center"> 
<a href="http://vors.grid.iu.edu/" target="_blank"><img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/vors_thumb.png"></a>
</td>
<td width="3%" bgcolor="#eaeaea" align="center"> 
<a href="http://vors.grid.iu.edu/documentation" target="_blank">
<img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/info.gif"></a> 
</td>
<td width="27%" bgcolor="#eaeaea" align="center"> 
<a href="http://vors.grid.iu.edu/cgi-bin/index.cgi" target="_blank">VORS</a>
<br>
<a href="http://vors.grid.iu.edu/cgi-bin/index.cgi?region=2&VO=1&grid=1&dtype=0&res=38#SPRACE-CE" target="_blank">SPRACE @ VORS</a>
</td>
</tr>
</table>


---+++ !MonALISA
This is a optional service and available as a courtesy for Resource Admins to watch their sites. It has no real bearing to how OSG jobs are submitted.

   * [[http://nui.uits.indiana.edu:8080/show?page=index.html][MonALISA]]

---+++ CEMon/BDII Integrated Server Status

<table cellspacing="3" cellpadding="1" class="twikiTable" border="0">
<tr>
<td width="45%" bgcolor="#eaeaea" class="twikiFirstCol"> 
This is used by some VOs the same way as !ReSS, it pulls raw Glue Schema data and serves it in LDAP format.
</td>
<td width="25%" bgcolor="#eaeaea" align="center"> 
<a href="http://is.grid.iu.edu/cgi-bin/status.cgi/" target="_blank"><img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/cemon_thumb.png"></a>
</td>
<td width="3%" bgcolor="#eaeaea" align="center"> 
<a href="https://twiki.grid.iu.edu/twiki/bin/view/ArchivedDocumentation/ITB/ITB070/CEMonOnComputeElement" target="_blank">
<img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/info.gif"></a> 
</td>
<td width="27%" bgcolor="#eaeaea" align="center"> 
<a href="http://is.grid.iu.edu/cgi-bin/status.cgi/" target="_blank">CEMon/BDII</a>
</td>
</tr>
</table>

---+++ Dashboard:

<table cellspacing="3" cellpadding="1" class="twikiTable" border="0">
<tr>
<td width="45%" bgcolor="#eaeaea" class="twikiFirstCol">
The Dashboard project for LHC experiments aims to provide a single entry point to the monitoring data collected from the distributed computing systems of the LHC virtual organization. The Dashboard collects information from multiple sources. It covers various activities of the LHC experiments like job processing, data management, transfer tests, monitoring of the reconstruction at Tier-0, or monitoring of site efficiency. The Dashboard is currently working on different Grid flavors (OSG, LCG, gLite). It is deployed for the four LHC experiments ATLAS, ALICE, CMS and LHCb.
</td>
<td width="25%" bgcolor="#eaeaea" align="center"> 
<a href="http://lxarda16.cern.ch/dashboard/request.py/latestresultssmry?siteSelect3=T2&serviceTypeSelect3=vo&sites=T2_BR_SPRACE&services=CE&services=SRMv2&tests=1301&tests=133&tests=111&tests=6&tests=1261&tests=76&tests=64&tests=20&tests=281&tests=882&exitStatus=all" target="_blank"><img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/dashboard.jpg"></a>
</td>
<td width="3%" bgcolor="#eaeaea" align="center"> 
<a href="http://dashboard.cern.ch/" target="_blank">
<img src="http://www.sprace.org.br/Twiki/Images/OSG_Monitoring/info.gif"></a> 
</td>
<td width="27%" bgcolor="#eaeaea" align="center">
<a href="http://dashboard.cern.ch/" target="_blank">- Dashboard</a>
<br>
<a href="http://dashboard.cern.ch/cms/index.html" target="_blank">- CMS Dashboard</a>
<br>
<a href="http://lxarda16.cern.ch/dashboard/request.py/historicalsiteavailabilityranking?siteSelect3=T2&sites=T2_BR_SPRACE&sites=T2_BR_UERJ&sites=T2_US_Caltech&sites=T2_US_Florida&sites=T2_US_MIT&sites=T2_US_Nebraska&sites=T2_US_Purdue&sites=T2_US_UCSD&sites=T2_US_Wisconsin&timeRange=last24" target="_blank">- USCMS-T2 Availabity</a>
<br>
- Site Status for the CMS sites:
<a href="http://dashb-cms-sv.cern.ch/dashboard/request.py/siteviewhome" target="_blank">Index</a>, 
<a href="http://dashb-cms-sv.cern.ch/dashboard/request.py/siteview" target="_blank">Expanded</a>,
<a href="http://gridmap.cern.ch/gm/#topo=regions&layout=tc&vo=CMS&serv=Site&osg" target="_blank">GridMap</a>.
<br> 
- SPRACE Status:
<a href="http://dashb-cms-sv.cern.ch/dashboard/request.py/siteview?site=T2_BR_SPRACE" target="_blank">CMS Sites</a>,
<a href="http://lxarda16.cern.ch/dashboard/request.py/latestresultssmry?siteSelect3=T2&serviceTypeSelect3=vo&sites=T2_BR_SPRACE&services=CE&services=SRMv2&tests=1301&tests=133&tests=111&tests=6&tests=1261&tests=76&tests=64&tests=20&tests=281&tests=882&exitStatus=all" target="_blank">SAM tests</a>
</tr>
</table>

---+++ !PhEDEx - CMS Data Transfers:

The !PhEDEx project provides the data placement and the file transfer system for the CMS experiment. 
The project name is short for "Physics Experiment Data Export".

   * [[http://cmsdoc.cern.ch/cms/aprom/phedex/prod/Info::Main][Production Info]]
   * [[http://cmsdoc.cern.ch/cms/aprom/phedex/prod/Components::Status?view=global][Components Status]]
   * [[http://cmsdoc.cern.ch/cms/aprom/phedex/prod/Components::Links][PhEDEx &#8211; CMS Data Transfers]]

---++LCG

   * [[http://gridview.cern.ch/GRIDVIEW/][Gridview:  Monitoring and Visualization Tool for LCG ]]

---++Data Operations: Data Transfers and Integrity


---+++ SPRACE

---++++New GStat 2.0

   * [[http://gstat-prod.cern.ch/gstat/site/SPRACE/][GStat 2.0]]

<a href="http://gstat-prod.cern.ch/gstat/site/SPRACE/" target="_blank">LCG GStat 2.0</a>,

%TABLE{ sort="off" tableborder="0" cellpadding="4" cellspacing="3" cellborder="0" }%
|  *Last 24 & 132 Hours*  ||| 
|  Fermilab | [[TransferMonitorFermilabSprace][%ICON{arrowbright}%]] | SPRACE   | 
|  SPRACE   | [[TransferMonitorSpraceFermilab][%ICON{arrowbright}%]] | Fermilab  |

---+++ Transfer Monitoring

%TABLE{ sort="off" tableborder="0" cellpadding="4" cellspacing="3" cellborder="0" }%
|  *Last 24 Hours*  |||  *Last 132 Hours*  |||
|  CERN | [[https://twiki.cern.ch/twiki/bin/view/CMS/TransferMonitorCernT1][%ICON{arrowbright}%]] | T1  |  [[https://twiki.cern.ch/twiki/bin/view/CMS/TransferMonitorVolumeQueued][%ICON{statistics}%]] Volume Queued  |
|  T1 | [[https://twiki.cern.ch/twiki/bin/view/CMS/TransferMonitorT1Cern][%ICON{arrowbright}%]] | CERN  |
|  T1 [not CERN] | [[https://twiki.cern.ch/twiki/bin/view/CMS/TransferMonitorT1T1][%ICON{arrowbright}%]] | T1 [not CERN]  |

---+++ Links for the working expert

%TABLE{ sort="off" tableborder="0" cellpadding="4" cellspacing="3" cellborder="0" }%
|  *Web Tools*  |||  *Lemon*  ||||  *SLS*  ||  *FTS*  ||
|  [[http://cmsdbs.cern.ch/DBS2_discovery/index?userMode=expert][DBS Discovery]]  \
|  [[http://cmsdoc.cern.ch/cms/aprom/phedex/][PhEDEx]]  \
|  [[https://cmsweb.cern.ch/sitedb/sitedb/][SiteDB]]  \
|  host  ||  user  ||  disk pool  ||  [[https://fts102.cern.ch/transfer-monitor-report/][prod]]  |  [[https://fts102.cern.ch/ftsmonitor/tiertwo/fts.php?from=all&to=all&vo=cms][tiertwo]]  |
|  [[https://twiki.cern.ch/twiki/bin/view/CMS/DBS-TDR][TWiki]]  \
|  [[https://twiki.cern.ch/twiki/bin/view/CMS/PhEDEx][TWiki]]  \
|  [[https://twiki.cern.ch/twiki/bin/view/CMS/SiteDB][TWiki]]  \
|  [[https://lemonweb.cern.ch/lemon-status/info.php?entity=vocms01][vocms01]]  \
|  [[https://lemonweb.cern.ch/lemon-status/info.php?entity=vocms20][vocms20]]  \
|  [[https://sls.cern.ch/lrf-castor/info.php?entity=cms001&type=user][cms001]]  \
|  [[https://sls.cern.ch/lrf-castor/info.php?entity=phedex&type=user][phedex]]  \
|  [[https://lemonweb.cern.ch/sls/service.php?id=CASTORCMS_T0EXPORT][t0export]]  \
|  [[https://lemonweb.cern.ch/sls/service.php?id=CASTORCMS_T1TRANSFER][t1transfer]]  \
|  [[https://twiki.cern.ch/twiki/bin/view/EGEE/FTS][TWiki]]  ||
| |  [[http://t2.unl.edu/phedex/xml/][queries]]  | | | | | |  [[https://lemonweb.cern.ch/sls/service.php?id=CASTORCMS_DEFAULT][default]]  \
|  [[https://lemonweb.cern.ch/sls/service.php?id=CASTORCMS_CMSCAF][cmscaf]]  \
|  [[https://twiki.cern.ch/twiki/bin/view/LCG/FtsTools20#FTS_Query_Quality_Map][quality map]]  ||

%TABLE{ sort="off" tableborder="0" cellpadding="4" cellspacing="3" cellborder="0" }%
|  *CVS*  ||  *Monitors*  ||  *IT*  |  *TWiki*  ||  *Other Links*  |||
|  [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/COMP/PHEDEX/][PhEDEx]]  \
|  [[http://cmssw.cvs.cern.ch/cgi-bin/cmssw.cgi/COMP/SITECONF/][SITECONF]] \
|  [[http://cmsdoc.cern.ch/cmscluster/newcacti/graph_view.php?%20action=tree&tree_id=3][cacti]]  \
|  [[http://gridview.cern.ch/GRIDVIEW/][GridView]]  \
|  [[http://it-support-servicestatus.web.cern.ch/it-support-servicestatus/][Service Status Board]]  \
|  [[https://twiki.cern.ch/twiki/bin/view/CMS/DDT][DDT]]  \
|  [[https://twiki.cern.ch/twiki/bin/view/CMS/FacilitiesOps][FacilitiesOps]]  \
|  [[http://castor.web.cern.ch/castor/][Castor]]  \
|  [[https://savannah.cern.ch/][Savannah]]  |  [[https://gus.fzk.de/pages/home.php][GGUS]]  |
| ^ | ^ | ^ | ^ | ^ |  *[[http://belforte.home.cern.ch/belforte/misc/CommissionedLinksStatus.html][status]]*  |  *[[https://twiki.cern.ch/twiki/bin/view/CMS/FacilitiesOps#CCRC08][CCRC08]]*  | ^ | ^ | ^ |

---++Brian's Graphs
   * [[http://t2.unl.edu/status][General Status]]
   * [[https://t2.unl.edu/gratia/xml/facility_hours_bar_smry?span=86400&facility=SPRACE&starttime=2008-05-01+00%3A00%3A00][Wall hours]]
   * [[https://t2.unl.edu/gratia/xml/facility_cpu_hours_bar_smry?span=86400&facility=SPRACE&starttime=2008-05-01+00%3A00%3A00][Gratia's reported CPU hours]]
   * [[https://t2.unl.edu/gratia/xml/facility_cpu_efficiency?span=86400&facility=SPRACE&starttime=2008-05-01+00%3A00%3A00][CPU efficiency]]


---++ LOCAL Monitoring
   * [[http://osg-ce.sprace.org.br/ganglia/][Ganglia]]
   * [[http://osg-se.sprace.org.br:2288/][dCache]]
   * [[http://www.nara.org.br/monitor][NARA]]
   * [[http://osg-ce.sprace.org.br/spracemon.html][SPRACE Monitoring script]]

---++E-mail
   * [[https://t2.unl.edu/gratia/email_lookup][E-mail Address Query]]

---++Other Links
   * [[https://twiki.cern.ch/twiki/bin/view/CMS/SAMForCMS][Site Availability Monitor (SAM) tests for CMS]]
   * [[https://savannah.cern.ch/support/?group=cmscompinfrasup][CMS Computing Infrastructure Support]]


<!--

<TABLE border="0" cellspacing=0 cellpadding=0 width="100%" >
<tr>
<td align ="left" valign="top" width="45%">

<p><a href="http://gratia.fnal.gov/Files/osg_gratia_display/today/vo_bar_smry.png" target="_blank" border="1">
  <img src="http://gratia.fnal.gov/Files/osg_gratia_display/today/vo_bar_smry.png" alt="Hours spent on jobs by VO" border="1" height="200" width="320" /> </a></p>  

<td align ="left" valign="top" width="45%">

<p><a href="http://gratia.fnal.gov/Files/osg_gratia_display/today/osg_wall_hours.png" target="_blank">
  <img src="http://gratia.fnal.gov/Files/osg_gratia_display/today/osg_wall_hours.png" alt="Computation Hours Per Week" border="1" height="200" width="320" /></a> </p>      

</tr>
<td align ="left" valign="top" width="45%">

<p><a href="http://osg-se.sprace.org.br:2288/usageInfo" target="_blank">
  <img src="http://osg-se.sprace.org.br:2288/usageInfo" alt="Cumulative Computation Hours" height="200" width="320" /></a> </p>

<td align ="left" valign="top" width="45%">

</tr></table>
-->
Topic revision: r35 - 2012-10-19 - JadirSilva
antalya escort bursa escort eskisehir escort istanbul escort izmir escort