Upgrade to OSG 1.0

We started our upgrade to 1.0:

• stoping our gatekeeper, in our computing element

/etc/init.d/xinetd stop

• In our Computing element, getting pacman

cp -a  /opt/osg-0.8.0 /home/mdias/osg_backup0.8
cd /opt
wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-3.26.tar.gz
tar --no-same-owner -xzvf pacman-3.26.tar.gz
cd pacman-3.26
source setup.sh

now,

cd /opt
mkdir osg-1.0.0
cd /opt/osg-1.0.0
vdt-control --off
disabling init service tomcat-55... ok
disabling cron service gratia-condor... ok
disabling init service condor... ok
disabling init service syslog-ng... ok
disabling init service tomcat-5... ok
disabling init service osg-rsv... ok
disabling init service apache... ok
disabling init service condor-devel... ok
disabling cron service vdt-update-certs... ok
disabling init service MLD... ok
disabling cron service gums-host-cron... ok
disabling cron service edg-mkgridmap... ok
disabling init service globus-ws... ok
disabling init service mysql... ok
disabling inetd service gsiftp... ok
disabling inetd service globus-gatekeeper... ok
disabling init service gris... ok
disabling cron service vdt-rotate-logs... ok
disabling cron service fetch-crl... ok

export OLD_VDT_LOCATION=/opt/osg-0.8.0
pacman -get OSG:ce
source setup.sh
pacman -get OSG:Globus-Condor-Setup

the last step install condor batch. We have to inspect

 vim  /opt/osg-1.0.0/condor/etc/condor_config

Managed fork issues: installing and configuring it

pacman -get  OSG:ManagedFork
 $VDT_LOCATION/vdt/setup/configure_globus_gatekeeper --managed-fork y --server y

Gums server:

pacman -get  OSG:gums

Monalisa

 vim /opt/osg-1.0.0/MonaLisa/Service/VDTFarm/ml.properties
$VDT_LOCATION/vdt/setup/configure_monalisa --prompt
vim  /opt/osg-1.0.0/MonaLisa/Service/CMD/ml_env
JAVA_HOME=/opt/osg-1.0.0/jdk1.5  <-------was jdk1.4

Gums host cron

vdt-register-service -name gums-host-cron --enable
vdt-register-service: updated cron service 'gums-host-cron'
vdt-register-service: desired state = enable
vdt-register-service: cron time     = '9 8,14,20,2 * * *'
vdt-register-service: cron command  = '/opt/osg-1.0.0/gums/scripts/gums-host-cron'

 vdt-control --enable gums-host-cron
$VDT_LOCATION/gums/scripts/gums-host-cron

some gums configuration

cp /opt/osg-1.0.0/post-install/prima-authz.conf /etc/grid-security/.
cp /opt/osg-1.0.0/post-install/gsi-authz.conf /etc/grid-security/.
/opt/osg-1.0.0/tomcat/v55/webapps/gums/WEB-INF/scripts/gums-add-mysql-admin "/DC=org/DC=doegrids/OU=People/CN=Marco Dias 280904"

We have to inspect these files

$VDT_LOCATION/vdt-app-data/gums/config/gums.config
$VDT_LOCATION/gums/config/gums-client.properties

Reusing the old configuration

cd /opt/osg-1.0.0/monitoring
source ../setup.sh
export OLD_VDT_LOCATION=/opt/osg-0.8.0/
./configure-osg.py -e
vim extracted-config.ini

we can test it and repair

./configure-osg.py -v -f ./extracted-config.ini
 cp /opt/osg-0.8.0/monitoring/grid3-user-vo-map.txt
/opt/osg-1.0.0/monitoring/.
vim /opt/osg-1.0.0/monitoring/extracted-config.ini

installing it.

  ./configure-osg.py -c -f ./extracted-config.ini 

removing and creating simbolic links

clcmd umount /OSG/
unlink /OSG 
ln -s /opt/osg-1.0.0 /OSG
vim /etc/exports
 /etc/init.d/nfs restart

Set Globus-Base-WSGRAM-Server

visudo
/opt/osg-1.0.0/vdt/setup/configure_prima_gt4 --enable --gums-server osg-ce.sprace.org.br
/etc/init.d/globus-ws stop
/etc/init.d/globus-ws start

Condor-cron

vim /opt/osg-1.0.0/condor-cron/local.osg-ce/condor_config.local

chown condor: /var/lock/subsys/condor-cron/

Turning on services (seems to be not necessary)

vdt-control --on
enabling cron service fetch-crl... ok
enabling cron service vdt-rotate-logs... ok
enabling cron service vdt-update-certs... ok
skipping init service 'gris' -- marked as disabled
enabling inetd service globus-gatekeeper... ok
enabling inetd service gsiftp... ok
enabling init service mysql... ok
enabling init service globus-ws... ok
skipping cron service 'edg-mkgridmap' -- marked as disabled
enabling cron service gums-host-cron... ok
enabling init service MLD... ok
enabling init service condor-cron... ok
enabling init service apache... ok
skipping init service 'osg-rsv' -- marked as disabled
enabling init service tomcat-55... ok
enabling init service syslog-ng-sender... ok
enabling init service condor... ok
enabling cron service gratia-condor... ok

• Installing RSV

cd /opt/osg-1.0.0/monitoring/
vim extracted-config.ini
[RSV]
enabled = True
rsv_user = mdias
enable_ce_probes = True
ce_hosts = osg-ce.sprace.org.br
enable_gridftp_probes = True
gridftp_dir = /tmp
enable_gums_probes =  False
gums_hosts = osg-ce.sprace.org.br
enable_srm_probes = True
srm_hosts = osg-se.sprace.org.br
srm_dir = /pnfs/sprace.org.br/data/mdias
use_service_cert = False
proxy_file = /tmp/x509up_u537
enable_gratia = True
print_local_time = True
setup_rsv_nagios = False
setup_for_apache = True

now start services

 vdt-control --off
./configure-osg.py -c -f ./extracted-config.ini 
vdt-control --on 

and check it

condor_cron_q
tail -f $VDT_LOCATION/osg-rsv/logs/consumers/gratia-script-consumer.out

• In our nodes, stop condor

clcmd /etc/init.d/condor stop
clcmd mount /OSG

in a NFS shared directory,

cd /home/mdias
wget http://physics.bu.edu/pacman/sample_cache/tarballs/pacman-3.26.tar.gz
tar --no-same-owner -xzvf pacman-3.26.tar.gz

and then We've created a script like that:

source /opt/OSG-wn-client/setup.sh
vdt-control --off
cd /home/mdias/pacman-3.26
source setup.sh
mv /opt/OSG-wn-client /opt/OSG-wn-client.old
mkdir /opt/OSG-wn-client
cd /opt/OSG-wn-client
VDTSETUP_AGREE_TO_LICENSES=y
export VDTSETUP_AGREE_TO_LICENSES
VDTSETUP_INSTALL_CERTS=l
export VDTSETUP_INSTALL_CERTS
VDTSETUP_EDG_CRL_UPDATE=n
export VDTSETUP_EDG_CRL_UPDATE
VDTSETUP_ENABLE_ROTATE=y
export VDTSETUP_ENABLE_ROTATE
VDTSETUP_CA_CERT_UPDATER=n
export VDTSETUP_CA_CERT_UPDATER
pacman -trust-all-caches -get OSG:wn-client
mv /var/log/glexec /var/log/glexec.old
mv  /etc/glexec  /etc/glexec.old
mkdir /opt/glexec
cd /opt/glexec
pacman -trust-all-caches    -get http://vdt.cs.wisc.edu/vdt_181_cache:Glexec
sed -i 's/yourmachine.yourdomain/osg-ce.sprace.org.br/g'  /etc/glexec/contrib/gums_interface/getmapping.cfg
source setup.sh
vdt-control --on
mkdir /opt/glexec/glite/etc
cp /OSG/glite/etc/vomses /opt/glexec/glite/etc/.

so, We start to run it in our nodes:

/root/bin/clcmd /home/mdias/worknodeinstall.sh
/root/bin/clcmd rm -rf /opt/OSG-wn-client.old

we have to edit one /etc/glexec/glexec.conf to put "linger =no" line in [glexec] section and copy to the other nodes. Also we have to edit our computer element , before reusing old configuration:

 vim /opt/osg-1.0.0/monitoring/extracted-config.in
glexec_location = /opt/glexec/glexec-osg

Testing glexec

cd /etc/glexec
source setup.sh 
voms-proxy-init -voms cms:/cms
export GLEXEC_CLIENT_CERT=/tmp/x509up_u537  
cd /opt/glexec/
glexec-osg/sbin/glexec /usr/bin/id

A srm error can force us to upgrade our dcache to make srm compatible. So in our storage elements:

/opt/init.d/dcache-pool stop
/opt/init.d/dcache-core stop
wget http://www.dcache.org/downloads/1.8.0/dcache-server-1.8.0-15p7.noarch.rpm
wget http://www.dcache.org/downloads/1.8.0/dcache-srmclient-1.8.0-15p7.noarch.rpm
rpm -Uvh dcache-server-1.8.0-15p7.noarch.rpm dcache-srmclient-1.8.0-15p7.noarch.rpm
/opt/d-cache/install/install.sh
chkconfig --del dcache-core 
chkconfig --del dcache-pool 
cp /opt/d-cache/bin/dcache-pool /etc/init.d/.
cp /opt/d-cache/bin/dcache-core /etc/init.d/.
chkconfig --add dcache-core 
chkconfig --add dcache-pool 
chkconfig dcache-core on
chkconfig dcache-pool on

• In our storage elements

 unlink /opt/osg-0.8.0
 ln -s /OSG /opt/osg-1.0.0

interesting links

• http://twiki.mwt2.org/bin/view/Main/DeployingOSG1d0
• https://twiki.grid.iu.edu/twiki/bin/view/ReleaseDocumentation/ComputeElementInstall

Updates

Fulano em dd/mm/aaaa

Coloca o que fez.

Ciclano em dd/mm/aaaa

Mais comentarios

-- MarcoAndreFerreiraDias - 23 Jun 2008