CoEPP RC
 

This is an old revision of the document!


Adelaide T3

User Access and Authentication

  • Names services and authentication comes from the CoEPP central authentication system. This consists of an LDAP service and a Kerberos KDC.
  • In order to access the Adelaide Tier 3 you must be part of the ui_adl UNIX group

Resources

Topology

  • The following picture provides an ilustration of the proposed model for local usage:

Servers and Hardware

Server Role CPUs Mem
adlui1.adl.coepp.org.au (alias: aui.coepp.org.au) Shared interactive node 1 and batch node 1 8 VCPUs 30 GB RAM
adlui2.adl.coepp.org.au Shared interactive node 2 and batch node 2 6 VCPUs 24 GB RAM
adlui3.adl.coepp.org.au Shared interactive node 3 and batch node 3 6 VCPUs 24 GB RAM
Hostname coepp1.ersa.edu.au
Vendor Dell
Model R620
OS Citrix Xenserver (Virtualization Hypervisor)
Photo
Hostname coepp2.ersa.edu.au
Vendor Dell
Model R620
OS Citrix Xenserver (Virtualization Hypervisor)
Photo

Software Management

setupATLAS

  • setupATLAS is a bash function which enables localSetup<TARGET> commands for specific <TARGET> configurations
$ setupATLAS
(...)
$ printMenu
...Type localSetupAGIS to setup AGIS
...Type localSetupAtlantis to setup Atlantis
...Type localSetupDQ2Client to use DQ2 Client
...Type localSetupEIClient to setup EIClient
...Type localSetupEmi to use emi
...Type localSetupFAX to use FAX
...Type localSetupGanga to use Ganga
...Type localSetupGcc to use alternate gcc
...Type localSetupPacman to use Pacman
...Type localSetupPandaClient to use Panda Client
...Type localSetupPyAMI to setup pyAMI
...Type localSetupPoD to setup Proof-on-Demand
...Type localSetupROOT to setup (standalone) ROOT
...Type localSetupRucioClients to setup rucio-clients
...Type localSetupSFT to setup SFT packages
...Type localSetupXRootD to setup XRootD
...Type showVersions to show versions of installed software
...Type asetup to setup a release (changeASetup to change asetup version)
...Type rcSetup to setup an ASG release (changeRCSetup to change rcSetup ver.)
...Type diagnostics for diagnostic tools
...Type helpMe for more help
...Type printMenu to show this menu
  • For example, to known which ROOT versions are available, run localSetupROOT –help
$ localSetupROOT --help

Usage: localSetupROOT [options] [version]

    This sets up the ROOT environment.  It is meant to be used outside
    Athena so do not source this file if you intend to run Athena jobs.

    You need to set the environment variable ATLAS_LOCAL_ROOT_BASE first.

    Options (to override defaults) are:
     -h  --help             Print this help message
     --skipConfirm          Skip the confirmation dialogue
     --quiet                Print no output (also sets skipConfirm)
     --xrdVer=STRING        xrootd version to setup
                             it will setup the approproate OS/platform version
     --davixVer=STRING      davix version to setup
                             This is dev so default is current

    Note: if you run h2root, you may see an error about a missing shared
          library libshift.so (used by Castor).  If you see this, do
    export LD_LIBRARY_PATH=$LD_LIBARY_PATH:<path to an ATLAS kit>/external/slc3compat/2.0.0/i686-slc3-gcc323/lib

    Note: root 5.32 and newer will setup external xrootd package.
          To disable this, do prior to setup
            export ALRB_SKIP_XDR=1


ROOT versions:
 ---> 5.28.00g-i686-slc5-gcc43-opt
 ---> 5.28.00g-x86_64-slc5-gcc43-opt
(...)
  • To configure a specific ROOT version, execute the following command (please note that the gcc and python versions are set accordingly)
$ localSetupROOT 5.34.25-x86_64-slc6-gcc48-opt
************************************************************************
Setting up ROOT ...
************************************************************************
Setting up ROOT version 5.34.25-x86_64-slc6-gcc48-opt
  Current GCC version: gcc (GCC) 4.8.1
  Python version in your path is 2.7.4
  Python version used to build ROOT is 2.7
Setting up gccxml version 0.9.0_20120309p2-x86_64-slc6-gcc48-opt
Setting up gsl version 1.10-x86_64-slc6-gcc48-opt
Setting up fftw version 3.1.2-x86_64-slc6-gcc48-opt
Setting up XRootD version 3.3.6.p1-x86_64-slc6-gcc48-opt
Setting up davix version 0.4.0-x86_64-slc6
 DAVIX root is $ALRB_DAVIX_ROOT
************************************************************************
 Tip for _this_ standalone ROOT and grid (ie prun) submission:
  avoid --athenaTag if you do not need athena
  use --rootVer=5.34/25 --cmtConfig=x86_64-slc6-gcc48-opt
************************************************************************

$ which root
/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/root/5.34.25-x86_64-slc6-gcc48-opt/bin/root

$ which python
/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/2.7.4-x86_64-slc6-gcc48/sw/lcg/external/Python/2.7.4/x86_64-slc6-gcc48-opt/bin/python

$ which gcc
/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/Gcc/gcc481_x86_64_slc6/slc6/gcc48/bin/gcc

setupSW

  • setupSW executes the same function as setupATLAS. It was setup so that non-ATLAS users do not get confused, and understand that they can also profit from the software suites deployed by ATLAS. They do not need to be ATLAS members to profit from ATLAS software stacks.
$ setupSW
(...)

$ printMenu
...Type localSetupAGIS to setup AGIS
...Type localSetupAtlantis to setup Atlantis
...Type localSetupDQ2Client to use DQ2 Client
...Type localSetupEIClient to setup EIClient
...Type localSetupEmi to use emi
...Type localSetupFAX to use FAX
...Type localSetupGanga to use Ganga
...Type localSetupGcc to use alternate gcc
...Type localSetupPacman to use Pacman
...Type localSetupPandaClient to use Panda Client
...Type localSetupPyAMI to setup pyAMI
...Type localSetupPoD to setup Proof-on-Demand
...Type localSetupROOT to setup (standalone) ROOT
...Type localSetupRucioClients to setup rucio-clients
...Type localSetupSFT to setup SFT packages
...Type localSetupXRootD to setup XRootD
...Type showVersions to show versions of installed software
...Type asetup to setup a release (changeASetup to change asetup version)
...Type rcSetup to setup an ASG release (changeRCSetup to change rcSetup ver.)
...Type diagnostics for diagnostic tools
...Type helpMe for more help
...Type printMenu to show this menu
  • People from theory may be specially interested in the localSetupSFT command since it makes available a wide set of MC generators and 3rd party pieces of software like blas, boost, cernlib, clhep, and much more.
$ localSetupSFT --help

Usage: localSetupSFT [options] [version]

    This sets up the ATLAS environment for LCG externals packages

    You need to set the environment variable ATLAS_LOCAL_ROOT_BASE first.

    Options (to override defaults) are:
     -h  --help             Print this help message
     --skipConfirm          Skip the confirmation dialogue
     --quiet                Print no output
     --lcgExtSW=STRING      LCG External software to setup
                             This is from the list below.
                             Separate multiple values with commas.
     --cmtConfig=STRING     CMTCONFIG version to use
                             Default is Athena or Standalone ROOT's cmtconfig

     For more details, please see
       https://twiki.atlas-canada.ca/bin/view/AtlasCanada/LocalSetupSFT

sft versions:
 bjam/3.1.13
 blas/20070405
 blas/20110419
 Boost/1.42.0_python2.5
(...)
  • A 3rd party software can be configured running localSetupSFT <TARGET>
$ localSetupSFT MCGenerators_lcgcmt67b/herwig++/2.7.1
************************************************************************
  Current GCC version: gcc (GCC) 4.8.1
  Python version in your path is 2.7
Setting up herwig++ 2.7.1 ...
 The env $SFT_HOME_herwigPP is the home dir
************************************************************************
  • See the setupATLAS explanations to further understand how to configure other target sofwares

Module

  • This is a mechanism to make available (different versions of) software which:
    • is not available via setupSW / setupATLAS
    • is incompatible with the OS default software
    • is needed by a considerable set of users
  • Users can issue the following commands:
    • module avail: show the modules currently installed in the system
    • module list: show the modules currently loaded by the user
    • module load <TARGET>: load a module
    • module unload <TARGET>: unload a module

Usage

  • This is a bare example on how modules work. In this precise case, we are changing the latex version from the default texlive-2007 installed in SL6 to texlive-2014
  • Check the current latex version
# which latex
/usr/bin/latex

# rpm -qf /usr/bin/latex
texlive-latex-2007-57.el6_2.x86_64
  • Check which software modules are available
# module avail
---------------------------- /usr/share/Modules/modulefiles ------------------------------
sl6/gcc447/texlive-2014.x86_64

-------------------------------------------------------- /etc/modulefiles --------------------------------------------------------
openmpi-x86_64
  • Load the sl6/gcc447/texlive-2014.x86_64 module
# module load sl6/gcc447/texlive-2014.x86_64

# module list
Currently Loaded Modulefiles:
  1) sl6/gcc447/texlive-2014.x86_64

# which latex
/cvmfs/experimental.cloud.coepp.org.au/sw/sl6/gcc447/x86_64/texlive/2014/bin/x86_64-linux/latex
  • Go back to the default latex version
# module unload sl6/gcc447/texlive-2014.x86_64

# which latex
/usr/bin/latex

Batch System

Queues and Times

# qstat -q
server: adltorque.adl.coepp.org.au
Queue            Memory CPU Time Walltime Node  Run Que Lm  State
---------------- ------ -------- -------- ----  --- --- --  -----
adl_long           --      --    96:00:00   --    0   0 --   E R
adl_short          --      --    02:00:00   --    0   0 --   E R
adl_extralong      --      --    168:00:0   --    0   0 --   E R
                                               ----- -----
                                                  0     0

Default Queue

# qmgr -c 'p s' | grep default_queue
set server default_queue = adl_long

Running X application

  • Running X applications and forwarding remote X windows is enabled through XPRA
tier3/adl.1434074375.txt.gz · Last modified: 2015/06/12 11:59 by goncalo
 
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
Recent changes RSS feed Donate Powered by PHP Valid XHTML 1.0 Valid CSS Driven by DokuWiki