How to use the clusters - Revision history

Lhep at 15:22, 29 May 2017

2017-05-29T15:22:56Z

← Older revision		Revision as of 17:22, 29 May 2017
Line 1:		Line 1:
	* '''The AEC clusters can only be accessed via Grid tools (ARC middleware). There is no local login on to the clusters for direct batch submission.''' <br/>The cluster endpoints are: '''<code>ce01.lhep.unibe.ch</code>, <code>ce02.lhep.unibe.ch</code>'''		* '''The AEC HTC clusters can only be accessed via Grid tools (ARC middleware). There is no local login on to the clusters for direct batch submission.''' <br/>The cluster endpoints are: '''<code>ce01.lhep.unibe.ch</code>, <code>ce02.lhep.unibe.ch</code>'''

Lhep at 15:22, 29 May 2017

2017-05-29T15:22:18Z

← Older revision	Revision as of 17:22, 29 May 2017
Line 56:	Line 56:


		'''NOTE: under review from here on ...'''

Lhep at 14:15, 29 May 2017

2017-05-29T14:15:44Z

← Older revision		Revision as of 16:15, 29 May 2017
Line 46:		Line 46:
	'''Our clusters run the ARC (Advanced Resource Connector), middleware''' from Nordugrid.<br/> The general documentation can be found [http://www.nordugrid.org/arc/about-arc.html here].		'''Our clusters run the ARC (Advanced Resource Connector), middleware''' from Nordugrid.<br/> The general documentation can be found [http://www.nordugrid.org/arc/about-arc.html here].

	'''ARC client installation and user manual reference can be found [http://www.nordugrid.org/manuals.html#client here]''' <br/>This gives you the ~~arc~~ tools like arcsub, arcls, arcstat, arcget etc. With those you can submit and manage your jobs.		'''ARC client installation and user manual reference can be found [http://www.nordugrid.org/manuals.html#client here]''' <br/>This gives you the ARC tools like <code>arcsub</code>, <code>arcls</code>, <code>arcstat</code>, <code>arcget</code> etc. With those you can submit and manage your jobs.

	'''NOTE: I strongly advise to use ARC clients from CVMFS ( [https://cernvm.cern.ch/portal/filesystem CernVM File System] ) as opposed to a local installation''', since you are very likely to be needing CVMFS access anyway on your client machine.<br/> The ATLAS User Interface servers are setup with CVMFS.		'''NOTE: I strongly advise to use ARC clients from CVMFS ( [https://cernvm.cern.ch/portal/filesystem CernVM File System] ) as opposed to a local installation''', since you are very likely to be needing CVMFS access anyway on your client machine.<br/> The ATLAS User Interface servers are setup with CVMFS.

Lhep at 14:13, 29 May 2017

2017-05-29T14:13:56Z

← Older revision		Revision as of 16:13, 29 May 2017
Line 42:		Line 42:


	* '''ARC client setup'''		* '''Grid ARC client setup'''

			'''Our clusters run the ARC (Advanced Resource Connector), middleware''' from Nordugrid.<br/> The general documentation can be found [http://www.nordugrid.org/arc/about-arc.html here].

			'''ARC client installation and user manual reference can be found [http://www.nordugrid.org/manuals.html#client here]''' <br/>This gives you the arc tools like arcsub, arcls, arcstat, arcget etc. With those you can submit and manage your jobs.

			'''NOTE: I strongly advise to use ARC clients from CVMFS ( [https://cernvm.cern.ch/portal/filesystem CernVM File System] ) as opposed to a local installation''', since you are very likely to be needing CVMFS access anyway on your client machine.<br/> The ATLAS User Interface servers are setup with CVMFS.

	Make sure you have a file ''$HOME/.voms/vomses'' including one or more of the following lines (create it with your editor):		Make sure you have a file ''$HOME/.voms/vomses'' including one or more of the following lines (create it with your editor):
Line 49:		Line 55:
	"t2k.org" "voms.gridpp.ac.uk" "15003" "/C=UK/O=eScience/OU=Manchester/L=HEP/CN=voms.gridpp.ac.uk t2k.org" "t2k.org"		"t2k.org" "voms.gridpp.ac.uk" "15003" "/C=UK/O=eScience/OU=Manchester/L=HEP/CN=voms.gridpp.ac.uk t2k.org" "t2k.org"

	~~Install your submission client, the ARC (Advanced Resource Connector), documentation can be found in [http://www.nordugrid.org/arc/about-arc.html].~~
	~~This gives you the arc tools like arcsub, arcls, arcstat, arcget etc. With those you can submit and manage your jobs.~~

	To set up ARC (standalone) choose the needed configuration from [http://download.nordugrid.org/standalone.html] and		To set up ARC (standalone) choose the needed configuration from [http://download.nordugrid.org/standalone.html] and

Lhep at 13:31, 29 May 2017

2017-05-29T13:31:21Z

← Older revision		Revision as of 15:31, 29 May 2017
Line 1:		Line 1:
	* '''The AEC clusters can only be accessed via Grid tools. There is no local login on to the clusters for direct batch submission.''' <br/>The cluster endpoints are: '''<code>ce01.lhep.unibe.ch</code>, <code>ce02.lhep.unibe.ch</code>'''		* '''The AEC clusters can only be accessed via Grid tools (ARC middleware). There is no local login on to the clusters for direct batch submission.''' <br/>The cluster endpoints are: '''<code>ce01.lhep.unibe.ch</code>, <code>ce02.lhep.unibe.ch</code>'''


Line 17:		Line 17:
	fs setacl -dir $HOME/.globus -acl system:anyuser l		fs setacl -dir $HOME/.globus -acl system:anyuser l

	The user's Grid certificate/key pair (''usercert.pem'' and ''userkey.pem'') can be copied to any other machine to access the Grid simply by copying the ''$HOME/.globus'' directory. The security measures described above have to be repeated.		The user's Grid certificate/key pair (''usercert.pem'' and ''userkey.pem'') can be copied to any other machine to access the Grid simply by copying the ''$HOME/.globus'' directory. In alternative, it can be restored from a backup .p12 bundle (see below ''"restore a backup of your certificate"''). The security measures described above have to be repeated.


Line 42:		Line 42:


			* '''ARC client setup'''

	Make sure you have a file ''$HOME/.voms/vomses'' including one or more of the following lines (create it with your editor):		Make sure you have a file ''$HOME/.voms/vomses'' including one or more of the following lines (create it with your editor):

Lhep at 13:13, 29 May 2017

2017-05-29T13:13:37Z

← Older revision		Revision as of 15:13, 29 May 2017
Line 44:		Line 44:


	Make sure you have a file ~/.voms/vomses ~~with this line inside~~ (create it with your editor):		Make sure you have a file ''$HOME/.voms/vomses'' including one or more of the following lines (create it with your editor):
	"~~aec~~" "voms.~~lhep.unibe~~.ch" "~~15027~~" "/DC=~~com~~/DC=~~quovadisglobal~~/DC=~~grid~~/DC=~~switch~~/DC=~~hosts~~/C=CH/ST=~~Bern~~/L=~~Bern~~/O=~~Universitaet Bern~~/CN=voms.~~lhep~~.~~unibe~~.ch" "~~aec~~"		"atlas" "lcg-voms.cern.ch" "15001" "/DC=ch/DC=cern/OU=computers/CN=lcg-voms.cern.ch" "atlas"
			"fermilab" "voms.fnal.gov" "15001" "/DC=org/DC=doegrids/OU=Services/CN=http/voms.fnal.gov" "fermilab"
			"t2k.org" "voms.gridpp.ac.uk" "15003" "/C=UK/O=eScience/OU=Manchester/L=HEP/CN=voms.gridpp.ac.uk t2k.org" "t2k.org"

	Install your submission client, the ARC (Advanced Resource Connector), documentation can be found in [http://www.nordugrid.org/arc/about-arc.html].		Install your submission client, the ARC (Advanced Resource Connector), documentation can be found in [http://www.nordugrid.org/arc/about-arc.html].

Lhep at 12:21, 29 May 2017

2017-05-29T12:21:57Z

← Older revision		Revision as of 14:21, 29 May 2017
Line 33:		Line 33:


	* '''Enroll in the appropriate Virtual Organisation (VO) for your experiment''', by visiting their VOMS (Virtual Organization Management Service) server. On the AEC clusters, the following experiments are currently supported		* '''Enroll in the appropriate Virtual Organisation (VO) for your experiment''', by visiting their VOMS (Virtual Organization Management Service) server. On the AEC clusters, the following experiments are currently supported:

	atlas - [https://lcg-voms2.cern.ch:8443/voms/atlas/register/start.action VOMS server]		atlas - [https://lcg-voms2.cern.ch:8443/voms/atlas/register/start.action VOMS server]

Lhep at 12:21, 29 May 2017

2017-05-29T12:21:21Z

← Older revision		Revision as of 14:21, 29 May 2017
Line 2:		Line 2:


	* '''Prerequisite: you need a valid user eScience certificate''' in order to access the ~~cluster~~ via the Grid. <br/>For all Swiss institutes, the certificate issuing and yearly renewal is handled by the Science IT Support unit at the University of Bern. Follow the procedure detailed [http://www.scits.unibe.ch/services/escience_certificates/certificate_signing_request here]. The procedure creates a file ''userkey.pem''. This is your private key, keep it safe.		* '''Prerequisite: you need a valid user eScience certificate''' in order to access the clusters via the Grid. <br/>The certificate represent your digital identity in the eScience world. For all Swiss institutes, the certificate issuing and yearly renewal is handled by the Science IT Support unit at the University of Bern. Follow the procedure detailed [http://www.scits.unibe.ch/services/escience_certificates/certificate_signing_request here]. The procedure creates a file ''userkey.pem''. This is your private key, keep it safe.

Lhep at 12:09, 29 May 2017

2017-05-29T12:09:48Z

← Older revision		Revision as of 14:09, 29 May 2017
Line 2:		Line 2:


	* '''Prerequisite: you need a valid user eScience certificate''' in order to access the Grid. For all Swiss institutes, the certificate issuing and yearly renewal is handled by the Science IT Support unit at the University of Bern. Follow the procedure detailed [http://www.scits.unibe.ch/services/escience_certificates/certificate_signing_request here]. The procedure creates a file ''userkey.pem''. This is your private key, keep it safe.		* '''Prerequisite: you need a valid user eScience certificate''' in order to access the cluster via the Grid. <br/>For all Swiss institutes, the certificate issuing and yearly renewal is handled by the Science IT Support unit at the University of Bern. Follow the procedure detailed [http://www.scits.unibe.ch/services/escience_certificates/certificate_signing_request here]. The procedure creates a file ''userkey.pem''. This is your private key, keep it safe.


	* '''You will receive the signed certificate by email from SEE-GRID CA ithin 4 working days'''. The certificate itself is an attachment to the email: ''<serial nr>.pem''. Copy it to your home directory and change the name to ''usercert.pem''. Put both files in the following directory (create it if it isn't there already) and set the correct permissions:		* '''You will receive the signed certificate by email from SEE-GRID CA ithin 4 working days'''. <br/>The certificate itself is an attachment to the email: ''<serial nr>.pem''. Copy it to your home directory and change the name to ''usercert.pem''. Put both files in the following directory (create it if it isn't there already) and set the correct permissions:

	mkdir $HOME/.globus		mkdir $HOME/.globus

Lhep at 12:06, 29 May 2017

2017-05-29T12:06:48Z

← Older revision		Revision as of 14:06, 29 May 2017
Line 1:		Line 1:
	* '''The AEC clusters can only be accessed via Grid tools. There is no local login on to the clusters for direct batch submission.'''		* '''The AEC clusters can only be accessed via Grid tools. There is no local login on to the clusters for direct batch submission.''' <br/>The cluster endpoints are: '''<code>ce01.lhep.unibe.ch</code>, <code>ce02.lhep.unibe.ch</code>'''