Lhep: 1 revision imported

2015-03-18T07:49:24Z

1 revision imported

New page

* ===Screen Function===
All the scanning processes should be started in a screen function in order to be able to access from everywhere. In addition, it's very easy to kill an process when it hangs (just kill the screen).

- screen -S myscreen : create a new screen
- screen -r : reattach to the screen
- screen -x : additionally attach to the screen
- inside the screen in order to deattach: Ctrl A D
- inside the screen to close: exit

* ===Alias===
To put in your personal .bashrc file
alias 46='ssh -X scanner@lheppc46.unibe.ch' #pc46
alias 56='ssh -X scanner@lheppc56.unibe.ch' #pc56
alias 13='ssh -X scanner@lhepsun13.unibe.ch' #pcsun13

alias rm1='rdesktop -g 1272x930 -k de-ch -u scanner lheppc9' #mic1 remonte desktop
alias rm1l='rdesktop -g 2200x930 -k de-ch -u scanner lheppc9' #mic1 remonte desktop large
alias rm2='rdesktop -g 1272x930 -k de-ch -u scanner lheppc45' #mic2 remonte desktop
alias rm2l='rdesktop -g 2200x930 -k de-ch -u scanner lheppc45' #mic2 remonte desktop large
alias rm3='rdesktop -g 1272x930 -k de-ch -u scanner lheppc16' #mic3 remonte desktop
alias rm3l='rdesktop -g 2200x930 -k de-ch -u scanner lheppc16' #mic3 remonte desktop large
alias rm4='rdesktop -g 1272x930 -k de-ch -u scanner lheppc28' #mic4 remonte desktop
alias rm4l='rdesktop -g 2200x930 -k de-ch -u scanner lheppc28' #mic4 remonte desktop large
alias rm5='rdesktop -g 1272x930 -k de-ch -u scanner lheppc30' #mic5 remonte desktop
alias rm5l='rdesktop -g 2200x930 -k de-ch -u scanner lheppc30' #mic5 remonte desktop large

* ===NFS disks===
To access to a directory through NFS.

'''Example :'''
You want to have access to ''/terabig from lheppc46'' on ''lheppc56''
In this case lheppc46 is the ''server'' and lheppc56 is the ''client''

'''Server configuration :'''
- As superuser open /etc/exports
- Add /terabig lheppc56(rw,all_squash,anonuid=1000,anongid=100,sync) ( more details on [[http://doc.ubuntu-fr.org/nfs]] in french :-) )
'''Remark : UID of scanner is 1000 & GUID of users is 100'''
- Do ''exportfs -ra'' to take into account your modifications
- Start the NFS server : /etc/init.d/nfsserver start
- If all is fine go to '''Client configuration''' , if not I'm sorry for you

'''Client configuration :'''
- As superuser mkdir /terabig_lheppc46
- Open /etc/fstab ( TAKE CARE of this file !!!! )
- Add ''lheppc46:/terabig /terabig_lheppc46 nfs rw,hard,intr,timeo=10 0 0'' ( more details on [[http://linux.die.net/man/5/nfs]] )
- Start NFS client : ''/etc/init.d/nfs start''
- Now you should see the lheppc46's data on /terabig_lheppc46 , if not I'm sorry for you

* ===Mount lhepsun6 & lhepsun15 -> WORK IN PROGRESS ===
SAMBA :

As superuser do :
mount -t smbfs //lhepsun6/share /terabig/scan/lhepsun6

For the moment no rw permissions, I have to check why

Same problem with
mount -t cifs //lhepsun6/share /terabig/scan/lhepsun6
And next line in /etc/fstab doesn't work
//130.92.139.16/share /terabig/scan/lhepsun6 smbfs rw,user,username=user,password=pass 0 0

Remark : The asked password is the password login for the user scanner

* ===[[SSH connection without password]]===

* === Install BackupPC ===

[[Image:Howto backuppc.pdf]] (in french)

[[Image:Config dir backuppc.pdf]]

=== mount and copy to terastation as backup===
mount disk to pc37 or pc41
su
mount -t cifs //130.92.139.16/share /terabig/scan/lhepsun6

create list of backup files, e.g. all 2008 published events, divided by mic1 and mic2 (pc41) and 3,4,5 (pc37)
pc46
/terabig/www/cgi-bin/EventTracer2008>
root -l check_tracer.C (here you can define your output list by yourself)
bricklist_lhepsun6_pc41() -> list saved in plots/bricklist_lhepsun6_pc41.txt
bricklist_lhepsun6_pc37() -> list saved in plots/bricklist_lhepsun6_pc37.txt

run backup
execute bricklist_lhepsun6_pc41.txt on pc41
execute bricklist_lhepsun6_pc37.txt on pc37

modify etc/fstab : to get the right of writing to scanner
LABEL=/ / ext3 defaults 1 1
/dev/sda2 /terabig ext3 defaults 1 2
tmpfs /dev/shm tmpfs defaults 0 0
devpts /dev/pts devpts gid=5,mode=620 0 0
sysfs /sys sysfs defaults 0 0
proc /proc proc defaults 0 0
LABEL=SWAP-sda3 swap swap defaults 0 0
130.92.139.96:/terabig/scan /terabig/scan/lheppc46 nfs rw,hard,intr,timeo=10 0 0
130.92.139.87:/terabig/scan /terabig/scan/lheppc37 nfs rw,hard,intr,timeo=10 0 0
130.92.139.156:/terabig/scan /terabig/scan/lheppc56 nfs rw,hard,intr,timeo=10 0 0

//130.92.139.16/share /terabig/scan/lhepsun6 cifs defaults,uid=500,gid=100 0 0

mount -a : mounts everything that is in fstab

=== BACKUP scanning data on terastation ===

* mount disc (should be already done)
lhepsun6 130.92.139.16 : various stuff on there
lhepsun15 130.92.139.25: -> scanning data under /share/scan
lheppc7 -> from ATLAS: mount lheppc7.unibe.ch/ngse5 lheppc7

su
modify /etc/fstab in order to put the right to scanner for writing, add line like
//130.92.139.16/share /terabig/scan/lhepsun6 cifs defaults,uid=500,gid=100 0 0
then mount everyting new:
mount -a

== the backup is done in the following steps ==
BE CAREFULL, YOU COULD DELETE STUFF!!!

* Decide what you want to backup
- Lheppc41 and lheppc37 are separated in the backup procedure.
- Lheppc41 (mic1 and mic2)
- Lheppc37 (mic3, mic4 and mic5)
- Go go to corresponding directory: /terabig/scan/BACKUP
(e.g. if you want to backup stuff from mic3, you go to lheppc37 /terabig/scan/BACKUP)
- There is a file called '''manual_list.txt'''. In this file, all the bricks you are going to
backup should be in there. The format is "brickid" "mic".
- Create the list of bricks with the corresponding mic that you want to backup.
You might can use the help of EventTracer.root file.
- Once the list is ready, those bricks will be backup.

* Create processing list
- In /terabig/scan/BACKUP run root -l manual_list.C
- This will produce you 4 files (rsync.sh, remove.txt, symlink.sh and toAdd.txt)
- This process crosschecks with the BACKUP_OK_LIST.txt. This file includes the bricks
that are already in backup or that you don't want to backup)
- For special bricks that are not labeled the standard way, you have to make a manual list
(the list of those bricks is under BACKUP_NOLINK_LIST.txt -> no simlink is created for those)

* Run manual_list_rsync.sh
- This file contains all the sync commands
- This process syncronizes the data to the location mentioned int he command
- This can take a long time and fill up the network traffic
- chmod 777 manual_list_rsync.sh in order to make the list executable

* Run manual_list_remove.txt
- BE CAREFULL, YOU ARE ABOUT TO DELETE DATA
- Copy file: cp manual_list_remove.txt manual_list_remove.sh (security reason not sh in first place)
- chmod 777 manual_list_remove.txt in order to make the list executable
- Run manual_list_remove.sh (this deletes the files)

* Run manual_list_symlink.sh
- Run manual_list_symlink.sh that creates the simlinks from the backup to the original place

* Add manual_list_toAdd.txt
- Add the content of manual_list_toAdd.txt to BACKUP_OK_LIST.txt so that we know that we did backup this data

* Exit working space clean and clear
- Open manual_list.txt and delete content. The next backup put again bricks inside here.
- Make a folder backupYEARMONTHDAY and put all files insdie
(except BACKUP_OK_LIST.txt, BACKUP_NOLINK_LIST.txt, manual_list.C and manual_list.txt)

== BACKUP TO DO ==
* Backup data from pc46 and pc56. pc56 maybe already transferred -> to be checked.
* Install new backups server that we get from ATLAS

Computing Tips and Tricks - Revision history

Lhep: 1 revision imported