Message boards : ATLAS Application : Instructions for ATLAS native app and CVMFS
Message board moderation

To post messages, you must log in.

AuthorMessage
David Cameron
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 20 Apr 16
Posts: 154
Credit: 1,352,539
RAC: 84
Message 4726 - Posted: 27 Feb 2017, 9:46:27 UTC
Last modified: 27 Feb 2017, 10:21:25 UTC

The new test app for ATLAS runs natively on Linux (no virtualbox required) and the CVMFS software must be installed for it to work. Here are some basic instructions for installing and setting up CVMFS.

A quick start guide is here: https://cernvm.cern.ch/portal/filesystem/quickstart

Follow the example to set up repositories for ATLAS:

CVMFS_REPOSITORIES=atlas.cern.ch,atlas-condb.cern.ch,grid.cern.ch


A squid server can be used to improve performance. You can set up one on your host with "yum install squid" then set

CVMFS_HTTP_PROXY="http://127.0.0.1:3128"


If you don't want to set up a squid you can set

CVMFS_HTTP_PROXY=DIRECT


After changing the configuration you must run "cvmfs_config reload"

To check that CVMFS is set up correctly run "cvmfs_config probe", which should return

Probing /cvmfs/atlas.cern.ch... OK
Probing /cvmfs/atlas-condb.cern.ch... OK
Probing /cvmfs/grid.cern.ch... OK


Everything should now be ready for ATLAS tasks. Sometimes you can get the message

27-Feb-2017 10:39:48 [lhcathome-dev] No tasks are available for ATLAS Simulation
27-Feb-2017 10:39:48 [lhcathome-dev] VirtualBox is not installed


but this generally means there are no tasks available on the server. This app does not require VirtualBox.

One advantage of native apps is much easier monitoring since you can access the working directory directly. You can also run a program like "top" to check if things are working ok. A healthy WU should look like this (after up to 10 mins of startup time where CPU is not heavily used):

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
3807 boinc     39  19 2214596 1.403g  51328 R 100.0 20.1   9:20.67 athena.py
3805 boinc     39  19 2249868 1.461g  75916 R  99.7 21.0   9:20.94 athena.py
3806 boinc     39  19 2148088 1.340g  51660 R  99.7 19.2   9:20.82 athena.py
3808 boinc     39  19 2176240 1.365g  51612 R  99.7 19.6   9:20.78 athena.py


There should be one athena.py process per CPU using close to 100% (this example is a 4-core task).

CVMFS is used by all the LHC experiments for distributed software deployment. For more information on CVMFS see the CERN-VM website and in particular the extensive list of publications.
ID: 4726 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
computezrmle
Avatar

Send message
Joined: 28 Jul 16
Posts: 404
Credit: 374,791
RAC: 0
Message 4727 - Posted: 27 Feb 2017, 10:28:18 UTC

cvmfs ... ok
squid ... ok
job start ... ok

result ... not ok

The job finished after 11 minutes - obviously without a good result.
Be so kind as to check the logs.

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=312534
ID: 4727 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
GVBS

Send message
Joined: 9 Feb 17
Posts: 1
Credit: 251,832
RAC: 0
Message 4778 - Posted: 6 Mar 2017, 11:12:49 UTC

Installed new test app for ATLAS according to quickstart guide:
- CVMFS_HTTP_PROXY=DIRECT
- cvmfs_config probe OK
- cvmfs_config chksetup OK
- sudo mount -t cvmfs sft.cern.ch /mnt/test OK
- sudo mount -t cvmfs repository.cern.ch /mnt/cvmfs FAILS

CernVM-FS: running with credentials 122:130
CernVM-FS: loading Fuse modul ... Failed to initialize root file catalog (16 -file catalog failure)

What am I missing in my installation?

fuse ist not in /etc/group
selinux not installed

OS is Linux 4.4.0-64-generic #85 Ubuntu x86-G4
ID: 4778 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 601
Credit: 1,451,312
RAC: 1,368
Message 4780 - Posted: 6 Mar 2017, 18:44:50 UTC

OpenSuse 13.2(x64):

sudo cvmfs_config probe OK
sudo cvmfs_config chksetup OK

Boinc-manager say: Atlas have no tasks to run :-(

Edit: Special thank from me for Computezrmle to give me a helping tip for the Installation.
ID: 4780 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 20 Apr 16
Posts: 154
Credit: 1,352,539
RAC: 84
Message 4781 - Posted: 6 Mar 2017, 20:19:34 UTC - in response to Message 4778.  

Installed new test app for ATLAS according to quickstart guide:
- CVMFS_HTTP_PROXY=DIRECT
- cvmfs_config probe OK
- cvmfs_config chksetup OK
- sudo mount -t cvmfs sft.cern.ch /mnt/test OK
- sudo mount -t cvmfs repository.cern.ch /mnt/cvmfs FAILS

CernVM-FS: running with credentials 122:130
CernVM-FS: loading Fuse modul ... Failed to initialize root file catalog (16 -file catalog failure)

What am I missing in my installation?

fuse ist not in /etc/group
selinux not installed

OS is Linux 4.4.0-64-generic #85 Ubuntu x86-G4


If the probe command says ok you should be good to go. You don't have to run the mount commands since cvmfs is automatically mounted by autofs. Only if you have problems should you use mount. repository.cern.ch is just an example and you should substitute repository for the real name, eg atlas.

The only repositories you need are atlas.cern.ch, atlas-condb.cern.ch and grid.cern.ch

PS I have put more tasks in the queue.
ID: 4781 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 601
Credit: 1,451,312
RAC: 1,368
Message 4785 - Posted: 7 Mar 2017, 9:33:58 UTC
Last modified: 7 Mar 2017, 9:42:54 UTC

in \usr\bin\projects there are no folder in project lhcathome-dev.

Have made a reset of the project, after this masterfile was downloaded.

Atlas has no tasks available is always shown.

Edit: This Computer have 2 CPUs. max-jobs and max-cpus are set to 1.
ID: 4785 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 20 Apr 16
Posts: 154
Credit: 1,352,539
RAC: 84
Message 4790 - Posted: 9 Mar 2017, 10:05:54 UTC

Just a note that we are suspending the testing of the native Linux app in order to concentrate on the long-awaited consolidation of ATLAS with LHC@Home. Thanks for all your help testing this app so far and we hope to come back to it soon.
ID: 4790 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 601
Credit: 1,451,312
RAC: 1,368
Message 4980 - Posted: 10 Jun 2017, 9:38:58 UTC - in response to Message 4790.  

Just a note that we are suspending the testing of the native Linux app in order to concentrate on the long-awaited consolidation of ATLAS with LHC@Home. Thanks for all your help testing this app so far and we hope to come back to it soon.


Probing /cvmfs/atlas.cern.ch... OK
Probing /cvmfs/atlas-condb.cern.ch... OK
Probing /cvmfs/grid.cern.ch... OK

Are there some news?
ID: 4980 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 601
Credit: 1,451,312
RAC: 1,368
Message 5569 - Posted: 30 Oct 2018, 6:58:40 UTC

Since yesterday there are download-failure for Atlas native App.
https://lhcathomedev.cern.ch/lhcathome-dev/results.php?userid=378
ID: 5569 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : ATLAS Application : Instructions for ATLAS native app and CVMFS


©2023 CERN