Development for LHC@home

This is ready for testing. For now CVMFS will need to be installed on the host as was the case for the native app. The /usr/bin/boinc and /usr/bin/boinccmd commands will need to be the latest from the github master.

@Laurence

The docker wrapper used for the (Linux) app_version 7.39 is either broken or outdated.
As a result it fails the tasks after a few seconds:
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3390209

A self compiled docker wrapper from the recent code runs fine.
So does a recent artifact from github.
Please create a new app_version using that artifact.

Tasks from app_version 7.40 start fine and are processing events.

This may stop the client from using podman on Linux

https://github.com/BOINC/boinc/blob/master/client/hostinfo_unix.cpp#L1259

I have removed it from my local client build.

You can always install the alias for docker

apt install podman-docker

but

docker --version
Emulate Docker CLI using podman. Create /etc/containers/nodocker to quiet msg.
podman version 4.9.3

so

touch /etc/containers/nodocker 

to make it seamless.

At this moment every task runs

RUN dnf install -y https://cvmrepo.s3.cern.ch/cvmrepo/yum/cvmfs-release-latest.noarch.rpm && \
    dnf install -y epel-release && \
    dnf install -y libxcrypt-compat bc bzip2 lighttpd procps-ng make gcc which cvmfs && \
    dnf clean all

Will it be changed in future so it does not redo everything for every container?

In reply to Laurence CERN's message of 21 Mar 2025:

This may stop the client from using podman on Linux

https://github.com/BOINC/boinc/blob/master/client/hostinfo_unix.cpp#L1259

I have removed it from my local client build.

It only affects BOINC clients on Linux that have their data directory on either nfs, nfs4 or smb.
Installations on local file systems (ext4, btrfs, ...) are not affected and pass this test.
https://github.com/BOINC/boinc/blob/d8faab4b6ef9d46f846b526a8014b103e7017ad0/client/hostinfo_linux.cpp#L225-L227

Can anyone check whether you can set lhcathomedev to "no new tasks"?
When i press it nothing happens.
also my tasks crash.
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
docker_wrapper config:
workdir: /boinc_slot_dir
use GPU: no
Web graphics guest port: 80
create args: -v /cvmfs:/cvmfs:shared
verbose: 1
Using Docker
running docker command: ps --all --filter "name=boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0"
command output:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

creating container boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
running docker command: images
command output:
REPOSITORY TAG IMAGE ID CREATED SIZE

boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4220687-645 latest e7709d118b18 About an hour ago 533MB

boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4224780-647 latest f13f5f07abdf About an hour ago 533MB

boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4299055-647 latest f13f5f07abdf About an hour ago 533MB

boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4158025-647 latest 30071b421094 About an hour ago 533MB

almalinux 9 df3270cc8bc8 2 weeks ago 209MB

atdr.meo.ws/archiveteam/goo-gl-grab latest 91466726fdb9 4 weeks ago 490MB

hello-world latest 74cc54e27dc4 8 weeks ago 10.1kB

containrrr/watchtower latest e7dd50d07b86 16 months ago 14.7MB

laks/dduper latest 8ae6fb7d5607 4 years ago 301MB

building image
running docker command: build . -t boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647 -f Dockerfile
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
Install the buildx component to build images with BuildKit:
https://docs.docker.com/go/buildx/

command output:
Sending build context to Docker daemon 3.999MB


Step 1/6 : FROM almalinux:9

---> df3270cc8bc8

Step 2/6 : RUN dnf install -y https://cvmrepo.s3.cern.ch/cvmrepo/yum/cvmfs-release-latest.noarch.rpm && dnf install -y epel-release && dnf install -y libxcrypt-compat bc bzip2 lighttpd procps-ng make gcc which cvmfs && dnf clean all

---> Using cache

---> 90b5257d624e

Step 3/6 : RUN useradd -m boinc

---> Using cache

---> 78e1f3e374ea

Step 4/6 : EXPOSE 80

---> Using cache

---> 89649ab0b08e

Step 5/6 : WORKDIR /boinc_slot_dir

---> Using cache

---> 3e32d896a4ec

Step 6/6 : CMD ./entrypoint.sh

---> Using cache

---> f13f5f07abdf

Successfully built f13f5f07abdf

Successfully tagged boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647:latest

web graphics: host port 36407, guest port 80
running docker command: create --name boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0 -v .:/boinc_slot_dir -p 36407:80 -v /cvmfs:/cvmfs:shared boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647
command output:
2e006bbb77116c2521d6455dd2d2dffdc0ced8cd7033290e412d15ce77d67596

starting container
running docker command: start boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0

running docker command: ps --all -f "name=boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0"
command output:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

2e006bbb7711 boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647 "/bin/sh -c ./entryp&#226;&#128;&#166;" 11 seconds ago Up 1 second 0.0.0.0:36407->80/tcp, :::36407->80/tcp boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0

running docker command: stats --no-stream --format "{{.CPUPerc}} {{.MemUsage}}" boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
6.27% 16.39MiB / 4.159GiB

running docker command: ps --all -f "name=boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0"
command output:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

2e006bbb7711 boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647 "/bin/sh -c ./entryp&#226;&#128;&#166;" 23 seconds ago Up 12 seconds 0.0.0.0:36407->80/tcp, :::36407->80/tcp boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0

running docker command: stats --no-stream --format "{{.CPUPerc}} {{.MemUsage}}" boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
0.19% 39.77MiB / 4.159GiB

running docker command: ps --all -f "name=boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0"
command output:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

2e006bbb7711 boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647 "/bin/sh -c ./entryp&#226;&#128;&#166;" 34 seconds ago Up 24 seconds 0.0.0.0:36407->80/tcp, :::36407->80/tcp boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0

running docker command: stats --no-stream --format "{{.CPUPerc}} {{.MemUsage}}" boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
0.02% 47.94MiB / 4.159GiB

running docker command: ps --all -f "name=boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0"
command output:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

2e006bbb7711 boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647 "/bin/sh -c ./entryp&#226;&#128;&#166;" 46 seconds ago Up 35 seconds 0.0.0.0:36407->80/tcp, :::36407->80/tcp boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0

running docker command: stats --no-stream --format "{{.CPUPerc}} {{.MemUsage}}" boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
3.07% 50.16MiB / 4.159GiB

running docker command: ps --all -f "name=boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0"
command output:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

2e006bbb7711 boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647 "/bin/sh -c ./entryp&#226;&#128;&#166;" 57 seconds ago Up 47 seconds 0.0.0.0:36407->80/tcp, :::36407->80/tcp boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0

running docker command: stats --no-stream --format "{{.CPUPerc}} {{.MemUsage}}" boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
10.83% 100.4MiB / 4.159GiB

running docker command: ps --all -f "name=boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0"
command output:
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

2e006bbb7711 boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647 "/bin/sh -c ./entryp&#226;&#128;&#166;" About a minute ago Up 58 seconds 0.0.0.0:36407->80/tcp, :::36407->80/tcp boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-64
7_0

running docker command: logs boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
Using CVMFS on the host.

job: htmld=/var/www/lighttpd

job: unpack exitcode=0

stderr from container:
Using CVMFS on the host.

job: htmld=/var/www/lighttpd

job: unpack exitcode=0

stderr end
running docker command: stop boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0

running docker command: container rm boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0
command output:
boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647_0

running docker command: image rm boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647
command output:
Untagged: boinc__lhcathomedev.cern.ch_lhcathome-dev__theory_2843-4101814-647:latest

2025-03-22 18:23:16 (61032): called boinc_finish(1)

Can you please post links to the logs instead of posting large logs?

And yes, setting lhcathomedev to NNT and vice versa works fine.

It does not work on build 8.1.0-1981 for me.
Also nothing happens when i press on update, suspend, reset , or remove.

I got a few BOINC errors when I upgraded e.g.

9	lhcathome-dev	3/22/2025 3:53:01 PM	[error] Project lhcathome-dev is in state file but no account file found	
10			3/22/2025 3:53:01 PM	[error] Application CMS outside project in state file	
11			3/22/2025 3:53:01 PM	[error] Application Xtrack outside project in state file	
12			3/22/2025 3:53:01 PM	[error] Application Theory outside project in state file	
13			3/22/2025 3:53:01 PM	[error] File info outside project in state file	
27			3/22/2025 3:53:01 PM	[error] Application version outside project in state file	
31			3/22/2025 3:53:01 PM	[error] Workunit outside project in state file	
32			3/22/2025 3:53:01 PM	[error] Task Theory_2843-4169431-640_2 outside project in state file	
33			3/22/2025 3:53:01 PM	[error] State file error: project https://lhcathomedev.cern.ch/lhcathome-dev/ not found for task	

but it seemed to recover fine.

The server gave me a regular theory task, so I wait for a docker one and report back

In reply to Toby Broom's message of 22 Mar 2025:

The server gave me a regular theory task, so I wait for a docker one and report back

Not 100% sure, but you may need to enable "Run native if available?" at your prefs page.

So far I didn't need it was serving me docker ones even though I could not run them as I was using 8.0.4.

I got one but it didn't work:

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3390602

You need to create a 'containers.conf' file like this, usually in '$HOME/.config/containers/'.

# To enable a local proxy remove the '#' from the next section
# and adjust the proxy name
#
#[containers]
#env = [
#    "http_proxy=http://your-local-squid.example.com:3128",
#    "https_proxy=http://your-local-squid.example.com:3128",
#    "no_proxy=localhost,127.0.0.0/8,192.168.0.0/16"
#]

[engine]
cgroup_manager = "cgroupfs"

OK, $HOME does not exist for the boinc user as it has no profile?

I put in the /usr/share/containers/containers.conf

The warnings went away, seems like there should be more guid for boinc: cf

https://unix.stackexchange.com/questions/689175/podman-errors-on-tar-with-potentially-insufficient-uids-or-gids-available-in-use


https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3390722

Please check the content of:

cat /etc/subuid
cat /etc/subgid

If boinc is missing, please add to each file:

boinc:100000:65536

In reply to Laurence CERN's message of 24 Mar 2025:

Please check the content of:

cat /etc/subuid
cat /etc/subgid

If boinc is missing, please add to each file:

boinc:100000:65536

Just in case boinc is not the only entry in those files:
Absolute numbers do not matter but the ranges for different users must not overlap.

This would be OK

boinc1:100000:65536
fredy2:300000:65536
boinc2:200000:65536

This would be wrong (fredy2 <-> boinc2)

fredy2:200000:65536
boinc1:100000:65536
boinc2:200000:65536

Already did that after looking around