Make eessi configure gpu node automatically

[claudia-lola]

Add tasks to eessi/configure.yml and compute-init.yml to run the EESSI link_nvidia_host_libraries.sh script on gpu nodes with nvidia drivers installed. The tasks will be run when either site.yml is run or a rebuild via slurm is completed.

[claudia-lola]

fat image build

[sjpb]

Looks fine, except the built images need adding back into the CI config.

[sjpb]

Failed CI run above (note previous attempts failed due to cloudflare being down):

• compute node has reimaged to openhpc-rl9-251112-1307-e34d64c4, so that's ok
• ansible-init failed:

Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34868]: TASK [Add base CVMFS config] ***************************************************
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34868]: fatal: [127.0.0.1]: FAILED! => {"msg": "Unable to look up a name or access an attribute in template string ({{ cvmfs_config | dict2items }}).\nMake sure your variable name does not contain invalid characters like '-': dict2items requires a dictionary, got <class 'ansible.template.Ans
ibleUndefined'> instead.. dict2items requires a dictionary, got <class 'ansible.template.AnsibleUndefined'> instead.. Unable to look up a name or access an attribute in template string ({{ cvmfs_config | dict2items }}).\nMake sure your variable name does not contain invalid characters like '-': dict2items requires a dictionary, got <class 'ansib
le.template.AnsibleUndefined'> instead.. dict2items requires a dictionary, got <class 'ansible.template.AnsibleUndefined'> instead."}
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34868]: PLAY RECAP *********************************************************************
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34868]: 127.0.0.1                  : ok=19   changed=3    unreachable=0    failed=1    skipped=29   rescued=0    ignored=0
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34821]: Traceback (most recent call last):
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34821]:  File "/usr/bin/ansible-init", line 91, in <module>
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34821]:    ansible_exec(
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34821]:  File "/usr/bin/ansible-init", line 39, in ansible_exec
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34821]:    subprocess.run([cmd, *args], env = environ, check = True, **kwargs)
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34821]:  File "/usr/lib64/python3.9/subprocess.py", line 528, in run
Nov 19 10:31:27 slurmci-RL9-357-compute-0 ansible-init[34821]:    raise CalledProcessError(retcode, process.args,

[sjpb]

My suggested refactoring was wrong, sorry! Lets try again - will need a new image build

[sjpb]

LGTM

[sjpb]

LGTM