Problem statement I have a Python program that needs to launch a number of Singularity containers in parallel. Is it possible to do this, exploiting all of the available hardware, using only built-in libraries (subprocessing, concurrent.futures, etc)? The 'host' script…
I have a dockerfile which ends ENTRYPOINT ["sh"] CMD ["runscript.sh"] I can run docker with an argument (a shell script) that overrides "runscript.sh" (if i wish). Note: the shell scripts are provided by a --bind mount I am translating my…
I tried to pull the latest version of the Singularity image for fmriprep into an HPC, which to my understanding is 21.0.1. I did it using the following bash script: module load singularity singularity pull --name fmriprep_latest.sif docker://poldracklab/fmriprep:latest Unfortunately, for…
Trying to run slurmd: sudo systemctl start slurmd I display the status of the daemon and an error is displayed on the screen: >>sudo systemctl status slurmd ● slurmd.service - Slurm node daemon Loaded: loaded (/lib/systemd/system/slurmd.service; enabled; vendor preset: enabled)…
I am struggling to find a comprehensive report about a general HPC cluster's average hardware utilization. There are various data-sets available from Google, or Facebook about their cloud's hardware utilization, but are there any similar report/data-set that I can cite…