change pre_prepare_hook_remove_install_dir_for_rebuilds into a pre_fetch hook by bedroge · Pull Request #342 · EESSI/software-layer-scripts

bedroge · 2026-11-05T10:29:45Z

Otherwise it gets triggered for every iteration, and then it wipes the files installed by the previous iteration

…hook_remove_install_dir_for_rebuilds

bedroge · 2026-11-05T11:13:07Z

EESSI/dev.eessi.io-riscv#140 should hopefully fix the failing CI.

…ebuilds_remove_installdir_wrong_hook

casparvl · 2026-11-05T13:19:43Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2
bot: build repo:eessi.io-2026.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2026-11-05T13:19:50Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2023.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2026.11/pr_342/223914

date	job status	comment
Nov 05 13:19:48 UTC 2026	submitted	job id `223914` awaits release by job manager
Nov 05 13:20:30 UTC 2026	released	job awaits launch by Slurm scheduler
Nov 05 13:27:45 UTC 2026	running	job `223914` is running
Nov 05 13:30:56 UTC 2026	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-223914.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.* created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-17938852620.tar.zst` size: 0 MiB (37880 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen2/software no software packages in tarball reprod directories under 2023.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2023.06/software/linux/x86_64/amd/zen2 no other files in tarball
Nov 05 13:30:56 UTC 2026	test result	😁 SUCCESS (click triangle for details) ReFrame Summary WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 8}), [ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_info=('BotBuildTests:x86-64-zen2', 'default', 'LAMMPS/2Aug2023_update2-foss-2023a-kokkos') %scale=1_node /e6487f70 @BotBuildTests:x86-64-zen2+default P: perf: 455.455 timesteps/s (r:0, l:None, u:None) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 8}), [ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_info=('BotBuildTests:x86-64-zen2', 'default', 'LAMMPS/29Aug2024-foss-2023b-kokkos') %scale=1_node /a88ab31a @BotBuildTests:x86-64-zen2+default P: perf: 449.069 timesteps/s (r:0, l:None, u:None) WARNING: PROCESS BINDING ERROR: wrong number of cpus per process: expected 1, found Counter({16: 8}) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 64}), [ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_info=('BotBuildTests:x86-64-zen2', 'default', 'OSU-Micro-Benchmarks/7.2-gompi-2023b') %scale=1_node %device_type=cpu /ea7c1ff2 @BotBuildTests:x86-64-zen2+default P: latency: 4.08 us (r:0, l:None, u:None) WARNING: PROCESS BINDING ERROR: wrong number of cpus per process: expected 1, found Counter({16: 8}) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 64}), [ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_info=('BotBuildTests:x86-64-zen2', 'default', 'OSU-Micro-Benchmarks/7.1-1-gompi-2023a') %scale=1_node %device_type=cpu /4138f72f @BotBuildTests:x86-64-zen2+default P: latency: 3.38 us (r:0, l:None, u:None) WARNING: PROCESS BINDING ERROR: wrong number of cpus per process: expected 1, found Counter({16: 8}) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 64}), [ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_info=('BotBuildTests:x86-64-zen2', 'default', 'OSU-Micro-Benchmarks/7.2-gompi-2023b') %scale=1_node %device_type=cpu /2d7254d4 @BotBuildTests:x86-64-zen2+default P: latency: 6.23 us (r:0, l:None, u:None) WARNING: PROCESS BINDING ERROR: wrong number of cpus per process: expected 1, found Counter({16: 8}) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 64}), [ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_info=('BotBuildTests:x86-64-zen2', 'default', 'OSU-Micro-Benchmarks/7.1-1-gompi-2023a') %scale=1_node %device_type=cpu /17125a0e @BotBuildTests:x86-64-zen2+default P: latency: 6.13 us (r:0, l:None, u:None) WARNING: PROCESS BINDING ERROR: wrong number of cpus per process: expected 1, found Counter({2: 2}) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 2}), [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_info=('BotBuildTests:x86-64-zen2', 'default', 'OSU-Micro-Benchmarks/7.2-gompi-2023b') %scale=1_node /877aff00 @BotBuildTests:x86-64-zen2+default P: latency: 0.4 us (r:0, l:None, u:None) WARNING: PROCESS BINDING ERROR: wrong number of cpus per process: expected 1, found Counter({2: 2}) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 2}), [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_info=('BotBuildTests:x86-64-zen2', 'default', 'OSU-Micro-Benchmarks/7.1-1-gompi-2023a') %scale=1_node /cf14cee4 @BotBuildTests:x86-64-zen2+default P: latency: 0.28 us (r:0, l:None, u:None) WARNING: PROCESS BINDING ERROR: wrong number of cpus per process: expected 1, found Counter({2: 2}) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 2}), [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_info=('BotBuildTests:x86-64-zen2', 'default', 'OSU-Micro-Benchmarks/7.2-gompi-2023b') %scale=1_node /fd7f244c @BotBuildTests:x86-64-zen2+default P: bandwidth: 32849.98 MB/s (r:0, l:None, u:None) WARNING: PROCESS BINDING ERROR: wrong number of cpus per process: expected 1, found Counter({2: 2}) WARNING: PROCESS BINDING WARNING: processes with cores shared by processing units, indicating hyperthreading: Counter({2: 2}), [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_info=('BotBuildTests:x86-64-zen2', 'default', 'OSU-Micro-Benchmarks/7.1-1-gompi-2023a') %scale=1_node /1d74513f @BotBuildTests:x86-64-zen2+default P: bandwidth: 32708.58 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-223914.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
Nov 05 14:10:02 UTC 2026	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-17938852620.tar.zst` to S3 bucket succeeded

eessi-bot-aws · 2026-11-05T13:19:55Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2026.11/pr_342/223915

date	job status	comment
Nov 05 13:19:54 UTC 2026	submitted	job id `223915` awaits release by job manager
Nov 05 13:20:27 UTC 2026	released	job awaits launch by Slurm scheduler
Nov 05 13:26:38 UTC 2026	running	job `223915` is running
Nov 05 13:29:53 UTC 2026	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-223915.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.* created!` Artefacts `eessi-2025.06-software-linux-x86_64-amd-zen2-17938852020.tar.zst` size: 0 MiB (37887 bytes) entries: 1 modules under 2025.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2025.06/software/linux/x86_64/amd/zen2/software no software packages in tarball reprod directories under 2025.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2025.06/software/linux/x86_64/amd/zen2 no other files in tarball
Nov 05 13:29:53 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite produced failures. ReFrame Summary [ FAILED ] Ran 6/6 test case(s) from 6 check(s) (6 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-223915.out` ❌ found message matching `ERROR:` ❌ found message matching `[\sFAILED\s].Ran . test case`
Nov 05 14:10:11 UTC 2026	uploaded	transfer of `eessi-2025.06-software-linux-x86_64-amd-zen2-17938852020.tar.zst` to S3 bucket succeeded

eessi-bot-aws · 2026-11-05T13:20:00Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2026.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2026.11/pr_342/223916

date	job status	comment
Nov 05 13:19:59 UTC 2026	submitted	job id `223916` awaits release by job manager
Nov 05 13:20:24 UTC 2026	released	job awaits launch by Slurm scheduler
Nov 05 13:25:33 UTC 2026	running	job `223916` is running
Nov 05 13:28:49 UTC 2026	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-223916.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.* created!` Artefacts `eessi-2026.06-software-linux-x86_64-amd-zen2-17938852580.tar.zst` size: 0 MiB (37842 bytes) entries: 1 modules under 2026.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2026.06/software/linux/x86_64/amd/zen2/software no software packages in tarball reprod directories under 2026.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2026.06/software/linux/x86_64/amd/zen2 no other files in tarball
Nov 05 13:28:49 UTC 2026	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite produced failures. ReFrame Summary [ FAILED ] Ran 4/4 test case(s) from 4 check(s) (4 failure(s), 0 expected failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-223916.out` ❌ found message matching `ERROR:` ❌ found message matching `[\sFAILED\s].Ran . test case`
Nov 05 14:10:20 UTC 2026	uploaded	transfer of `eessi-2026.06-software-linux-x86_64-amd-zen2-17938852580.tar.zst` to S3 bucket succeeded

change pre_prepare_hook_remove_install_dir_for_rebuilds to pre_fetch_…

6933900

…hook_remove_install_dir_for_rebuilds

bedroge added a commit to bedroge/software-layer that referenced this pull request Nov 5, 2026

use commit from EESSI/software-layer-scripts#342

b72f7e2

bedroge added a commit to bedroge/software-layer that referenced this pull request Nov 5, 2026

use commit from EESSI/software-layer-scripts#342

6af7105

bedroge added a commit to bedroge/software-layer that referenced this pull request Nov 5, 2026

use commit from EESSI/software-layer-scripts#342

6d6b69c

Merge branch 'main' of github.com:EESSI/software-layer-scripts into r…

3c7d566

…ebuilds_remove_installdir_wrong_hook

casparvl added the bot:deploy label Nov 5, 2026

casparvl mentioned this pull request Nov 5, 2026

Limit the build parallelism for Highway #317

Merged

casparvl approved these changes Nov 5, 2026

View reviewed changes

This was referenced Nov 5, 2026

{2025.06} rebuild Brotli to fix CVE-2026-111497 EESSI/software-layer#1912

Merged

{2023.06} Rebuild Brotli to fix CVE-2026-111497 EESSI/software-layer#1911

Merged

casparvl merged commit 66e4377 into EESSI:main Nov 5, 2026
134 of 146 checks passed

bedroge deleted the rebuilds_remove_installdir_wrong_hook branch November 5, 2026 20:07

Navigation Menu

Repository navigation

change pre_prepare_hook_remove_install_dir_for_rebuilds into a pre_fetch hook - #342

change pre_prepare_hook_remove_install_dir_for_rebuilds into a pre_fetch hook#342
casparvl merged 2 commits into
EESSI:mainfrom
bedroge:rebuilds_remove_installdir_wrong_hook

bedroge commented Nov 5, 2026

Uh oh!

bedroge commented Nov 5, 2026

Uh oh!

casparvl commented Nov 5, 2026

Uh oh!

eessi-bot-aws Bot commented Nov 5, 2026 •

edited

Loading

Uh oh!

eessi-bot-aws Bot commented Nov 5, 2026 •

edited

Loading

Uh oh!

eessi-bot-aws Bot commented Nov 5, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

bedroge commented Nov 5, 2026

Uh oh!

bedroge commented Nov 5, 2026

Uh oh!

casparvl commented Nov 5, 2026

Uh oh!

eessi-bot-aws Bot commented Nov 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-aws Bot commented Nov 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-aws Bot commented Nov 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

eessi-bot-aws Bot commented Nov 5, 2026 •

edited

Loading

eessi-bot-aws Bot commented Nov 5, 2026 •

edited

Loading

eessi-bot-aws Bot commented Nov 5, 2026 •

edited

Loading