Skip to content

Commit 99078ba

Browse files
committed
fix: resolve S3 publishing failures and publishDir configuration casting errors
- Add multipart upload permissions to S3 IAM policy for large files >5GB - Remove problematic closures from publishDir tags configuration - Update policy version hash to trigger compute environment recreation - Fixes workflow failures with S3 copy operations and casting errors
1 parent 11f5cce commit 99078ba

File tree

4 files changed

+560
-0
lines changed

4 files changed

+560
-0
lines changed
Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
// Nextflow configuration for ARM CPU compute environments
2+
// Includes base configuration and ARM-specific settings
3+
4+
includeConfig 'nextflow-base.config'
5+
6+
process {
7+
publishDir = [
8+
path: { params.outdir },
9+
mode: 'copy',
10+
tags: [
11+
'compute_env': 'aws_ireland_fusionv2_nvme_cpu_ARM_snapshots',
12+
'architecture': 'arm64',
13+
'fusion': 'enabled',
14+
'fusionSnapshots': 'enabled'
15+
]
16+
]
17+
}
Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
// Nextflow configuration for CPU compute environments
2+
// Includes base configuration and CPU-specific settings
3+
4+
includeConfig 'nextflow-base.config'
5+
6+
process {
7+
publishDir = [
8+
path: { params.outdir },
9+
mode: 'copy',
10+
tags: [
11+
'compute_env': 'aws_ireland_fusionv2_nvme_cpu_snapshots',
12+
'architecture': 'x86_64',
13+
'fusion': 'enabled',
14+
'fusionSnapshots': 'enabled'
15+
]
16+
]
17+
}
Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
// Nextflow configuration for GPU compute environments
2+
// Includes base configuration and GPU-specific settings
3+
4+
includeConfig 'nextflow-base.config'
5+
6+
process {
7+
publishDir = [
8+
path: { params.outdir },
9+
mode: 'copy',
10+
tags: [
11+
'compute_env': 'aws_ireland_fusionv2_nvme_gpu_snapshots',
12+
'architecture': 'x86_64',
13+
'gpu': 'enabled',
14+
'fusion': 'enabled',
15+
'fusionSnapshots': 'enabled'
16+
]
17+
]
18+
}

0 commit comments

Comments
 (0)