Code

add multiprocessing#92

Code

Open

LFT18 wants to merge 99 commits intoRasmussenLab:developerRasmussenLab/MOVE:developerfrom LFT18:mainLFT18/multiprocessing_bayes_MOVE:mainCopy head branch name to clipboard

+1,108-210

Commits

Commits on Apr 18, 2024

• Add files for multiprocessing

  

  qgh533

  committed
  0e2242e

  Copy full SHA for 0e2242e

• Update identify_associations_multiprocess.py

  LFT18

  authored
  2add9b9

  Copy full SHA for 2add9b9

Commits on Apr 19, 2024

• Clean multiprocessing script

  LFT18

  authored
  f645ea4

  Copy full SHA for f645ea4

• Update __main__.py multiprocessing

  LFT18

  authored
  f471704

  Copy full SHA for f471704

• Update schema.py multiprocessing

  LFT18

  authored
  85c28e5

  Copy full SHA for 85c28e5

• Update __init__.py multiprocessing

  LFT18

  authored
  6330e92

  Copy full SHA for 6330e92

• Update preprocessing.py

  LFT18

  authored
  bbe1b4e

  Copy full SHA for bbe1b4e

Commits on Apr 22, 2024

• 🔥 clean-up duplicated src/move files (pkg was in main folder)

  

  Henry Webel

  committed
  820c554

  Copy full SHA for 820c554

Commits on Apr 23, 2024

• ✨ add identify_associations_multiprocess to src/move/tasks

  Show description for ce9a9dc
  

  Henry Webel

  committed
  ce9a9dc

  Copy full SHA for ce9a9dc

• 🐛 make mutliprocessing not stale: assign # of threads for each process

  Show description for 5327223
  

  Henry Webel

  committed
  5327223

  Copy full SHA for 5327223

• Merge pull request #1 from enryH/main

  Show description for eaa858a
  LFT18

  authored
  eaa858a

  Copy full SHA for eaa858a

• Updated identify_associations_multiprocess.py

  

  qgh533

  committed
  5ab5e59

  Copy full SHA for 5ab5e59

• Update config files for small tries

  

  qgh533

  committed
  33f565a

  Copy full SHA for 33f565a

Commits on Apr 24, 2024

• Multiprocessing for analyze_latent

  

  qgh533

  committed
  63f128b

  Copy full SHA for 63f128b

• Analyze latent multiprocessing

  

  qgh533

  committed
  ca389d2

  Copy full SHA for ca389d2

• Analyze latent multiprocessing

  

  qgh533

  committed
  e08a94b

  Copy full SHA for e08a94b

Commits on Apr 25, 2024

• Fix bayes_k calculation

  

  qgh533

  committed
  e94ef90

  Copy full SHA for e94ef90

Commits on Apr 26, 2024

• Fix analyze_latent_multiprocessing

  

  qgh533

  committed
  f4f0aa3

  Copy full SHA for f4f0aa3

Commits on May 11, 2024

• Update and new functions

  

  qgh533

  committed
  6a0b665

  Copy full SHA for 6a0b665

• Delete files and fix multiloop

  

  qgh533

  committed
  a5310a6

  Copy full SHA for a5310a6

Commits on May 21, 2024

• Clean identify_association_multiprocess.py

  

  qgh533

  committed
  e67bb75

  Copy full SHA for e67bb75

• Clean analyze_latent multiprocessing.py

  

  qgh533

  committed
  86bfed5

  Copy full SHA for 86bfed5

Commits on Jun 7, 2024

• Update perturbations.py

  LFT18

  authored
  f9d4961

  Copy full SHA for f9d4961

Commits on Jun 10, 2024

• Update perturbations.py

  LFT18

  authored
  c2c49e8

  Copy full SHA for c2c49e8

Commits on Jun 13, 2024

• Delete src/move/tasks/analyze_latent_efficient.py

  LFT18

  authored
  0a4bcae

  Copy full SHA for 0a4bcae

• Delete src/move/tasks/analyze_latent_multiprocessing.py

  LFT18

  authored
  ce20dac

  Copy full SHA for ce20dac

• Delete src/move/tasks/identify_associations_multiprocess_loop.py

  LFT18

  authored
  4a72842

  Copy full SHA for 4a72842

• Delete src/move/tasks/identify_associations_multiprocess_may.py

  LFT18

  authored
  f537d21

  Copy full SHA for f537d21

• Delete src/move/tasks/identify_associations_selected.py

  LFT18

  authored
  568aaa8

  Copy full SHA for 568aaa8

• Delete src/move/tasks/analyze_latent_original.py

  LFT18

  authored
  ede3707

  Copy full SHA for ede3707

• Remove multiprocess_loop

  LFT18

  authored
  5df8a01

  Copy full SHA for 5df8a01

• Remove multiprocess_loop

  LFT18

  authored
  52c37fd

  Copy full SHA for 52c37fd

Commits on Jun 18, 2024

• 🎨 format with black

  

  Henry

  committed
  2e29f23

  Copy full SHA for 2e29f23

• Merge branch 'main' into LFT18-main

  

  Henry

  committed
  13678cb

  Copy full SHA for 13678cb

• Merge branch 'developer' into LFT18-main

  

  Henry

  committed
  f92a862

  Copy full SHA for f92a862

Commits on Jun 20, 2024

• 🎨 add trigger of actions from PR

  

  Henry

  committed
  b7824f7

  Copy full SHA for b7824f7

• 🎨 format with black

  

  Henry

  committed
  e5253a2

  Copy full SHA for e5253a2

• 🔥 remove duplicated code and intermediate scripts

  

  Henry

  committed
  d4118a3

  Copy full SHA for d4118a3

Commits on Jun 21, 2024

• Merge branch 'developer' into LFT18-main

  

  Henry

  committed
  3e19e24

  Copy full SHA for 3e19e24

Commits on Jun 24, 2024

• 🐛 fix f-string formatting errors

  Show description for dbc0238
  

  Henry

  committed
  dbc0238

  Copy full SHA for dbc0238

• 🐛 remove unused imports

  

  Henry

  committed
  80352e6

  Copy full SHA for 80352e6

Commits on Jul 3, 2024

• ⏪ add configuration files back in from developer branch

  

  Henry

  committed
  488b4a4

  Copy full SHA for 488b4a4

• 🎨 isort imports

  

  Henry

  committed
  9b3a27e

  Copy full SHA for 9b3a27e

• 🚧 see if this advances CI to the next step

  

  Henry

  committed
  05d4c34

  Copy full SHA for 05d4c34

• 🔥 remove intermediate files of development

  Show description for ebb72ad
  

  Henry

  committed
  ebb72ad

  Copy full SHA for ebb72ad

• 🚧 multiprocess only defined for bayes factors

  

  Henry

  committed
  efbfd5c

  Copy full SHA for efbfd5c

• 🐛 remove non-existing, intermediate tasks (used for developing), no multiprocessing for t-tests

  Show description for fbbeb19
  

  Henry

  committed
  fbbeb19

  Copy full SHA for fbbeb19

• 🐛 also deactivate mutliprocessing for KS as it's not implemented

  

  Henry

  committed
  cb3ad30

  Copy full SHA for cb3ad30

• 🎨 fix flake8-bugbear issues except missing multiprocessing of t-test and KS approach

  

  Henry

  committed
  8c61d35

  Copy full SHA for 8c61d35

• 🐛 format and fix import

  

  Henry

  committed
  5aa03ff

  Copy full SHA for 5aa03ff

• 🐛 use perturb_continuous_data_extended from perturbations

  Show description for 8b06298
  

  Henry

  committed
  8b06298

  Copy full SHA for 8b06298

Commits on Jul 4, 2024

• 🔥 comments and old configurations; format

  

  Henry

  committed
  6cfd1f8

  Copy full SHA for 6cfd1f8

• 🔥 remove duplicated functionality

  Show description for 8277891
  

  Henry

  committed
  8277891

  Copy full SHA for 8277891

• ✨ integrate multiprocessing into analyze_latent.py

  Show description for 44802eb
  

  Henry

  committed
  44802eb

  Copy full SHA for 44802eb

• ✨ merge multiprocessing bayes factors into identify_associations

  Show description for f64d779
  

  Henry

  committed
  f64d779

  Copy full SHA for f64d779

Commits on Jul 5, 2024

• 🔥 remove old schema entries, increase run time

  

  Henry

  committed
  6a17110

  Copy full SHA for 6a17110

• :zip: do no save intermediate files for single-process bayes_approach

  

  Henry

  committed
  b8b4769

  Copy full SHA for b8b4769

• 🔥 remove comments

  

  Henry

  committed
  2927d3f

  Copy full SHA for 2927d3f

• 🔥 remove unused code

  

  Henry

  committed
  202eb74

  Copy full SHA for 202eb74

• 🎨 reorder functions

  

  Henry

  committed
  d6bc896

  Copy full SHA for d6bc896

• 🚧 move bayes_parallel to own module

  Show description for b99ce97
  

  Henry

  committed
  b99ce97

  Copy full SHA for b99ce97

• 🚧 unify interface

  

  Henry

  committed
  171c915

  Copy full SHA for 171c915

• 🔥 remove not-used code

  

  Henry

  committed
  95c9f40

  Copy full SHA for 95c9f40

• 🎨 start separating recurrent code into fcts

  

  Henry

  committed
  e556fae

  Copy full SHA for e556fae

• 🎨 adapt to look more similar to single-core bayes factor fct

  

  Henry

  committed
  1a2774d

  Copy full SHA for 1a2774d

• ✨ add back masking of self-perturbed feat.

  

  Henry

  committed
  680c164

  Copy full SHA for 680c164

Commits on Jul 8, 2024

• 🎨 initiailize logger at the top of the module

  

  Henry

  committed
  8f43c90

  Copy full SHA for 8f43c90

• ✨ pass feature_mask to bayes_parallell

  Show description for 6178c8f
  

  Henry

  committed
  6178c8f

  Copy full SHA for 6178c8f

• 🐛 add condition for masking

  Show description for 60ed227
  

  Henry

  committed
  60ed227

  Copy full SHA for 60ed227

• 🎨 align masking strategies

  

  Henry

  committed
  f5da671

  Copy full SHA for f5da671

• 🐛 fix cont perturbation

  Show description for 7eae82d
  

  Henry

  committed
  7eae82d

  Copy full SHA for 7eae82d

• 🐛 remove redefintion of nan_mask

  

  Henry

  committed
  50a623e

  Copy full SHA for 50a623e

• 🎨 only define logger once in module

  

  Henry

  committed
  2df057b

  Copy full SHA for 2df057b

• 🎨 align single process bayes and multiprocess bayes fct

  Show description for 2e87e12
  

  Henry

  committed
  2e87e12

  Copy full SHA for 2e87e12

• 🎨 just document in code that this cannot happen

  Show description for aa2e5d9
  

  Henry

  committed
  aa2e5d9

  Copy full SHA for aa2e5d9

• ⚡ improve CI speed, reduce stability (-> one refit only)

  

  Henry

  committed
  4041fcb

  Copy full SHA for 4041fcb

• 🐛 use default no. of epochs + t-test needs 4 refits

  

  Henry

  committed
  2d004e0

  Copy full SHA for 2d004e0

Commits on Jul 9, 2024

• ⚡ do not run t-test check (for now)

  Show description for 8d65528
  

  Henry

  committed
  8d65528

  Copy full SHA for 8d65528

• ⚡ bump up bayes factor training

  

  Henry

  committed
  1dd6788

  Copy full SHA for 1dd6788

• 🎨 train both refits with 100 epochs

  

  Henry

  committed
  dc9020e

  Copy full SHA for dc9020e

• ✨ add log2 option

  Show description for 9cd2a7b
  

  Henry

  committed
  9cd2a7b

  Copy full SHA for 9cd2a7b

• 🎨 document some more

  

  Henry

  committed
  a4911d7

  Copy full SHA for a4911d7

• ⚡ test multiprocess on continuous tutorial

  

  Henry

  committed
  e0421bd

  Copy full SHA for e0421bd

• 🐛 remove non-exisitng key

  

  Henry

  committed
  c70d328

  Copy full SHA for c70d328

• ✨ build dataloader fct

  Show description for 1c72316
  

  Henry

  committed
  1c72316

  Copy full SHA for 1c72316

• 🐛 fix minor bug (wrongly assigned feat)

  

  Henry

  committed
  58f08e4

  Copy full SHA for 58f08e4

• ⚡ move masking code into main fct of module

  

  Henry

  committed
  f895237

  Copy full SHA for f895237

• 🎨 move feat_mask creation out

  

  Henry

  committed
  5eb7954

  Copy full SHA for 5eb7954

• 🚑 temp. fix of CI

  Show description for 8c4e53b
  

  Henry

  committed
  8c4e53b

  Copy full SHA for 8c4e53b

• ⚡ do not build dataloaders for multiprocessing

  

  Henry

  committed
  49a93d0

  Copy full SHA for 49a93d0

Commits on Jul 10, 2024

• 🚧 test t-test again, re-run pert. w/o model training

  

  Henry

  committed
  709c674

  Copy full SHA for 709c674

• ✨ add categorical pert. to multiprocessing

  

  Henry

  committed
  6e65cc6

  Copy full SHA for 6e65cc6

• 🔥 remove unused code

  

  Henry

  committed
  4efbdd9

  Copy full SHA for 4efbdd9

• 🎨 remove unused argument

  

  Henry

  committed
  dab767a

  Copy full SHA for dab767a

Commits on Jul 12, 2024

• ⏪ checkout developer version

  

  Henry

  committed
  980bbce

  Copy full SHA for 980bbce

• 🎨 move shared key to base class

  

  Henry

  committed
  c26b2dd

  Copy full SHA for c26b2dd

• 🔥 remove comments and code duplications

  

  Henry

  committed
  05c1735

  Copy full SHA for 05c1735

• 🎨 update type hints, remove unused import

  

  Henry

  committed
  c5002cd

  Copy full SHA for c5002cd

Commits on Aug 12, 2024

• Merge branch 'developer' into main

  enryH

  authored
  fe8c48b

  Copy full SHA for fe8c48b