Code

[fs] basic sync tool#14248

Code

Open

danking wants to merge 67 commits intohail-is:mainhail-is/hail:mainfrom danking:new-new-copierdanking/hail:new-new-copierCopy head branch name to clipboard

+1,179-112

Commits

Commits on Feb 27, 2024

• [fs] basic sync tool

  Show description for 8621664
  

  Dan King

  committed
  8621664

  Copy full SHA for 8621664

• more docs

  

  Dan King

  committed
  86b5a4b

  Copy full SHA for 86b5a4b

• fix bad help string

  

  Dan King

  committed
  8fbc0f2

  Copy full SHA for 8fbc0f2

• use recursive=True for rapid listing

  

  Dan King

  committed
  861ca13

  Copy full SHA for 861ca13

• fix

  

  Dan King

  committed
  7660033

  Copy full SHA for 7660033

• no prints

  

  Dan King

  committed
  f956f0a

  Copy full SHA for f956f0a

• allow isdir without trailing slash

  

  Dan King

  committed
  5b0c8a9

  Copy full SHA for 5b0c8a9

• simplify sync.py dramatically

  

  Dan King

  committed
  46b1b34

  Copy full SHA for 46b1b34

• update listeners before return

  

  Dan King

  committed
  55c83e0

  Copy full SHA for 55c83e0

• use uvloop

  

  Dan King

  committed
  eac543c

  Copy full SHA for eac543c

• uvloopx

  

  Dan King

  committed
  2bc9d1d

  Copy full SHA for 2bc9d1d

• import fix

  

  Dan King

  committed
  9588f91

  Copy full SHA for 9588f91

• maybe get InsertObjectStream right

  

  Dan King

  committed
  b905f30

  Copy full SHA for b905f30

• await _cleanup_future too

  

  Dan King

  committed
  c4162cb

  Copy full SHA for c4162cb

• use async with instead of async with await

  

  Dan King

  committed
  c8388b1

  Copy full SHA for c8388b1

• smaller part size maybe helps?

  

  Dan King

  committed
  527488f

  Copy full SHA for 527488f

• prints

  

  Dan King

  committed
  c8891ec

  Copy full SHA for c8891ec

• use order of magnitude less file parallelism than partition parallelism

  

  Dan King

  committed
  0e6ae95

  Copy full SHA for 0e6ae95

• files are 1

  

  Dan King

  committed
  04448ed

  Copy full SHA for 04448ed

• prints

  

  Dan King

  committed
  22ef264

  Copy full SHA for 22ef264

• debugging

  

  Dan King

  committed
  9a43627

  Copy full SHA for 9a43627

• debugging

  

  Dan King

  committed
  f5a7af2

  Copy full SHA for f5a7af2

• fix

  

  Dan King

  committed
  e6fffd7

  Copy full SHA for e6fffd7

• revert prints

  

  Dan King

  committed
  470884d

  Copy full SHA for 470884d

• fewre prints

  

  Dan King

  committed
  01e0759

  Copy full SHA for 01e0759

• debug

  

  Dan King

  committed
  52fd7b6

  Copy full SHA for 52fd7b6

• wtf

  

  Dan King

  committed
  e5ce4d6

  Copy full SHA for e5ce4d6

• debug

  

  Dan King

  committed
  279dcfa

  Copy full SHA for 279dcfa

• debug

  

  Dan King

  committed
  d1ef63c

  Copy full SHA for d1ef63c

• debug

  

  Dan King

  committed
  41d9a9a

  Copy full SHA for 41d9a9a

• debug

  

  Dan King

  committed
  927ad35

  Copy full SHA for 927ad35

• debug

  

  Dan King

  committed
  8e0d44c

  Copy full SHA for 8e0d44c

• debug

  

  Dan King

  committed
  cab8b8f

  Copy full SHA for cab8b8f

• debug

  

  Dan King

  committed
  4a848b4

  Copy full SHA for 4a848b4

• debug

  

  Dan King

  committed
  f89a9e5

  Copy full SHA for f89a9e5

• debug

  

  Dan King

  committed
  188fff7

  Copy full SHA for 188fff7

• debug

  

  Dan King

  committed
  9ef4b32

  Copy full SHA for 9ef4b32

• debug

  

  Dan King

  committed
  7086648

  Copy full SHA for 7086648

• debug

  

  Dan King

  committed
  2c9d79d

  Copy full SHA for 2c9d79d

• debug

  

  Dan King

  committed
  6268348

  Copy full SHA for 6268348

• debug

  

  Dan King

  committed
  edbf8cd

  Copy full SHA for edbf8cd

• debug

  

  Dan King

  committed
  c9b07de

  Copy full SHA for c9b07de

• debug

  

  Dan King

  committed
  7aa4a5a

  Copy full SHA for 7aa4a5a

• debug

  

  Dan King

  committed
  2a886aa

  Copy full SHA for 2a886aa

• debug

  

  Dan King

  committed
  7fc7003

  Copy full SHA for 7fc7003

• async with await

  

  Dan King

  committed
  e564b5d

  Copy full SHA for e564b5d

• pyright fixes

  

  Dan King

  committed
  40f96c5

  Copy full SHA for 40f96c5

• remove uvloopx changes

  

  Dan King

  committed
  4c69ec6

  Copy full SHA for 4c69ec6

• Revert "also front_end.py"

  Show description for e3425e1
  

  Dan King

  committed
  e3425e1

  Copy full SHA for e3425e1

• remove cruft

  

  Dan King

  committed
  eeb861f

  Copy full SHA for eeb861f

• remove debug cruft

  

  Dan King

  committed
  ba77330

  Copy full SHA for ba77330

• fix Self improt

  

  Dan King

  committed
  44c9364

  Copy full SHA for 44c9364

Commits on Feb 28, 2024

• fix bad imports

  

  Dan King

  committed
  f6eacea

  Copy full SHA for f6eacea

• Merge remote-tracking branch 'hi/main' into new-new-copier

  

  Dan King

  committed
  f502b8f

  Copy full SHA for f502b8f

• [uvloopx] consolidate uvloop initialization code to one place

  

  Dan King

  committed
  2bd85ec

  Copy full SHA for 2bd85ec

• also front_end.py

  

  Dan King

  committed
  4c05471

  Copy full SHA for 4c05471

• revert unnecsesary changes to copy and copier

  

  Dan King

  committed
  4bba249

  Copy full SHA for 4bba249

Commits on Feb 29, 2024

• add assertion about total size and also fix lint about unused variable

  

  Dan King

  committed
  7ae6107

  Copy full SHA for 7ae6107

Commits on Jun 25, 2024

• :Merge remote-tracking branch 'upstream/main' into new-new-copier

  chrisvittal

  committed
  38727c9

  Copy full SHA for 38727c9

• fix

  chrisvittal

  committed
  9c25bc0

  Copy full SHA for 9c25bc0

Commits on Aug 5, 2024

• Merge branch 'main' into new-new-copier

  chrisvittal

  committed
  1a33173

  Copy full SHA for 1a33173

Commits on Aug 7, 2024

• lint fixes

  chrisvittal

  committed
  44ef794

  Copy full SHA for 44ef794

Commits on Aug 8, 2024

• test fixes

  chrisvittal

  committed
  7087fc0

  Copy full SHA for 7087fc0

Commits on Aug 12, 2024

• fix?

  chrisvittal

  committed
  5a32d23

  Copy full SHA for 5a32d23

Commits on Aug 13, 2024

• lint

  chrisvittal

  committed
  c66533f

  Copy full SHA for c66533f

Commits on Sep 13, 2024

• Merge branch 'main' into new-new-copier

  chrisvittal

  committed
  a447e22

  Copy full SHA for a447e22

Commits on Jan 29, 2025

• Merge branch 'main' into new-new-copier

  chrisvittal

  committed
  b87f981

  Copy full SHA for b87f981