2.3.0rc1
Pre-release
Pre-release
What's Changed
- Fix
BufferedReader
error caused by opening an empty file in S3 in "rb" mode by @belltailjp in #270 - Sphinx 5 warns as language is None by @kuenishi in #274
- Control buffering for underlying file object for Zip(FS) by @kuenishi in #273
- Sparse file local cache by @kuenishi in #275
- Thread safety by @kuenishi in #277
- Multiprocessing-safe sparse file cache by @kuenishi in #278
- Limit the sparse cache size by @kuenishi in #279
Sparse file cache example with multiprocessing would be like:
import os
from pfio.v2 import from_url
with from_url("s3://bucket/your.zip",
local_cache=True, reset_on_fork=True) as fs:
pid = os.fork()
if pid:
os.wait()
else:
with fs.open("file-in-zip.jpg", 'rb') as fp:
data = rp.read()
$ sha1sum dist/pfio-2.3.0rc1*
782f5ef08f08e4de64dac5175b300bce3dd46a38 dist/pfio-2.3.0rc1-py3-none-any.whl
4d21ede0d89f059830d681b74b8c464febd567e4 dist/pfio-2.3.0rc1.tar.gz
Full Changelog: 2.2.0...2.3.0rc1