Skip to content

Commit 76f8591

Browse files
Conchylicultorcopybara-github
authored andcommitted
Update TFDS to 4.4.0
**API**: * Add [`PartialDecoding` support](https://www.tensorflow.org/datasets/decode#only_decode_a_sub-set_of_the_features), to decode only a subset of the features (for performances) * Catalog now expose links to [KnowYourData visualisations](https://knowyourdata-tfds.withgoogle.com/) * `tfds.as_numpy` supports datasets with `None` * Dataset generated with `disable_shuffling=True` are now read in generation order. * Loading datasets from files now supports custom `tfds.features.FeatureConnector` * `tfds.testing.mock_data` now supports * non-scalar tensors supports `tf.string` * `builder_from_files` supports and path-based community datasets * File format automatically restored (for datasets generated with `tfds.builder(..., file_format=)`). * Many new reinforcement learning datasets * Various bug fixes and internal improvements like: * Dynamically set number of worker thread during extraction * Update progression bar during download even if downloads are cached **Dataset creation:** * Add `LabeledImage` for semantic segmentation (like image but with additional `info.features['image_label'].name` label metadata) * Add float support for `tfds.features.Image` * All FeatureConnector can now have a `None` dimension anywhere (previously restricted to the first position). * `tfds.features.Tensor()` can have arbitrary number of dynamic dimension (`Tensor(..., shape=(None, None, 3, None)`)) * `tfds.features.Tensor` can now be serialised as bytes, instead of float/int values (to allow better compression): `Tensor(..., encoding='zlib')` * Add script to add TFDS metadata files to existing TF-record (see [doc](https://www.tensorflow.org/datasets/external_tfrecord)). * New guide on [common implementation gotchas](https://www.tensorflow.org/datasets/common_gotchas) PiperOrigin-RevId: 387322136
1 parent 8404e82 commit 76f8591

File tree

3 files changed

+419
-68
lines changed

3 files changed

+419
-68
lines changed

0 commit comments

Comments
 (0)