-
Notifications
You must be signed in to change notification settings - Fork 1.6k
Commit 76f8591
Update TFDS to 4.4.0
**API**:
* Add [`PartialDecoding` support](https://www.tensorflow.org/datasets/decode#only_decode_a_sub-set_of_the_features), to decode only a subset of the features (for performances)
* Catalog now expose links to [KnowYourData visualisations](https://knowyourdata-tfds.withgoogle.com/)
* `tfds.as_numpy` supports datasets with `None`
* Dataset generated with `disable_shuffling=True` are now read in generation order.
* Loading datasets from files now supports custom `tfds.features.FeatureConnector`
* `tfds.testing.mock_data` now supports
* non-scalar tensors supports `tf.string`
* `builder_from_files` supports and path-based community datasets
* File format automatically restored (for datasets generated with `tfds.builder(..., file_format=)`).
* Many new reinforcement learning datasets
* Various bug fixes and internal improvements like:
* Dynamically set number of worker thread during extraction
* Update progression bar during download even if downloads are cached
**Dataset creation:**
* Add `LabeledImage` for semantic segmentation (like image but with additional `info.features['image_label'].name` label metadata)
* Add float support for `tfds.features.Image`
* All FeatureConnector can now have a `None` dimension anywhere (previously restricted to the first position).
* `tfds.features.Tensor()` can have arbitrary number of dynamic dimension (`Tensor(..., shape=(None, None, 3, None)`))
* `tfds.features.Tensor` can now be serialised as bytes, instead of float/int values (to allow better compression): `Tensor(..., encoding='zlib')`
* Add script to add TFDS metadata files to existing TF-record (see [doc](https://www.tensorflow.org/datasets/external_tfrecord)).
* New guide on [common implementation gotchas](https://www.tensorflow.org/datasets/common_gotchas)
PiperOrigin-RevId: 3873221361 parent 8404e82 commit 76f8591Copy full SHA for 76f8591
File tree
Expand file treeCollapse file tree
3 files changed
+419
-68
lines changedOpen diff view settings
Filter options
- tensorflow_datasets
Expand file treeCollapse file tree
3 files changed
+419
-68
lines changedOpen diff view settings
0 commit comments