Skip to content

Releases: apache/opendal

v0.29.1

05 Mar 09:08
v0.29.1
b9dd40f
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.29.0...v0.29.1

v0.29.0

01 Mar 13:02
v0.29.0
8f62f9b
Compare
Choose a tag to compare

Upgrade to v0.29

In v0.29, we introduced [Object Writer][crate::docs::rfcs::rfc_1420_object_writer] to replace existing Multipart related APIs.

Users can now append multiparts bytes into object via:

let mut w = o.writer().await?;
w.write(bs1).await?;
w.write(bs2).await?;
w.close()

Along with this change, we cleaned up a lot of internal structs and traits. Users who used to depend on opendal::raw::io::{input,output} should use opendal::raw::oio instead.

Also, decompress related feature also removed. Users can use async-compression with ObjectReader directly.


What's Changed

New Contributors

Full Changelog: v0.28.0...v0.29.0

v0.28.0

22 Feb 06:38
v0.28.0
f824e98
Compare
Choose a tag to compare

Upgrade to v0.28

In v0.28, we introduced Query Based Metadata. Users can query cached metadata with ObjectMetakey to make sure that OpenDAL always makes the best decision.

- pub async fn metadata(&self) -> Result<ObjectMetadata>;
+ pub async fn metadata(
+        &self,
+        flags: impl Into<FlagSet<ObjectMetakey>>,
+    ) -> Result<Arc<ObjectMetadata>>;

Please visit Object::metadata()'s example for more details.


What's Changed

  • feat: add dashmap support by @PsiACE in #1390
  • RFC-1391: Object Metadataer by @Xuanwo in #1391
  • refactor: Implement query based object metadata cache by @Xuanwo in #1395
  • refactor: Store complete inside bits and add more examples by @Xuanwo in #1397
  • RFC-1398: Query Based Metadata by @Xuanwo in #1398
  • refactor: Trigger panic if users try to visit not fetched metadata by @Xuanwo in #1399
  • refactor: Polish the implement of Query Based Metadata Cache by @Xuanwo in #1400
  • Bump version to 0.28 by @Xuanwo in #1401

Full Changelog: v0.27.2...v0.28.0

v0.27.2

20 Feb 08:19
v0.27.2
adafc83
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.27.1...v0.27.2

v0.27.1

13 Feb 08:08
v0.27.1
c913415
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.27.0...v0.27.1

v0.27.0

11 Feb 07:23
v0.27.0
43541c6
Compare
Choose a tag to compare

Upgrade to v0.27

In v0.27, we refactored our list related logic and added scan support. So make Pager and BlockingPager associated types in Accessor too!

pub trait Accessor: Send + Sync + Debug + Unpin + 'static {
    type Reader: output::Read;
    type BlockingReader: output::BlockingRead;
+    type Pager: output::Page;
+    type BlockingPager: output::BlockingPage;
}

User defined layers

Due to this change, all layers implementation should be changed. If there is not changed over pager, they can by changed like the following:

impl<A: Accessor> LayeredAccessor for MyAccessor<A> {
    type Inner = A;
    type Reader = MyReader<A::Reader>;
    type BlockingReader = MyReader<A::BlockingReader>;
+    type Pager = A::Pager;
+    type BlockingPager = A::BlockingPager;

+    async fn list(&self, path: &str, args: OpList) -> Result<(RpList, Self::Pager)> {
+        self.inner.list(path, args).await
+    }

+    async fn scan(&self, path: &str, args: OpScan) -> Result<(RpScan, Self::Pager)> {
+        self.inner.scan(path, args).await
+    }

+    fn blocking_list(&self, path: &str, args: OpList) -> Result<(RpList, Self::BlockingPager)> {
+        self.inner.blocking_list(path, args)
+    }

+    fn blocking_scan(&self, path: &str, args: OpScan) -> Result<(RpScan, Self::BlockingPager)> {
+        self.inner.blocking_scan(path, args)
+    }
}

Usage of ops

To reduce the understanding overhead, we move all OpXxx into opendal::ops now. User may need to change:

- use opendal::OpWrite;
+ use opendal::ops::OpWrite;

Usage of RetryLayer

backon is the implementation detail of our RetryLayer, so we hide it from our public API. Users of RetryLayer need to change the code like:

- RetryLayer::new(backon::ExponentialBackoff::default())
+ RetryLayer::new()

What's Changed

New Contributors

Full Changelog: v0.26.2...v0.27.0

v0.26.2

07 Feb 06:51
v0.26.2
5d5c651
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.26.1...v0.26.2

v0.26.1

05 Feb 10:18
v0.26.1
48f49bc
Compare
Choose a tag to compare

v0.26.1 - 2023-02-05

Changed

  • refactor: Remove not used layer subdir (#1280)

Docs

  • docs: Add v0.26 upgrade guide (#1276)
  • docs: Add feature sets in services (#1277)
  • docs: Migrate all docs in rustdoc instead (#1281)
  • docs: Fix index page not redirected (#1282)

v0.26.0

04 Feb 10:06
v0.26.0
50c2608
Compare
Choose a tag to compare

Upgrade to v0.26

In v0.26 we have replaced all internal dynamic dispatch usage with static dispatch. With this change, we can ensure that all operations performed inside OpenDAL are zero cost.

Due to this change, we have to refactor the logic of Operator's init logic. In v0.26, we added opendal::Builder trait and opendal::OperatorBuilder. For the first glance, the only change to existing code will be like:

- let op = Operator::new(builder.build()?);
+ let op = Operator::new(builder.build()?).finish();

By adding a finish() call, we will erase all generic types so that Operator can still be easily to used everywhere as before.

Accessor

In v0.26, Accessor has been changed into trait with associated types.

All services need to decalare the types returned as Reader or BlockingReader:

pub trait Accessor: Send + Sync + Debug + Unpin + 'static {
    type Reader: output::Read;
    type BlockingReader: output::BlockingRead;
}

If your service doesn't support read or blocking_read, we can use () to represent an dummy reader:

impl Accessor for MyDummyAccessor {
    type Reader = ();
    type BlockingReader = ();
}

Layer

As described before, OpenDAL prefer to use static dispatch. Layers are required to implement the new Layer and LayeredAccessor trait:

pub trait Layer<A: Accessor> {
    type LayeredAccessor: Accessor;

    fn layer(&self, inner: A) -> Self::LayeredAccessor;
}

#[async_trait]
pub trait LayeredAccessor: Send + Sync + Debug + Unpin + 'static {
    type Inner: Accessor;
    type Reader: output::Read;
    type BlockingReader: output::BlockingRead;
}

LayeredAccessor is a wrapper of Accessor with the typed Innder. All methods that not implemented will be forward to inner instead.

Builder

Since v0.26, we implement opendal::Builder for all services, and services' mod will not be exported.

- use opendal::services::s3::Builder;
+ use opendal::services::S3;

Conclusion

Sorry again for the big changes in this release. It's a big step for OpenDAL to work in more critical systems.


What's Changed

New Contributors

Full Changelog: v0.25.2...v0.26.0

v0.25.2

30 Jan 05:53
v0.25.2
c1f2599
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.25.1...v0.25.2