bug: NotEnoughNodeQuotes errors over repeated uploads prevent client uploading

[happybeing]

I'm finding the same issue with Autonomi v0.3.1 as v0.3.0 which I reported on the forum, so opening an issue. I've tried the same set of files uploading from both laptop over mobile broadband hotspot and on VPS.

Essentially I have a script which is repeatedly running my client (awe) to upload a directory of about a dozen files until it succeeds, but it always fails to upload one or more files with this error:

[2024-12-24T17:51:44.627310Z ERROR autonomi::client::data::public 65] Error paying for data: Cost(NotEnoughNodeQuotes(d100a0(11010001).., 1, 5))

The log contains a blend of my client output to terminal and the autonomi log output:
awelog-upload-quicktest.zip

[jacderida]

Thanks for the report.

We seen this issue internally, but we resolved it, or at least thought we had. It doesn't occur any more in our own uploads against the live network.

Probably good to bring this one to the attention of @maqi .

[traktion]

I've had variations of this error many times too. It seems worse on this network over the last.

I've been struggling to upload a full directory of files. Single files seems more reliable.

Iirc, a failure doesn't mean you aren't billed either. It looked like I was paying each retry, the last time I checked.

[jacderida]

We will look into this again. Thanks for the report.

[digryd-niddyr]

I've had variations of this error many times too. It seems worse on this network over the last.

I've been struggling to upload a full directory of files. Single files seems more reliable.

Iirc, a failure doesn't mean you aren't billed either. It looked like I was paying each retry, the last time I checked.

I've been experiencing the same thing. When a failure occurs (due to not enough node quotes) on a directory upload, sometimes I would still be charged attos. I'm guessing this might be due to some of the files in the directory successfully uploading (but no address given due to the error ending the process). It would be nice to be able to resume a directory upload to avoid redundant file uploads.

[sbosshardt]

I'm trying to use ant-cli to interact with the Autonomi network. I wanted to create a vault and couldn't due to "not enough node quotes". I think this could be the same bug.

ant vault cost:
log_2025-02-19_01-31-36.zip

ant vault create:
log_2025-02-19_01-45-54.zip

I don't think it's my fault. Before this, I'd already created a wallet, transferred adequate ETH and ANT to it, and used ant file cost to successfully get an estimate to upload a 3 KB file. That said, I only saw one cost estimate from ant file cost (presumably for ANT, not ETH) - even though the ant-cli README.md says "This returns both the storage costs and gas fees for the file."

[sbosshardt]

Now when I run ant vault cost, it's saying "Vault already exists".

$ ant vault cost
Logging to directory: "/home/sbosshardt/.local/share/autonomi/client/logs/log_2025-02-19_02-25-47"
🔗 Connected to the Network                                                     Getting cost to create a new vault...
Vault already exists, updating an existing vault is free unless the new content exceeds the current vault's paid capacity.

I find this troubling because the last time I ran a vault command, I was told that it did not create properly:

$ ant vault create
Logging to directory: "/home/sbosshardt/.local/share/autonomi/client/logs/log_2025-02-19_01-45-54"
🔗 Connected to the Network                                                     Retrieving local user data...
Pushing to network vault...
Error: 
   0: Vault error: Vault Scratchpad related error: Payment failure occurred during scratchpad creation.
   1: Vault Scratchpad related error: Payment failure occurred during scratchpad creation.
   2: Payment failure occurred during scratchpad creation.
   3: Cost error: NotEnoughNodeQuotes(78a9cd(01111000).., 2, 5)
   4: Not enough node quotes for 78a9cd(01111000).., got: 2 and need at least 5

Location:
   ant-cli/src/commands/vault.rs:41

Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.