macOS Memory leak when transferring large amount of data from WebDAV server

[andtechgroup]

This ticket system is to report bugs and feature requests. For support, visit the help page first.

• If you have trouble connecting to a server or your login credentials are not valid, try to resolve the issue with the assistance of your hosting service provider. Any such ticket will be closed with a resolution of thirdparty.

Describe the bug
When transferring over 100GB of data from the cloud service Sharefile via WebDAV, Cyberduck uses a significant amount of RAM and swap disk. This issue has been observed on multiple Macs, including the Mac mini M2 Pro with 16GB of RAM and the Mac Studio M1 Max with 32GB of RAM.

To Reproduce
Steps to reproduce the behavior:

1. Connect to Webdav server
2. Select files to transfer more than 100 GB. Monitor transfer processes as RAM usage increases exponentially during transfer until the system has no available memory, causing Cyberduck to become unresponsive and require a force quit.

Expected behavior
I don't expect the cache data to be stored in RAM before being downloaded to the destination folder on the disk. (I assume that is what is occurring (?))

Screenshots
I've been limiting my transfers to less than 100GB in order to complete the task of transferring. I've attached a screenshot of a current transfer of 65.7GB of data. The transfer is only 22% complete (14.9GB), but Cyberduck is already using 8.85GB of RAM and over 15GB of swap.

Desktop (please complete the following information):
macOS Sonoma 14.5

Log Files
Please include the log file. You can reach the logging output in Preferences → Connection.

cyberduck.log.zip

Additional context
Using Cyberduck also triggers perpetual indexing for Spotlight on my hard drive, which may be unrelated.

[dkocher]

Possible duplicate for #15510.