[Bug]: GenericFileException when uploading files to a shared folder #49970
Labels
0. Needs triage
Pending check for reproducibility or if it fits our roadmap
29-feedback
bug
feature: previews and thumbnails
Comments
Narsskrarc
added
0. Needs triage
|
When did this behavior start? (i.e. right after an upgrade? etc.) Does
Do your URLs really have |
|
Run into this error every time I try to upload many files at the same time or a very large file (about 20GB). And the most interesting thing is that the threshold of getting this error is higher when I try to use a faster SSD. For example, I tested on a WD Black P10 HDD and the largest file I could upload was about 8GB, uploading any files larger than this would cause the error. Then I moved the data folder of nextcloud to a Samsung 980 SSD without modifying any config, and now I can upload files around 15GB. Here are the error logs I got, as you can see, there are always two logs items for one failed uploading: {"reqId":"OeVjzytXMCuiExCuOwyz","level":3,"time":"2025-01-01T04:44:03+00:00","remoteAddr":"172.18.0.1","user":"[email protected]","app":"webdav","method":"MOVE","url":"/remote.php/dav/uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","message":"无法打开文件","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36 Edg/131.0.0.0","version":"30.0.4.1","exception":{"Exception":"Sabre\\DAV\\Exception\\ServiceUnavailable","Message":"无法打开文件","Code":0,"Trace":[{"file":"/var/www/html/apps/dav/lib/Upload/AssemblyStream.php","line":273,"function":"get","class":"OCA\\DAV\\Connector\\Sabre\\File","type":"->","args":[]},{"file":"/var/www/html/apps/dav/lib/Upload/AssemblyStream.php","line":143,"function":"getStream","class":"OCA\\DAV\\Upload\\AssemblyStream","type":"->","args":[{"__class__":"OCA\\DAV\\Connector\\Sabre\\File"}]},{"function":"stream_read","class":"OCA\\DAV\\Upload\\AssemblyStream","type":"->","args":[8192]},{"file":"/var/www/html/3rdparty/icewind/streams/src/Wrapper.php","line":55,"function":"fread","args":["*** sensitive parameters replaced ***",8192]},{"file":"/var/www/html/3rdparty/icewind/streams/src/CallbackWrapper.php","line":96,"function":"stream_read","class":"Icewind\\Streams\\Wrapper","type":"->","args":[8192]},{"function":"stream_read","class":"Icewind\\Streams\\CallbackWrapper","type":"->","args":[8192]},{"file":"/var/www/html/lib/private/Files/Storage/Local.php","line":304,"function":"file_put_contents","args":["/var/www/html/data/[email protected]/files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null]},{"file":"/var/www/html/lib/private/Files/Storage/Local.php","line":622,"function":"file_put_contents","class":"OC\\Files\\Storage\\Local","type":"->","args":["files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null]},{"file":"/var/www/html/lib/private/Files/Storage/Wrapper/Wrapper.php","line":629,"function":"writeStream","class":"OC\\Files\\Storage\\Local","type":"->","args":["files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null,null]},{"file":"/var/www/html/lib/private/Files/Storage/Wrapper/Wrapper.php","line":629,"function":"writeStream","class":"OC\\Files\\Storage\\Wrapper\\Wrapper","type":"->","args":["files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null,null]},{"file":"/var/www/html/apps/dav/lib/Connector/Sabre/File.php","line":208,"function":"writeStream","class":"OC\\Files\\Storage\\Wrapper\\Wrapper","type":"->","args":["files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null]},{"file":"/var/www/html/apps/dav/lib/Connector/Sabre/Directory.php","line":110,"function":"put","class":"OCA\\DAV\\Connector\\Sabre\\File","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Tree.php","line":325,"function":"createFile","class":"OCA\\DAV\\Connector\\Sabre\\Directory","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Tree.php","line":151,"function":"copyNode","class":"Sabre\\DAV\\Tree","type":"->","args":[{"__class__":"OCA\\DAV\\Upload\\FutureFile"},{"__class__":"OCA\\DAV\\Connector\\Sabre\\Directory"},"*** sensitive parameters replaced ***"]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Tree.php","line":181,"function":"copy","class":"Sabre\\DAV\\Tree","type":"->","args":["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]},{"file":"/var/www/html/apps/dav/lib/Upload/ChunkingPlugin.php","line":76,"function":"move","class":"Sabre\\DAV\\Tree","type":"->","args":["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]},{"file":"/var/www/html/apps/dav/lib/Upload/ChunkingPlugin.php","line":58,"function":"performMove","class":"OCA\\DAV\\Upload\\ChunkingPlugin","type":"->","args":["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]},{"file":"/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php","line":89,"function":"beforeMove","class":"OCA\\DAV\\Upload\\ChunkingPlugin","type":"->","args":["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/CorePlugin.php","line":603,"function":"emit","class":"Sabre\\DAV\\Server","type":"->","args":["beforeMove",["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]]},{"file":"/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php","line":89,"function":"httpMove","class":"Sabre\\DAV\\CorePlugin","type":"->","args":[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php","line":472,"function":"emit","class":"Sabre\\DAV\\Server","type":"->","args":["method:MOVE",[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]]},{"file":"/var/www/html/apps/dav/lib/Connector/Sabre/Server.php","line":43,"function":"invokeMethod","class":"Sabre\\DAV\\Server","type":"->","args":[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"/var/www/html/apps/dav/lib/Server.php","line":371,"function":"start","class":"OCA\\DAV\\Connector\\Sabre\\Server","type":"->","args":[]},{"file":"/var/www/html/apps/dav/appinfo/v2/remote.php","line":19,"function":"exec","class":"OCA\\DAV\\Server","type":"->","args":[]},{"file":"/var/www/html/remote.php","line":146,"args":["/var/www/html/apps/dav/appinfo/v2/remote.php"],"function":"require_once"}],"File":"/var/www/html/apps/dav/lib/Connector/Sabre/File.php","Line":463,"message":"无法打开文件","exception":[],"CustomMessage":"无法打开文件"},"id":"677874f5900a0"}{"reqId":"OeVjzytXMCuiExCuOwyz","level":3,"time":"2025-01-01T04:44:02+00:00","remoteAddr":"172.18.0.1","user":"[email protected]","app":"no app in context","method":"MOVE","url":"/remote.php/dav/uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","message":"无法打开文件","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36 Edg/131.0.0.0","version":"30.0.4.1","exception":{"Exception":"Sabre\\DAV\\Exception\\ServiceUnavailable","Message":"无法打开文件","Code":0,"Trace":[{"file":"/var/www/html/apps/dav/lib/Upload/AssemblyStream.php","line":273,"function":"get","class":"OCA\\DAV\\Connector\\Sabre\\File","type":"->","args":[]},{"file":"/var/www/html/apps/dav/lib/Upload/AssemblyStream.php","line":143,"function":"getStream","class":"OCA\\DAV\\Upload\\AssemblyStream","type":"->","args":[{"__class__":"OCA\\DAV\\Connector\\Sabre\\File"}]},{"function":"stream_read","class":"OCA\\DAV\\Upload\\AssemblyStream","type":"->","args":[8192]},{"file":"/var/www/html/3rdparty/icewind/streams/src/Wrapper.php","line":55,"function":"fread","args":["*** sensitive parameters replaced ***",8192]},{"file":"/var/www/html/3rdparty/icewind/streams/src/CallbackWrapper.php","line":96,"function":"stream_read","class":"Icewind\\Streams\\Wrapper","type":"->","args":[8192]},{"function":"stream_read","class":"Icewind\\Streams\\CallbackWrapper","type":"->","args":[8192]},{"file":"/var/www/html/lib/private/Files/Storage/Local.php","line":304,"function":"file_put_contents","args":["/var/www/html/data/[email protected]/files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null]},{"file":"/var/www/html/lib/private/Files/Storage/Local.php","line":622,"function":"file_put_contents","class":"OC\\Files\\Storage\\Local","type":"->","args":["files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null]},{"file":"/var/www/html/lib/private/Files/Storage/Wrapper/Wrapper.php","line":629,"function":"writeStream","class":"OC\\Files\\Storage\\Local","type":"->","args":["files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null,null]},{"file":"/var/www/html/lib/private/Files/Storage/Wrapper/Wrapper.php","line":629,"function":"writeStream","class":"OC\\Files\\Storage\\Wrapper\\Wrapper","type":"->","args":["files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null,null]},{"file":"/var/www/html/apps/dav/lib/Connector/Sabre/File.php","line":208,"function":"writeStream","class":"OC\\Files\\Storage\\Wrapper\\Wrapper","type":"->","args":["files/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv.ocTransferId302765613.part",null]},{"file":"/var/www/html/apps/dav/lib/Connector/Sabre/Directory.php","line":110,"function":"put","class":"OCA\\DAV\\Connector\\Sabre\\File","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Tree.php","line":325,"function":"createFile","class":"OCA\\DAV\\Connector\\Sabre\\Directory","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Tree.php","line":151,"function":"copyNode","class":"Sabre\\DAV\\Tree","type":"->","args":[{"__class__":"OCA\\DAV\\Upload\\FutureFile"},{"__class__":"OCA\\DAV\\Connector\\Sabre\\Directory"},"*** sensitive parameters replaced ***"]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Tree.php","line":181,"function":"copy","class":"Sabre\\DAV\\Tree","type":"->","args":["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]},{"file":"/var/www/html/apps/dav/lib/Upload/ChunkingPlugin.php","line":76,"function":"move","class":"Sabre\\DAV\\Tree","type":"->","args":["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]},{"file":"/var/www/html/apps/dav/lib/Upload/ChunkingPlugin.php","line":58,"function":"performMove","class":"OCA\\DAV\\Upload\\ChunkingPlugin","type":"->","args":["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]},{"file":"/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php","line":89,"function":"beforeMove","class":"OCA\\DAV\\Upload\\ChunkingPlugin","type":"->","args":["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/CorePlugin.php","line":603,"function":"emit","class":"Sabre\\DAV\\Server","type":"->","args":["beforeMove",["uploads/[email protected]/web-file-upload-2a0d23544ae7749b/.file","files/[email protected]/Movies/The Twilight Samurai/The.Twilight.Samurai.2002.1080p.BluRay.x264.DTS-WiKi.mkv"]]},{"file":"/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php","line":89,"function":"httpMove","class":"Sabre\\DAV\\CorePlugin","type":"->","args":[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php","line":472,"function":"emit","class":"Sabre\\DAV\\Server","type":"->","args":["method:MOVE",[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]]},{"file":"/var/www/html/apps/dav/lib/Connector/Sabre/Server.php","line":43,"function":"invokeMethod","class":"Sabre\\DAV\\Server","type":"->","args":[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"/var/www/html/apps/dav/lib/Server.php","line":371,"function":"start","class":"OCA\\DAV\\Connector\\Sabre\\Server","type":"->","args":[]},{"file":"/var/www/html/apps/dav/appinfo/v2/remote.php","line":19,"function":"exec","class":"OCA\\DAV\\Server","type":"->","args":[]},{"file":"/var/www/html/remote.php","line":146,"args":["/var/www/html/apps/dav/appinfo/v2/remote.php"],"function":"require_once"}],"File":"/var/www/html/apps/dav/lib/Connector/Sabre/File.php","Line":463,"message":"无法打开文件","exception":[],"CustomMessage":"无法打开文件"},"id":"677874f59030c"}
Here's one extra clue: I monitored the "Time Spent Doing I/Os" chart on my grafana, and found there's a huge disk reading peak after receiving the file chunks. |
|
|
I saw just now, that the log entries are not generated when uploading, but when opening a folder with pictures in Files, but not for each picture. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Bug description
When uploading a bunch of pictures to a shared folder, there were a lot of "An unknown error has occurred" errors. In the logs, I see GenericFileExceptions (from App "Index") and corresponding PHP errors ("Failed to open stream: No such file or directory", see below).
Steps to reproduce
Expected behavior
no error should occur
Nextcloud Server version
29
Operating system
Other
PHP engine version
PHP 8.2
Web server
Apache (supported)
Database engine version
PostgreSQL
Is this bug present after an update or on a fresh install?
None
Are you using the Nextcloud Server Encryption module?
Encryption is Disabled
What user-backends are you using?
Configuration report
{ "system": { "htaccess.RewriteBase": "\/", "memcache.local": "\\OC\\Memcache\\APCu", "apps_paths": [ { "path": "\/var\/www\/html\/apps", "url": "\/apps", "writable": false }, { "path": "\/var\/www\/html\/custom_apps", "url": "\/custom_apps", "writable": true } ], "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "localhost", "akki", "akki.fin.earth", "192.168.200.9", "creideiki.homelinux.net", "cloud.helmut-bender.de" ], "trusted_proxies": "***REMOVED SENSITIVE VALUE***", "datadirectory": "***REMOVED SENSITIVE VALUE***", "dbtype": "pgsql", "version": "29.0.10.1", "overwrite.cli.url": "https:\/\/cloud.helmut-bender.de", "overwritehost": "cloud.helmut-bender.de", "overwritewebroot": "\/", "overwriteprotocol": "https", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "default_phone_region": "DE", "installed": true, "instanceid": "***REMOVED SENSITIVE VALUE***", "maintenance": false, "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_smtpmode": "smtp", "mail_sendmailmode": "smtp", "mail_domain": "***REMOVED SENSITIVE VALUE***", "mail_smtpauth": 1, "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "587", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "mail_smtpauthtype": "PLAIN", "loglevel": 0, "mail_smtpsecure": "tls", "memcache.distributed": "\\OC\\Memcache\\Redis", "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "password": "***REMOVED SENSITIVE VALUE***", "port": 6379 }, "theme": "", "app_install_overwrite": [ "maps" ], "maintenance_window_start": 23, "upgrade.disable-web": true } }List of activated Apps
Nextcloud Signing status
Nextcloud Logs
{"reqId":"eKhJe8j51sFuomAOD60J","level":3,"time":"2024-12-25T10:26:35+00:00","remoteAddr":"91.89.167.224","user":"hab","app":"index","method":"GET","url":"/index.phpiew?fileId=46219&x=250&y=250","message":"Exception thrown: OCP\\Files\\GenericFileException","userAgent":"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:133.0) Gecko/20100101 Firefox/133.0","version":"29.0.10.1","exception":{"Exception":"OCP\\Files\\GenericFileException","Message":"","Code":0,"Trace":[{"file":"/var/www/html/lib/private/Files/SimpleFS/SimpleFile.php","line":74,"function":"getContent","class":"OC\\Files\\Node\\File","type":"->","args":[]},{"file":"/var/www/html/lib/public/AppFramework/Http/FileDisplayResponse.php","line":70,"function":"getContent","class":"OC\\Files\\SimpleFS\\SimpleFile","type":"->","args":[]},{"file":"/var/www/html/lib/private/AppFramework/App.php","line":241,"function":"callback","class":"OCP\\AppFramework\\Http\\FileDisplayResponse","type":"->","args":[{"__class__":"OC\\AppFramework\\Http\\Output"}]},{"file":"/var/www/html/lib/private/Route/Router.php","line":331,"function":"main","class":"OC\\AppFramework\\App","type":"::","args":["OC\\Core\\Controller\\PreviewController","getPreviewByFileId",{"__class__":"OC\\AppFramework\\DependencyInjection\\DIContainer"},{"_route":"core.preview.getpreviewbyfileid"}]},{"file":"/var/www/html/lib/base.php","line":1060,"function":"match","class":"OC\\Route\\Router","type":"->","args":["/core/preview"]},{"file":"/var/www/html/index.php","line":49,"function":"handleRequest","class":"OC","type":"::","args":[]}],"File":"/var/www/html/lib/private/Files/Node/File.php","Line":56,"message":"","exception":[],"CustomMessage":"Exception thrown: OCP\\Files\\GenericFileException"},"id":"676bddf69c419"} {"reqId":"eKhJe8j51sFuomAOD60J","level":3,"time":"2024-12-25T10:26:35+00:00","remoteAddr":"91.89.167.224","user":"hab","app":"PHP","method":"GET","url":"/index.phpiew?fileId=46219&x=250&y=250","message":"file_get_contents(/var/www/html/data/appdata_ocwflvc6mxkf/preview/b/b/f/9/6/d/e/46219/256-256-crop.png): Failed to open stream: No such file or directory at /var/www/html/lib/private/Files/Storage/Local.php#331","userAgent":"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:133.0) Gecko/20100101 Firefox/133.0","version":"29.0.10.1","data":{"app":"PHP"},"id":"676bddf69c427"}Additional info
OS: Docker image (nextcloud:29-apache) on QNAP QTS (Linux 5.10.60-qnap x86_64)
The text was updated successfully, but these errors were encountered: