Content
View differences
Updated by Judith Roth 4 months ago
### Before filing a report
_Before you file a report, please ensure you are running the latest version of OpenProject and_
_have searched for similar bug reports._
### Steps to reproduce
_Please write down the steps to reproduce. Try to write down all necessary preconditions (what permissions do you have, are other users involved?). Example:_
1. Configure server with 4GB of RAM and use FOG with AWS S3 for attachment storage. Direct Direct uploads.
2. Upload a large file more than 4GB (such as a video)
### What is the buggy behavior?
_Please describe the bug in as much detail as possible. Example:_
* The server tries to download any direct uploaded files for post processing. This is a stream, so ok.
* The server does post processing.
* The server tries to reupload the file with its content and such modified. This will fail as it tries to put the whole file in mem.
* The job will then repeat at downloading a new file. This will fill all disk space on the server till there is no more space.
* The real bug is that we should have a configurable threshold `LARGE_FILE_THRESHOLD` that can be set so any file over that size doesn't do this download and reupload thing.
### What is the expected behavior?
_Describe how the application should behave like. Example:_
1. Should not crash the job and should not eventually fill the server disk space (/tmp folder).
2. Should not have to download and reupload a large file that it is not going to extract text out of anyway.
### Potential Solution
I was able to write a script and monkey patch the application on bootup. It checks the file size, and if its more than the threshold (50MB in my case) it doesn't try to download/reupload it instead finishes the job. The script is attached here for reference. I make no IP claim. Feel free to use any/all/none as you see fit.
###
Important note
_Please note that unless you are a contributor to OpenProject, you can no longer edit this bug report after saving. You can still add new comments, new images and upload attachments though, but updating description or modifying fields will not be possible after saving. Please make sure that all necessary information and attachments are added, and the following attributes are set:_
###
**Logs**
_Are there errors in the browser console? (_[_Click here for information on how to open your browser's console_](https://webmasters.stackexchange.com/a/77337)_) For a local installation: Are there relevant logs output by_ `_openproject logs_` _(packaged installation) (_[_click here for details_](https://docs.openproject.org/installation-and-operations/operation/monitoring/#show-logs)_) or in a log/production.log or /var/log/openproject/ ? Please attach error output in these log files if applicable_
### Screenshots and other files
_If you have screenshots of the application's bug behavior or other relevant files, please drag them into this place or attach them using the "Files" section._
### Environment information
_Please check and fill out the following details to help us identify in what versions and distributions of OpenProject the error occurs_
**OpenProject installation type**
* Packaged Install on Ubuntu 24.04
**OpenProject version**
_v16.1.1_
**Browser**
* [x] Chrome
* [x] Firefox
* [ ] Safari
* [ ] Mobile Safari
* [ ] Other (please specify)
**Operating System**
* [ ] Windows
* [ ] Mac OS X
* [ ] Mobile iOS
* [ ] Mobile Android
* [x] Linux (please specify distro) Ubuntu
* [ ] Chrome OS
* [ ] Other (please specify)
**Language**
_English_
_Before you file a report, please ensure you are running the latest version of OpenProject and_
_have searched for similar bug reports._
###
2. Upload a large file more than 4GB (such as a video)
### What is the buggy behavior?
* The server does post processing.
* The server tries to reupload the file with its content and such modified. This will fail as it tries to put the whole file in mem.
* The job will then repeat at downloading a new file. This will fill all disk space on the server till there is no more space.
* The real bug is that we should have a configurable threshold `LARGE_FILE_THRESHOLD` that can be set so any file over that size doesn't do this download and reupload thing.
### What is the expected behavior?
2. Should not have to download and reupload a large file that it is not going to extract text out of anyway.
### Potential Solution
I was able to write a script and monkey patch the application on bootup. It checks the file size, and if its more than the threshold (50MB in my case) it doesn't try to download/reupload it instead finishes the job. The script is attached here for reference. I make no IP claim. Feel free to use any/all/none as you see fit.
###
_Please note that unless you are a contributor to OpenProject, you can no longer edit this bug report after saving. You can still add new comments, new images and upload attachments though, but updating description or modifying fields will not be possible after saving. Please make sure that all necessary information and attachments are added, and the following attributes are set:_
_Are there errors in the browser console? (_[_Click here for information on how to open your browser's console_](https://webmasters.stackexchange.com/a/77337)_) For a local installation: Are there relevant logs output by_ `_openproject logs_` _(packaged installation) (_[_click here for details_](https://docs.openproject.org/installation-and-operations/operation/monitoring/#show-logs)_) or in a log/production.log or /var/log/openproject/ ? Please attach error output in these log files if applicable_
_If you have screenshots of the application's bug behavior or other relevant files, please drag them into this place or attach them using the "Files" section._
###
_Please check and fill out the following details to help us identify in what versions and distributions of OpenProject the error occurs_
**OpenProject installation type**
* Packaged Install on Ubuntu 24.04
**OpenProject version**
_v16.1.1_
**Browser**
* [x] Chrome
* [x] Firefox
* [ ] Safari
* [ ] Mobile Safari
* [ ] Other (please specify)
**Operating System**
* [ ] Windows
* [ ] Mac OS X
* [ ] Mobile iOS
* [ ] Mobile Android
* [x] Linux (please specify distro) Ubuntu
* [ ] Chrome OS
* [ ] Other (please specify)
**Language**
_English_