Top Menu

Jump to content
Home
    • Projects
    • Work packages
    • News
    • Getting started
    • Introduction video

      Welcome to OpenProject Community

      Get an overview

      Get a quick overview of project management and team collaboration with OpenProject.
      You can restart this video from the help menu

    • Help and support
    • User guides
    • Videos
    • Shortcuts
    • Community forum
    • Professional support

    • Additional resources
    • Data privacy and security policy
    • Digital accessibility (DE)
    • OpenProject website
    • Security alerts / Newsletter
    • OpenProject blog
    • Release notes
    • Report a bug
    • Development roadmap
    • Add and edit translations
    • API documentation
  • Sign in
      Forgot your password?
      Create a new account

      or sign in with your existing account

      Google

Side Menu

  • Overview
  • Activity
  • Roadmap
  • Work packages
  • Calendars
  • Team planners
  • Boards
  • Forums
  • Wiki
    • Table of contents
      • Expanded. Click to collapseCollapsed. Click to showDeveloper
        • Hierarchy leafAccessibility Checklist
        • Hierarchy leafCode Review Guidelines
        • Expanded. Click to collapseCollapsed. Click to showContribution
          • Hierarchy leafGit Workflow
          • Hierarchy leafTranslations
        • Expanded. Click to collapseCollapsed. Click to showDeveloping Plugins
          • Hierarchy leafDeveloping an OmniAuth Authentication Plugin
        • Hierarchy leafRelease Process
        • Hierarchy leafReport a bug
        • Hierarchy leafSecurity
        • Hierarchy leafSetting up an OpenLDAP server for testing
        • Hierarchy leafTheme Features
      • Hierarchy leafDownload
      • Expanded. Click to collapseCollapsed. Click to showFeature tour
        • Hierarchy leafRelease Notes OpenProject 30
        • Expanded. Click to collapseCollapsed. Click to showRelease Notes OpenProject 30 - Overview
          • Hierarchy leafGlossary
          • Hierarchy leafRelease Notes - Accessibility
          • Hierarchy leafRelease Notes - Accessibility changes
          • Hierarchy leafRelease Notes - Add work package queries as menu items to sidebar
          • Hierarchy leafRelease Notes - Copy projects based on Templates
          • Hierarchy leafRelease Notes - Design changes
          • Hierarchy leafRelease Notes - Fixed Bugs
          • Hierarchy leafRelease Notes - Keyboard Shortcuts
          • Hierarchy leafRelease Notes - Project settings
          • Hierarchy leafRelease Notes - Ruby&Rails Update
          • Hierarchy leafRelease Notes - Security
          • Hierarchy leafRelease Notes - Timelines
          • Hierarchy leafRelease Notes - Work packages
      • Hierarchy leafHowto create animated gifs
      • Hierarchy leafMigration Squashing
      • Hierarchy leafMod security
      • Hierarchy leafNew work package page
      • Hierarchy leafOP3 to OP4 Debian upgrade
      • Hierarchy leafOP4 Ubuntu1404 Stable with MySQL in production
      • Hierarchy leafOpenProject 40 Development Setup
      • Expanded. Click to collapseCollapsed. Click to showOpenProject Foundation
        • Hierarchy leafBoards
        • Hierarchy leafMembers
        • Hierarchy leafOPF-Meetings
        • Hierarchy leafStatutes
      • Expanded. Click to collapseCollapsed. Click to showRelease Notes
        • Hierarchy leafOpenProject released on Bitnami
      • Expanded. Click to collapseCollapsed. Click to showRelease Notes OpenProject 40 - Overview
        • Hierarchy leafRelease Notes OpenProject 40 - Accessibility improvements
        • Hierarchy leafRelease Notes OpenProject 40 - Column header functions in work package table
        • Hierarchy leafRelease Notes OpenProject 40 - Improved Design
        • Hierarchy leafRelease Notes OpenProject 40 - Integrated query title on work package page
        • Hierarchy leafRelease Notes OpenProject 40 - Integrated toolbar on work package page
        • Hierarchy leafRelease Notes OpenProject 40 - OmniAuth integration for OpenProject
        • Hierarchy leafRelease Notes OpenProject 40 - Work package details pane
      • Expanded. Click to collapseCollapsed. Click to showSecurity and privacy
        • Hierarchy leafFAQ
      • Expanded. Click to collapseCollapsed. Click to showSupport
        • Expanded. Click to collapseCollapsed. Click to showDownload and Installation
          • Hierarchy leafInstallation MacOS
          • Expanded. Click to collapseCollapsed. Click to showInstallation OpenProject 3 0
            • Hierarchy leafDebian Stable with MySQL in production
            • Hierarchy leafInstallation Ubuntu
            • Hierarchy leafInstallation Windows
            • Hierarchy leafInstallation on Centos 65 x64 with Apache and PostgreSQL 93
          • Expanded. Click to collapseCollapsed. Click to showInstallation OpenProject 40
            • Hierarchy leafOP4 Debian Stable with MySQL in production
          • Expanded. Click to collapseCollapsed. Click to showMigration paths
            • Hierarchy leafFrom Chilliproject to OpenProject
            • Hierarchy leafMigration 15 to 30
            • Hierarchy leafMigration 24 to 30
            • Hierarchy leafMigration Redmine 2x › OpenProject 30
            • Hierarchy leafOpenProject 3 Migration
          • Hierarchy leafOpenProject 40
        • Expanded. Click to collapseCollapsed. Click to showNews
          • Hierarchy leafNew OpenProject Translations Plugin
          • Hierarchy leafNew Plugin on OpenProjectorg Local Avatars
          • Hierarchy leafNew design for OpenProject
          • Hierarchy leafNews Accessibility workshop for OpenProject
          • Hierarchy leafNews Glossary for OpenProject
          • Hierarchy leafNews Heartbleed fixed
          • Hierarchy leafNews Icon Fonts
          • Hierarchy leafNews OpenProject 30 Release
          • Hierarchy leafNews Release GitHub Integration Plugin
          • Hierarchy leafNews Success Story Deutsche Telekom
          • Hierarchy leafNews Timelines
          • Hierarchy leafOpenProject 3013 released
          • Hierarchy leafOpenProject 3017 released
          • Hierarchy leafOpenProject 40 released
          • Hierarchy leafOpenProject 40 will be coming soon
          • Hierarchy leafOpenProject 405 released
          • Hierarchy leafOpenProject and pkgrio
          • Hierarchy leafOpenProject news moved to a new blog
          • Hierarchy leafOpenProjectBitnami
          • Hierarchy leafPackager version with plugins released ("Community edition")
          • Hierarchy leafRegistration OpenProject-Foundation
          • Hierarchy leafRelease OpenProject AuthPlugins
          • Hierarchy leafUpdates on OpenProject
          • Hierarchy leafWe need your feedback for the the new fullscreen view for work packages
        • Hierarchy leafOpenProject Plug-Ins
      • Hierarchy leafWiki
You are here:
  • Forums
  • General discussion

Content

Data Conversion

Added by jason southwell over 8 years ago

Last night I did a conversion of about 10,000 tasks from a home-built task manager system into OpenProject. So far things are going quite well, though I notice moments of sluggishness that weren’t there before when we were only adding in new tasks.

I’ve got to do another conversion merge next week with several thousand tasks from a Mantis system and am a bit worried that performance will suffer again. Has there been any significant testing on data in the 30k-50k Work Package range?


Replies (2)

RE: Data Conversion - Added by Jens Ulferts over 8 years ago

Hi Jason,

that is a really tough question to answer. In fact, without knowing the specifics of your data it is almost impossible to answer it in a satisfying way.

I am aware of an OpenProject Application having 150k issues. Issues, because it is still running on OpenProject 2.4 (Ruby 1.8.7.). This installation is lacking performance in some scenarios. For example, a non admin user having about 200 project memberships is opening a wiki page that has a large amount of references (#, ##) to issues of different projects on it. There are a couple of plugins installed for that installation that decrease performance of authorisation checks. In most use cases however, the performance is still ok.

We expect a significance performance gain when this installation is switched to OpenProject 3.0. as we addressed certain performance problems and are switching to a new application stack (rails, ruby) on top of that.

But whether the characteristics of the data in that installation matches the characteristics of the data you are working with I cannot say. So instead of answering your question I have to counter with a whole bunch of question myself:

  • In which use cases is the application running slower than before?
    • Which page gets called? What data is displayed on the page (one package, a whole package hierarchy)?
    • What kind of user is calling the page (permissions, roles, project memberships)?
  • How many packages are there per project?
  • How are the packages related (related to, follows, blocked by, …) to each other?
  • What kind of tree structure (hierarchy) do the packages form?
    • Single node tree?
    • Maximum number of nodes in a tree?
    • Depth of the tree?
    • Width of the tree?

Please don’t get me wrong. I am not trying to block of your question by asking questions myself. We are very sensitive when it comes to performance and thus depend of feedback from real user experiences. One can try to think of hundreds of ways in which performance can be reduced. Only user feedback shows us which ones we need to address.

Kind regards

Jens

RE: Data Conversion - Added by jason southwell over 8 years ago

I’ll clarify…

I’ve noticed since starting with Open Project, even before the conversion, that there would be stutters of slowness. Things would be moving along fine then all of a sudden a click will take 10 seconds or so to come back. Now after the conversion, those 10 seconds are more like 30 to 50. These do not happen on a regular schedule but when they happen they are very noticeable.

It’s not any particular action, but rather when it happens it happens for all actions and for all users. The system it’s on is responsive though as it’s also running the Postgres server and I can quickly return queries while Open Project is hung up. I don’t know if there is any one page causing the problem but once it starts it affects any page.

We have several projects defined in a tree structure with multiple branches, but most of the tasks are the imported tasks and they are all into one project. In that project they are about 99% of the 10k tasks.

Only about 5% of the packages are related to each other in any way and most of those are related tasks, not parent/child.

As to the environment, I’m on Windows 2008 R2 server, 4GB RAM and Xeon CPU @ 2.4GHz. Drives are just standard SATA 7200 RPM drives. I don’t notice any CPU spikes or memory spikes during the slowdowns.

  • (1 - 2/2)
Loading...