# Bug OP-17446 - Performance: Add modal routes to robots.txt

Project: OpenProject
Status: closed
URL: https://community.openproject.org/work_packages/OP-17446

## Open points

_No work packages_

## Details

| Attribute | Value |
| --- | --- |
| Date |  |
| Priority | Medium |
| Module | Modules and project features / Project list |
| Target versions | 16.2.0 |
| Observed in versions |  |
| Sprint | 16.2.0 |
| Backlog bucket |  |
| Bug found in version (deprecated) |  |
| Found in mobile app version |  |
| Follow-up feedback e-mail |  |
| Requires doc change | No |
| Accessibility | No |
| Pull preview |  |
| List |  |
| Labels |  |

## People

| Attribute | Value |
| --- | --- |
| Assignee |  |
| Accountable | OP Dev Polaris Team |
| Product manager |  |
| Developers | Andrej Sandorf |
| Designer |  |
| Ordered by |  |
| Signed off by |  |
| Interest by |  |

## Planning

| Attribute | Value |
| --- | --- |
| Relevance |  |

## Costs

| Attribute | Value |
| --- | --- |
| Votes |  |
| Work |  |
| Labor costs |  |

## Description

### Steps to reproduce

1.  Be a bot
    
2.  Scrape OpenProject
    

### What is the buggy behavior?

*   Several routes are not meant to be scraped
    

### What is the expected behavior?

*   Those routes are forbidden for robots in the robots.txt
    

### **Logs**

`Projects::QueriesController#configure_view_modal`

[https://appsignal.com/openproject-gmbh/sites/673c529383eb67b55471dda2/performance/incidents/26](https://appsignal.com/openproject-gmbh/sites/673c529383eb67b55471dda2/performance/incidents/26)

`ProjectsController#export_list_modal`

[https://appsignal.com/openproject-gmbh/sites/673c529383eb67b55471dda2/performance/incidents/91](https://appsignal.com/openproject-gmbh/sites/673c529383eb67b55471dda2/performance/incidents/91)&nbsp;

### Screenshots and other files

<figure class="image image_resized op-uc-figure" style="width:515px;"><div class="op-uc-figure--content"><img class="op-uc-image" src="/api/v3/attachments/708036/content"></div><figcaption class="op-uc-figure--description">Example of tried scrapes on this routes</figcaption></figure>

### Environment information

**OpenProject installation type**

*   All public-facing OP instances
    

**Browser**

*   [x] Bot

**Operating System**

*   [x] All
