Skip to content

Processing Page

Kele Kent edited this page Jun 20, 2024 · 9 revisions

The Processing Page is used to gain information from a .raw file or other data file that needs to be processed or has been processed. Processing data files allows for a better understanding of the contents of the MS run. This page contains all data processor nodes installed on MS Connect. It provides the current worker status and their connection information. The last 100 processes are presented, this table can be modified with search parameters to narrow it down to list specific data.

1. Automated Data Processing

When processing data there are two ways to go about doing it. First, after uploading a file this page can be used to select a data processor and run the process. There is an automated processing step that can be activated on the User Settings Page.

2. Data Processing Apps - Shows installed Data Processing Nodes

  1. PD 2.5 processor - Processes the data using PD 2.5 processor tools
  2. DIA NN Processor - Processes the data using DIA NN processor tools
  3. Fragpipe processor - Processes data using Fragpipe Processor

3. Future Processing Methods

  1. Maxquant 2 processor - Generates error 404
  2. PD 3.0 processor - Generates error 404
  3. FragPipe processor prerelease - Generates error 404

4. Current Workers Status

For each processor, a worker is associated. This doesn't require any setup and should work automatically. Each worker is given a number, an IP, and a worker name. The worker IP and worker name are associated with the Proteomics Data Processor. The worker's last job displays the last time that processor was last used and the prosses number of that job.

5. Search Queue - Search parameters can be used to modify the table at the bottom of the page to show more specific data. This can be used to isolate a specific process.

  • Queue Pk - Searches for the process number. The process number is created when the process is started according to when the process was created. This can be used as a range.
  • Contain record - Searches for the record number. The record number is created when the record is uploaded according to what numerical order in the record was added to the system through the raw file uploader. This can be used as a range.
  • Process Name - Based on the Record PK name, usually it is the Record file PK name plus "_QC" added to the end.
  • Process Creator - Once selected, only processes selected by this user will be displayed.
  • QC1 range - Looks at "Output QC Number 1". This can be used as a range.
  • Process apps - Only displays the Processes that were created by the selected process app.
  • Finish time from and finish time up to - Used to set a time range that the process was run.

5A. Using a Range A range is used when looking for a group of records or for narrowing down a search to specific parameters.

It can be used in three different ways. First, parameter to parameter. This is done by first inserting your smaller parameter followed by a hyphen and the bigger parameter.

300-500

Second, is used to search from 0 to the parameter. This is done by inserting a hyphen followed by the parameter.

-500

Third, is used to search from the parameter to infinity. This is done by inserting the parameter.

500

6. Secondary Search

While the parameters above are used for organizing the table to specific details, this search function is used to modify and search through the table itself. To use simply type the text that is on the table into the box. Multiple different lines can be used as long as they are separated by a space. If the space is part of the phrase and is needed in the search, surround the phrase by parentheses.

This is how to search for every record processed on June 1st

"June 1,"

7. Data Processing Queue

shows the last 100 processed records. The last 100 are modified by both the Search Queue and the secondary search function.

Figure 1: The Processing Page when it is first opened up.

image

image

Figure 2: Secondary Search

image

Clone this wiki locally