Skip to content

Quick Start

kwebber3 edited this page Nov 11, 2022 · 1 revision

Raw file uploader

Raw file uploader is a upload tool to be used with Proteomics Data Manager (https://github.com/xiaofengxie128/Proteomic-Data-Manager) for uploading raw files to the database with metadata. The program is built on C# with .net 4.5.1 (same framework as Thermo Orbitrap Tribride) for Windows platform.

Initial Configuration

First, put in your server location and '/files/api' to the box provided on the Server tab. image

Next, input the login information from your Proteomics Data Manager that you would like to use for this set of uploads. image

Next, verify your login and server information by clicking the 'Verify Account' button. image image

Next, you can send alert emails when the MS has stopped acquiring (for example, due to an error) by putting your email into the 'Alert Recipient Email' and setting the max alert interval to the length of your acquisition method. Additionally, you can set a limit on the number of emails you recieve in a given time. Finally, you can configure the sending email using the 'Config SMTP Server' button and the dialog box. image

Finally, The No Copy mode box should generally NOT be checked because if off busy files will not be uploaded and may cause an error, but if you don't want to make temporary copies before uploading you can check this box. image

To save your settings or load old settings click on the 'File' menu in the top left corner. image

Uploading & Monitoring

First, confirm that the login information matches that of the person who owns the acquisition files (don't forget to verify your information). image image

Select, the file Type in the Files tab image

Then you need to choose the files to upload, by using one of the following three methods (see appendix 1 for anything other than Thermo Raw files)

1.A upload a file

First, browse or type a filename (or files separated by '.'), then click 'manual upload files/folder' image

1.B upload folder based data

First, browse or type a folder location (or add folders separated by '.'), then click 'manual upload files/folder' image

2. upload all files (or subfolders if MS data is stored in folders)

First, browse or type a folder location (or files separated by '.'), then click 'manual upload files/folder'. image

3. monitor a folder for any new data, and automatically upload data

First, maximum and minimum file sizes can be determined on the Settings tab, as well as a pattern in the filename that you don't want uploaded (such as 'blank'). image

Next, select the folder, enter project name (folder name in backup drive), record name (both optional) and hit the monitor button. image

As files are uploaded, they will be reported in the log. image

Appendix 1: Using other file formats

To use other file formats than Thermo Raw, you will not to do some configuration: First select the file type configure in the dropdown. Next the file extension (i.e. raw for thermo raw files and .d for Agilent folders) Next is the Acquisition programs name. This is the program used to make the raw files, raw file uploader waits until this program is done with the file before uploading the file, so that partial files aren't uploaded. image

This can be found by using the 'File_Lock_Checker' in the tools menu. image

Next, you select if it is folder based data, and then how long to delay before upload. Because some acquisition files may not be busy for the whole time after the creation, you may want to set this to the length of the run for some systems. For folder based data, the Final file is the last file created or the file the aquisition program keeps busy or creates to trigger your upload (or wait). image

Appendix 2: Adding metadata

Metadata can either be automatically extracted from the filename or defined manually for each upload image

First, define your column and spe serial numbers and sample type for this upload image

Next, fill in the table (which is split into two) for any information pulled from the file name. For example if your fields are delimited by underscores than a file named mouse_brain.raw, could have metadata extracted by making the first factor name '[0]' and the first factor value "organism" and the second pair '[1]' and "organ". image

Finally upload your data as described above.