Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MaxQuant: append error log files to stderr #575

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

bernt-matthias
Copy link
Collaborator

MaxQuant's error output seems pretty useless for users and admins:

E.g.

Unhandled Exception:
System.Exception: Exception during execution of external process: 27929
  at BaseLibS.Util.WorkDispatcher.ProcessSingleRunExternalProcess (System.Int32 taskIndex, System.Int32 threadIndex) [0x001a1] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at BaseLibS.Util.WorkDispatcher.DoWork (System.Int32 taskIndex, System.Int32 threadIndex) [0x0001e] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at BaseLibS.Util.WorkDispatcher.Work (System.Object threadIndex) [0x00054] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at System.Threading.ThreadHelper.ThreadStart_Context (System.Object state) [0x00025] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.RunInternal (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state, System.Boolean preserveSyncCtx) [0x00071] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.Run (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state, System.Boolean preserveSyncCtx) [0x00000] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.Run (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state) [0x0002b] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ThreadHelper.ThreadStart (System.Object obj) [0x0000f] in <7cd4deb8302a478d9d393f24754841da>:0
[ERROR] FATAL UNHANDLED EXCEPTION: System.Exception: Exception during execution of external process: 27929
  at BaseLibS.Util.WorkDispatcher.ProcessSingleRunExternalProcess (System.Int32 taskIndex, System.Int32 threadIndex) [0x001a1] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at BaseLibS.Util.WorkDispatcher.DoWork (System.Int32 taskIndex, System.Int32 threadIndex) [0x0001e] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at BaseLibS.Util.WorkDispatcher.Work (System.Object threadIndex) [0x00054] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at System.Threading.ThreadHelper.ThreadStart_Context (System.Object state) [0x00025] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.RunInternal (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state, System.Boolean preserveSyncCtx) [0x00071] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.Run (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state, System.Boolean preserveSyncCtx) [0x00000] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.Run (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state) [0x0002b] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ThreadHelper.ThreadStart (System.Object obj) [0x0000f] in <7cd4deb8302a478d9d393f24754841da>:0

But there are error file in combined/proc/ which contain more info, e.g.

id	0
start	15/03/2021 13:22:03
title	Testing_raw_files (4/6)
description	/gpfs1/work/songalax/galaxy/database/jobs_directory/000/107/107504/working/2016-04-05_NJ_Groundwater_5_1.raw.thermo.raw
error	/gpfs1/work/songalax/galaxy/database/jobs_directory/000/107/107504/working/2016-04-05_NJ_Groundwater_5_1.raw.thermo.raw_The file '/gpfs1/work/songalax/galaxy/database/jobs_directory/000/107/107504/working/2016-04-05_NJ_Groundwater_5_1.raw.thermo.raw' appears to be corrupt. Try to open it with vendor software. Error message: RunHeaderEx_  at MaxQuantPLibS.Basic.MaxQuantTasks.TestFile (System.Int32 taskIndex, System.String mqparFile) [0x00080] in <e0d3ea923fb542858289d68af3ae5a27>:0 _  at MaxQuantPLibS.Work.RawFileTester.Calculation (System.String[] args, BaseLibS.Util.Responder responder) [0x00009] in <e0d3ea923fb542858289d68af3ae5a27>:0 _  at MaxQuantPLibS.Work.MaxQuantWorkDispatcherUtil.PerformTask (System.Int32 taskType, System.String[] args, BaseLibS.Util.Responder responder) [0x00007] in <e0d3ea923fb542858289d68af3ae5a27>:0 _  at MaxQuantTask.Program.Function (System.String[] args, BaseLibS.Util.Responder responder) [0x00012] in <a9a7ab44566440088bf38b1365d644dc>:0 _  at Utils.Util.ExternalProcess.Run (System.String[] args, System.Boolean debug) [0x000af] in <13cd68fb3f5d4831b26fc0f070437c6f>:0
end	15/03/2021 13:22:04

Which contains the slightly more useful message: 2016-04-05_NJ_Groundwater_5_1.raw.thermo.raw' appears to be corrupt. Try to open it with vendor software.

While this might still overwhelm end users its certainly useful for
admins (and they do not need to remember where the error are kept for
MaxQuant)

TODO:

  • does someone has raw files for testing?

MaxQuant's error output seems pretty useless for users and admins:

E.g.

```
Unhandled Exception:
System.Exception: Exception during execution of external process: 27929
  at BaseLibS.Util.WorkDispatcher.ProcessSingleRunExternalProcess (System.Int32 taskIndex, System.Int32 threadIndex) [0x001a1] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at BaseLibS.Util.WorkDispatcher.DoWork (System.Int32 taskIndex, System.Int32 threadIndex) [0x0001e] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at BaseLibS.Util.WorkDispatcher.Work (System.Object threadIndex) [0x00054] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at System.Threading.ThreadHelper.ThreadStart_Context (System.Object state) [0x00025] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.RunInternal (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state, System.Boolean preserveSyncCtx) [0x00071] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.Run (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state, System.Boolean preserveSyncCtx) [0x00000] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.Run (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state) [0x0002b] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ThreadHelper.ThreadStart (System.Object obj) [0x0000f] in <7cd4deb8302a478d9d393f24754841da>:0
[ERROR] FATAL UNHANDLED EXCEPTION: System.Exception: Exception during execution of external process: 27929
  at BaseLibS.Util.WorkDispatcher.ProcessSingleRunExternalProcess (System.Int32 taskIndex, System.Int32 threadIndex) [0x001a1] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at BaseLibS.Util.WorkDispatcher.DoWork (System.Int32 taskIndex, System.Int32 threadIndex) [0x0001e] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at BaseLibS.Util.WorkDispatcher.Work (System.Object threadIndex) [0x00054] in <3fc1eb7cc45041de8ce7f41aa00f3311>:0
  at System.Threading.ThreadHelper.ThreadStart_Context (System.Object state) [0x00025] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.RunInternal (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state, System.Boolean preserveSyncCtx) [0x00071] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.Run (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state, System.Boolean preserveSyncCtx) [0x00000] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ExecutionContext.Run (System.Threading.ExecutionContext executionContext, System.Threading.ContextCallback callback, System.Object state) [0x0002b] in <7cd4deb8302a478d9d393f24754841da>:0
  at System.Threading.ThreadHelper.ThreadStart (System.Object obj) [0x0000f] in <7cd4deb8302a478d9d393f24754841da>:0
```

But there are error file in combined/proc/ which contain more info, e.g.

```
id	0
start	15/03/2021 13:22:03
title	Testing_raw_files (4/6)
description	/gpfs1/work/songalax/galaxy/database/jobs_directory/000/107/107504/working/2016-04-05_NJ_Groundwater_5_1.raw.thermo.raw
error	/gpfs1/work/songalax/galaxy/database/jobs_directory/000/107/107504/working/2016-04-05_NJ_Groundwater_5_1.raw.thermo.raw_The file '/gpfs1/work/songalax/galaxy/database/jobs_directory/000/107/107504/working/2016-04-05_NJ_Groundwater_5_1.raw.thermo.raw' appears to be corrupt. Try to open it with vendor software. Error message: RunHeaderEx_  at MaxQuantPLibS.Basic.MaxQuantTasks.TestFile (System.Int32 taskIndex, System.String mqparFile) [0x00080] in <e0d3ea923fb542858289d68af3ae5a27>:0 _  at MaxQuantPLibS.Work.RawFileTester.Calculation (System.String[] args, BaseLibS.Util.Responder responder) [0x00009] in <e0d3ea923fb542858289d68af3ae5a27>:0 _  at MaxQuantPLibS.Work.MaxQuantWorkDispatcherUtil.PerformTask (System.Int32 taskType, System.String[] args, BaseLibS.Util.Responder responder) [0x00007] in <e0d3ea923fb542858289d68af3ae5a27>:0 _  at MaxQuantTask.Program.Function (System.String[] args, BaseLibS.Util.Responder responder) [0x00012] in <a9a7ab44566440088bf38b1365d644dc>:0 _  at Utils.Util.ExternalProcess.Run (System.String[] args, System.Boolean debug) [0x000af] in <13cd68fb3f5d4831b26fc0f070437c6f>:0
end	15/03/2021 13:22:04
```

Which contains the slightly more useful message: `2016-04-05_NJ_Groundwater_5_1.raw.thermo.raw' appears to be corrupt. Try to open it with vendor software.`

While this might still overwhelm end users its certainly useful for
admins (and they do not need to remember where the error are kept for
MaxQuant)
@bernt-matthias bernt-matthias mentioned this pull request Mar 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant