First pass reprocessing of early mission

[mgalloy]

Process 20130930 through 20131231.

This is needed to do #211. Then the early mission will need to be processed again.

Tasks

• test 20131027 out of production
• test 20131123 out of production
• test 20131101 out of production
• test 20131113 out of production
• test 20131128 out of production
• test 20131210 out of production
• make a release
• produce cals for 20130930-20131231 in production
• reprocess 20130930-20131231 in production
• reprocess 2024 data and check Fix database errors with kcor_hw in 2.1.11 reprocessing #382

[mgalloy]

Test results for 20131027 and 20131123 are in raw.latest.

[jburkepile]

Thanks Mike!
The match is better than I expected since: 1) we got the value of 2.2 from older versions of the pipeline; 2) we are comparing days one solar rotation apart ; 3) the data < Nov 22 are taken at only 0.16 msec exposure and have low signal-to-noise. I compared the pb plots at fixed heights - they are not bad given all the caveats above:

Bottom line - it is worth reprocessing more days to get more comparisons.

Please reprocess:

• Nov 1, 2013
• Nov 13, 2013
• Nov 28, 2013
• Dec 10, 2013

[mgalloy]

By the way, I was able to make a cal file for the first 6 cal epochs (up to 20131123).

[jburkepile]

Mike: Can you send me those dates? There are a number of days in 2013 that do not have valid data due to erroneous info in the fits headers and bad info on location of the calibration hardware in the beam. I need to check that those are good quality calibration data.
Thanks very much!
joan

[mgalloy]

20131027 and 20131123 are fully processed. Other days there are just cals.

[jburkepile]

I am not sure I understand your last comment. Do you mean that you can't process these days: (see my previous comment that contains the plots).
Nov 1, 2013
Nov 13, 2013
Nov 28, 2013
Dec 10, 2013
Thanks for clarifying!

[mgalloy]

I had not seen your comment adding more days to process. I am processing those now, though I have to get a cal file for cal epoch 7 in order to do the last one.

[mgalloy]

@jburkepile All the test days are done now. Results still in raw.latest.

[jburkepile]

Here are the comparisons of Nov 1 and Nov 28 (1 solar rotation apart). The ad hoc camera correction of 2.2 looks okay for these days too:

[mgalloy]

@jburkepile Is that good enough to make a release and reprocess 20130930-20131231 in production?

[jburkepile]

Yes! reprocess 2013.
I have looked at Nov 13 and Dec 10 2013 and they are also a good enough match given all the caveats: