Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Persistence Configs for Run 7 #22

Merged
merged 4 commits into from
Aug 28, 2024
Merged

Persistence Configs for Run 7 #22

merged 4 commits into from
Aug 28, 2024

Conversation

jbanovetz
Copy link
Contributor

Three different Persistence Tests for Run 7. I wasn't able to run Seth's timing code, though I am also not sure if it is set up for the new DARKINTERRUPT or DARKINTERRUPTLIST, which I rely on for these config files.

@jbanovetz jbanovetz self-assigned this Aug 27, 2024
Copy link
Contributor

@jchiang87 jchiang87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The github actions CI check runs Seth's script as a syntax checker, so you don't need to do that.

I requested a number of changes, the key one being to update the FILTERCONFIG values in all three files.

I'm curious why a flat acquisition is used for Persistence_large.cfg, but sflat for the other two.

Comment on lines 4 to 22
[ANALYZE]
#bias # standalone, build bias Frame
#noise # needs dark
#biasnoise # needs bias (noise & noise correlations)
#dark # needs dark
#badpixel # needs dark, sflat
#ptc # needs flatpair
#brighterfatter # needs flatpair
#overscan # needs flatpair
#linearity # needs flat
#fullwell # needs flat
#cti # needs sflat
#tearing # needs sflat
#persistence # needs persistence
#scan # needs scan

[ANALYSIS_RUNS]
# if only doing a portion of the ACQUIRE, use prior run for GAIN, DARK, BADPIXEL
#GAIN=curated_amp_gains_2020-09-16.json # get GAIN from this file
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you can just delete the [ANALYZE] and [ANALYSIS_RUNS] sections.

WL =red # wavelength filter to use for the flats
HILIM =15.0 # maximum seconds for a flat field exposure
LOLIM =0 # minimum seconds for a flat field exposure
FILTERCONFIG = /gpfs/slac/lsst/fs2/u1/devel/ccs/bot-eotest-configs/Run6/calib.cfg
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update this path to

FILTERCONFIG = /home/ccs/bot-eotest-configs/Run7/calib.cfg

LOLIM =0 # minimum seconds for a flat field exposure
FILTERCONFIG = /gpfs/slac/lsst/fs2/u1/devel/ccs/bot-eotest-configs/Run6/calib.cfg

FLAT=15 90000, # number of electrons/pixel, ND filter
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment, # number of electrons/pixel, ND filter, looks wrong.

15 170000,
15 180000,
15 190000,
15 200000,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a final \n (newline) to this file?

DARKINTERRUPT = True # If True, will take darks between flat images
DARKINTERRUPTLIST = 15 5 # integration time and image count for dark set, formatted the same as the DARK acquisition
SHUTTER = OPEN # Shutter opens at start of acqusition, closes at end
FILTERCONFIG = /gpfs/slac/lsst/fs2/u1/devel/ccs/bot-eotest-configs/Run6/calib.cfg
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs to be updated.

DARKINTERRUPT = True # If True, will take darks between flat images
DARKINTERRUPTLIST = 15 5 # integration time and image count for dark set, formatted the same as the DARK acquisition
SHUTTER = OPEN # Shutter opens at start of acqusition, closes at end
FILTERCONFIG = /gpfs/slac/lsst/fs2/u1/devel/ccs/bot-eotest-configs/Run6/calib.cfg
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update.

red 105000 1, # wavelength filter, signal(e-), count
red 110000 1, # wavelength filter, signal(e-), count
red 115000 1, # wavelength filter, signal(e-), count
red 120000 1, # wavelength filter, signal(e-), count
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add a newline.

@jbanovetz
Copy link
Contributor Author

Thank you for looking at it, I will make those changes.

I'm curious why a flat acquisition is used for Persistence_large.cfg, but sflat for the other two.

For this one, I wanted two flats taken at the same flux level so that I could average them to beat down any read or shot noise. I could change it to sflats and just copy every flux level X number of times (maybe 3) if that would help with processing.

Copy link
Contributor

@jchiang87 jchiang87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm.

@jbanovetz
Copy link
Contributor Author

Looking at the output of Seth's code I don't think that it is picking up the DARKINTERRUPT command as the Persistence_large.cfg is only taking ~25 minutes right now and it should have 8, 15 second darks between flat images (rough estimate would be around 205 mintues). I think the configs are good to go but we might want to change that timing script at some point.

@jchiang87
Copy link
Contributor

sure, I don't think the point was to get the timing results though, but rather to do simple syntax checking of the file.

@seanmacb
Copy link
Contributor

Reference for changes

@jbanovetz
Copy link
Contributor Author

jbanovetz commented Aug 28, 2024

After some discussion in Aaron's weekly meeting, I changed the Large and Short configs to match what he was thinking. This included changing the Large config to sflats and it should be about 4 hours.

@sethdigel
Copy link
Contributor

I'd recommend removing the comma at the end of the last line of lists of flats/sflats. I recall that fp_srcipts does not like it.

@jbanovetz
Copy link
Contributor Author

Removed the commas and will now merge

@jbanovetz jbanovetz closed this Aug 28, 2024
@jbanovetz jbanovetz reopened this Aug 28, 2024
@jbanovetz jbanovetz merged commit 391262c into master Aug 28, 2024
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants