Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gp/feat/multipass make ml map #1035

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Conversation

iparask
Copy link
Member

@iparask iparask commented Nov 20, 2024

This PR brings the multipass capabilities of ML mapmaker to the site pipeline script. It also does some lint changes to increase readability.

Copy link
Contributor

@chervias chervias left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I couldn't run to the end. This are the things I think are broken.

sotodlib/site_pipeline/make_ml_map.py Outdated Show resolved Hide resolved
sotodlib/site_pipeline/make_ml_map.py Outdated Show resolved Hide resolved
sotodlib/site_pipeline/make_ml_map.py Outdated Show resolved Hide resolved
sotodlib/site_pipeline/make_ml_map.py Outdated Show resolved Hide resolved
@iparask iparask requested a review from chervias December 4, 2024 20:44
# And add it to the mapmaker
# FIXME: How to handle multipass here?
with mapmaking.mark(f"add_obs {name}"):
signal_estimate = None if pass_ind == 0 else mapmaker.transeval(name, obs, mapmaker_prev, x_prev)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tested the mapmaker with 2 passes. Once the second pass started, it failed in this line like this

Traceback (most recent call last):
  File "/pscratch/sd/c/chervias/cmbenv-perlmutter-so2/bin/so-site-pipeline", line 8, in <module>
    sys.exit(main())
  File "/pscratch/sd/c/chervias/cmbenv-perlmutter-so2/lib/python3.10/site-packages/sotodlib/site_pipeline/cli.py", line 109, in main
    module.main(**vars(args))
  File "/pscratch/sd/c/chervias/cmbenv-perlmutter-so2/lib/python3.10/site-packages/sotodlib/site_pipeline/make_ml_map.py", line 297, in main
    signal_estimate = None if pass_ind == 0 else mapmaker.transeval(name, obs, mapmaker_prev, x_prev)
  File "/pscratch/sd/c/chervias/cmbenv-perlmutter-so2/lib/python3.10/site-packages/sotodlib/mapmaking/ml_mapmaker.py", line 143, in transeval
    ssig.transeval(id, obs, osig, oval, tod=tod)
  File "/pscratch/sd/c/chervias/cmbenv-perlmutter-so2/lib/python3.10/site-packages/sotodlib/mapmaking/ml_mapmaker.py", line 359, in transeval
    pmap.from_map(dest=tod, signal_map=map, comps=self.comps)
  File "/pscratch/sd/c/chervias/cmbenv-perlmutter-so2/lib/python3.10/site-packages/sotodlib/coords/pmat.py", line 451, in from_map
    proj.from_map(self._prepare_map(signal_map), self._get_asm(), signal=dest, comps=comps)
  File "/pscratch/sd/c/chervias/cmbenv-perlmutter-so2/sotoast2/lib/python3.10/site-packages/so3g/proj/wcs.py", line 679, in from_map
    return super().from_map(src_map, assembly, signal, comps)
  File "/pscratch/sd/c/chervias/cmbenv-perlmutter-so2/sotoast2/lib/python3.10/site-packages/so3g/proj/wcs.py", line 321, in from_map
    signal_out = projeng.from_map(
RuntimeError: Tiling problem (index 11): Projector expects tile but it is missing.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chervias this is the same issue that is holding #947. @mhasself and I have tried to resolve it, but we need to schedule another debug session.

Can you paste the test you run? If we can run we may be able to replace it and see something new compared to my tests.

@iparask iparask requested a review from Helbouha December 12, 2024 15:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants