-
Notifications
You must be signed in to change notification settings - Fork 113
Agency Visualization Requirements
This is part of Task 4 of the Phase 6B work plan.
Stakeholders: Please fill out this survey of the existing tools and workflows in use at your agency. We are interested in how you manage your model runs, what tools you use when analyze the results of those runs, and what capabilities you particularly like or particularly feel are missing/need improvement.
After your agency has filled out the document, we will follow up with each of you for a brief interview or "show and tell" so we can better understand what is working and what is missing.
Please consider the use cases mentioned in the task order when you are answering:
- Organize/access model results
- Model debugging
- Calibration/validation
- Project analysis
- Scenario comparisons
- Results presentation
This is all going into one Wiki document so you can all see each other's responses: but PLEASE only edit the section for your own agency! Thanks! ✨
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
MWCOG currently manages model run inputs and outputs in file folders. The ActivitySim-based Gen3 Model that is currently under development will likely adopt this system. Cube does provide a scenario manager but MWCOG staff intentionally do not use it because of the added complexities.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
Currently, MWCOG mainly uses ArcGIS to visualize outputs from our trip-based Gen2 Model. We plan to adopt a R-based ABM Visualizer developed by RSG for the ActivitySim-based Gen3 Model.
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
Gen3 Model is currently at the Phase 1 Model Deployment stage. We will further evaluate ABM Visualizer when we gain more hands-on experiences with the model and the visualization tool.
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
ABM Visualizer was mainly designed for internal use. We are interested in visualization tools that can convey model outputs (e.g., outputs from a race-related equity analysis) in less technical and more straightforward terms to the Board or the public.
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!
1. Run management. How do you currently manage model run inputs and outputs? Think about the different contexts such as model development, calibration/validation, and project-based model application work.
2. Visualization now: which tools do you currently use for visualizing model outputs? Do you have proprietary packages, agency-written scripts/tools, etc. Is any of it web-based?
3. Analysis needs: what do you feel is currently missing from your analyst visualization toolkit? Are there things you can't do at all that you need? Are there things you can do, but they are onerous or annoying or difficult?
4. Outward facing visualization: Stepping away from an internal analyst role and thinking about outward presentation, what would you need to help convey model outputs? What tools do you use to get from model outputs to Board, TRB presentations, and to the public?
5. At your agency, is a common viz toolkit something that would be added on top of existing tools that you already love, or more likely to be something that replaces existing workflows (if any)? We ask because the task clearly states that the consortium will coalesce around a common set of tools, and that will require changes for all of you!