Remove SOCIETY.StateFuelSites from Internal SGID Only and maintaining AGOL layer

[rkelson]

Summary

• SOCIETY.StateFuelSites:
• opensgid.society.state_fuel_sites:
• https://utah.maps.arcgis.com/home/item.html?id=8d9bc67285fb421fb15d55342148ac1e:

A short summary of the situation.

Migration Guide

A short summary of how users affected by this deprecation can modify their workflows and projects to continue to get similar or improved functionality

It was determined that this layer does not have a lot of value living in the Internal database. However it must persist in AGOL for an application. This way requested updates from the steward can immediately be reflected in the map by editing the AGOL layer directly.

Action items

1. Assign a person who should complete the task by replacing name with their github @name.
2. Check [x] the box when the task is completed and add the date of completion.
3. Strike out all items that do not apply.

Soft Delete

The purpose of the soft delete is to ensure that all of our users and applications have gracefully migrated off of the dataset. Soft deletes will remain in effect for 14 days. During this time, we will have the ability to restore the dataset to its original SGID offering(s). After these 14 days, the item is then ready for a hard delete.

Note: If this dataset is being replaced, then wait until the new data is publicly available before completing these steps:

- [ ] Append "(Mature Support)" to the end of the item title in the SGID.META.AGOLItems table (@rkelson, completed: 2024/00/00)
- [ ] Remove all tags other than "Deprecated" in the SDE metadata (@rkelson, completed: 2024/00/00)

• Add note to SDE description noting when layer will be deleted and any replacement layer (@rkelson, completed: 2024/07/03)
  - [ ] Update the SGID Index row as deprecated by pasting the related Porter issue URL in the "porterUrl" field and setting the value of the "ugrcStatus" field as "removed". Also update the "refreshCycle" field (@rkelson, completed: 2024/00/00)
  - [ ] Change Authoritative field to d in SGID.META.AGOLItems to automatically set the Deprecated AGOL flag. Allow the d to persist through one run of Auditor - currently, Auditor runs daily at 5:00am (@rkelson, completed: 2024/00/00)
• Remove the row from the SGID.META.AGOLItems table. This will trigger the removal of this item in Open SGID (@rkelson, completed: 2024/07/03)
  - [ ] Unshare the item from its SGID group, which will remove it from the SGID on ArcGIS (@jacobdadams, completed: 2024/00/00)
• Check if this layer in the base maps. If so, work with Zach to develop a path forward before you proceed with a Hard Delete (@rkelson, completed: 2024/07/03).

Hard Delete

Target Date: 2024/07/20

Hard deletes are final. It is recommended to complete the soft delete process before moving on to these steps. If you decide to skip the soft delete, note that you will need to incorporate some of those steps here.

• Manually remove data from the Internal SGID (@rkelson, completed: 2024/00/00)
  • Deprecated database layers should be backed up on Google Drive > AGRC Projects > SGID > deprecated layers > internal_db_sgid_layers (@rkelson, completed: 2024/07/03). Created Utah_State_Fuel_Sites_20240620.gdb in the folder above
    - [ ] Remove ArcGIS Online item: (name, completed: 2024/00/00)
    - [ ] Remove Farm from AGOL connection (@stdavis, completed: 2024/00/00)
• Update the SGID Index fields: "arcGisOnline", "openSgid", "openSgidTableName" (@stdavis, completed: 2024/00/00)
• Update relevant gis.utah.gov data pages (@rkelson , completed: 2024/07/09)
  - [ ] Update SGID.META.AGOLItems table (name, completed: 2024/00/00)
  - [ ] Delete Google Drive data (name, completed: 2024/00/00)
• Remove row from SGID.META.ChangeDetection (@stdavis, completed: 2024/00/00)
• Remove data from forklift hashing and receiving (@stdavis, completed: 2024/00/00)
• Remove row from data/hashed/changedetection.gdb/TableHashes (@stdavis, completed: 2024/00/00)

🤖 Automation validation

1. Assign yourself or someone to check the item by replacing name with their github @name.
2. Check [x] the box and add the date of verification 2020/01/01 when the task is verified.
3. Strike out all items that do not apply.

• Remove data from Open SGID (@stdavis on 2024/00/00)
• sgid-index (@steveoh on 2024/00/00)
  - [ ] Auditor sets appropriate shelved/static/Deprecated information (@jacobdadams on 2024/00/00)

Are there service dependencies

• Are clients querying this data with the WebAPI? (@steveoh on 2024/00/00)
• Notify Don Jackson (don.jackson1 at motorolasolutions.com) if the data is in the Next-Generation 911 Motorola Aware Map? (@gregbunce on 2024/06/20)
• Does any other application depend on this data?

Notification

• Twitter (@steveoh)

Group Task Assignments

1. Check [x] the box when you have assigned all the tasks relevant to your group.

• Data Team (@gregbunce)
• Dev Team (@steveoh)
• Cadastre Team (@rkelson)

[rkelson]

This is a bit different than the usual deprecation from Internal as the AGOL item needs to persist after the removal from internal. I am not exactly sure how to accomplish this correctly. Any guidance on the best path forward is appreciated.

[steveoh]

For these types of AGOL only layers, we need to implement a backup strategy in case of data loss.

[rkelson]

Is there a list of similar agol only layers?

[steveoh]

@gregbunce 🔔

[gregbunce]

this is where the stewardship sheet (sgid index tab) as a database would be handy to run a query. one quick thought.

• we could use the stewardship sheet to filter where StorageType in (AGOL, Cloud) and HostedBy = UGRC and ArcGISOnline = true and itemId is not null. or something like that. you get the idea.

Ultimately, that info is in the stewardship sheet (sgid index tab).

@rkelson, i suggest exploring that route. if there are holes, we can work together to alter the sheet so we accommodate these types of questions.

[agrc-conductor]

conductor results for tasks - 325

check	status
@rkelson has completed 5 out of 7 tasks	⛔
@stdavis has completed 0 out of 5 tasks	⛔
@steveoh has completed 0 out of 4 tasks	⛔
@gregbunce has completed 1 out of 2 tasks	⛔

[agrc-conductor]

conductor results for SOCIETY.StateFuelSites

check	status
internal sgid	⛔
meta table	👍
stewardship
- porter issue link	⛔