CoL of December 2021

[yroskov]

• ITIS of 2021-12-02 is ready for the conversion & import; imported 2021-12-07, but need to be re-done due to the checklistbank maintenance; re-imported 2021-12-09; synced 2021-12-09&10

• 65 WoRMS of 2021-12-01; imported 2021-12-02&03; synced 2021-12-06&07, but probably some need to be re-done due to the checklistbank maintenance; re-synced 2021-12-10

• ReptileDB - new version announced by Peter (email of 2021-11-07); dump received 2021-11-15; imported 2021-11-16; resolved (issues remain); synced 2021-11-16

• World Plants of 2021-11-27 received; 3rd update after ac21; synced 2021-12-01
  New version received 2021-12-06; converted; imported 2021-12-09; synced 2021-12-10

• World Ferns of 2021-11-27 received; 3rd update after ac21; synced 2021-11-29, 2021-12-01
  New version received 2021-12-06;
  New version: ferns_2021-12-08; converted; imported 2021-12-09; synced 2021-12-10

• Pterophoroidea; @dhobern, 2021-11-29: ...my Pterophoroidea dataset has also been updated with seven new species and some other publication/distribution/life history data; synced 2021-12-13

• Scarabs of 2021-12-06; converted; imported 2021-12-08 = lot of new ISSUES - need to be re-imported due to the checklistbank maintenance; re-imported 2021-12-09; synced with remaining issues 2021-12-13
  new version 2021-12-13; imported 2021-12-14; resolved; synced 2021-12-14

• WCVP (in Markus hands; needs to add distribution data in DwC-A = COMPLETED; make references from Nomenclatural Citations) = COMPLETED
  Markus 2021-10-26: data are here: https://urldefense.com/v3/__https://data.dev.catalogueoflife.org/dataset/2182/imports__;!!DZ3fjg!sKiei9ditXWqUT2Rcij9Hy5a5bFX5N2R3Tc68HFcxY49YmW61dJPx0WxyoxAGS8FaYc$
  Issues: WCVP on DEV #175
  Import to the PROD: 2021-11-30 (failed?); 2021-12-03 (completed, WCVP (id 2232): test report #177)

• StaphBase - request for a new version sent; data received 2021-10-21; converting in TW

• Global Gracillariidae might be available in CoLDP; eml from Chantal/François Malherbe of 2021-11-12; first draft on DEV

Other 11 GSDs for updates: https://docs.google.com/spreadsheets/d/1WRxfYQF8h2Xiu3gNUvQ3de-zRH-BSq3wYWIAbHHBrhY/edit?usp=sharing

[yroskov]

Critical issues:

• Geoff's name in the reference
• Questionable title "Catalogue of Life Checklist". "Catalogue" and "Checklist" in the same phrase is a nonsense. Which title is registered with ISSN? The title must be consistent with the registered one.
• Paragraph Acknowledgements should not be a list of "creators"/authors

[yroskov]

World Plants supposed to be synced 2021-12-01.

2021-12-02: Lot of WP sectors still have a status "waiting", one - "cancelled". No processes running. What does it mean?

CatalogueOfLife/backend#1079

[yroskov]

Woops! 2021-12-07, 13.20: The system is under maintenance - please expect errors.

2021-12-07, 9.30: The system is under maintenance - please expect errors.

2021-12-09, 10.15: The system is under maintenance - please expect errors.

@gdower, as we discussed, we probably need to re-do ITIS & Scarabs import and WoRMS syncs (what is about WPlants & WFerns?) after clb will be back to normal. (...The ITIS import process isn't showing at all even though it uploaded). See also CatalogueOfLife/backend#1079 (comment)

2021-12-09, 12.00: @gdower, it looks like clb is back to normal now (no warning message anymore). I guess, we can re-do postponed jobs from now.

[yroskov]

• A batch of "bare names" in the CoL need to be deleted: 1362 bare names in COL data#369

Checklistbank has no tool for deletion. Only blocking is possible. It's possible, via "indirect" steps, because user cannot open CoL Working Draft (id 3) in the Workbench.

2021-12-15: 1,208 bare names blocked in dataset ID 3 *)

https://data.catalogueoflife.org/catalogue/3/dataset/3/workbench?facet=rank&facet=issue&facet=status&facet=nomStatus&facet=nameType&facet=field&facet=authorship&facet=authorshipYear&facet=extinct&facet=environment&facet=origin&limit=1000&offset=0&reverse=false&status=bare%20name

*) Well, names blocked, if the checklistbank can handle this correctly:

1. selected all bare names, decision "Block" applied to all
   
2. results
   
3. page refreshed, and... no one decision saved (!)
   

[yroskov]

• ILDIS synced 2021-12-10
• LepIndex synced 2021-12-13

[yroskov]

Preview conversion launched 2021-12-13

[yroskov]

Checks of WFerns & WPlants 2021-12-06/08 on PREVIEW 2021-12-14

• Both WFerns & WPlants have incomplete references. Only Author present, no Year, no Details: World Plants (id 1141): test report #4 (comment) and World Ferns (id 1140): test report  #3 (comment).
  Seems, backend problem: Problem with References: only Auhtor present, no Year, no Details backend#1081

• Missing taxa in Scarabs. New version 2021-12-13 should be processed. Completed. = FIXED up to certain level

Markus: You did a release on the 13th when we had huge problems with the installation and had to restart the API in an emergency twice. Basically the release never completed, please delete it and do another one! (CatalogueOfLife/portal#173 (comment))

[yroskov]

Preview conversion launched 2021-12-14

[yroskov]

Checks of PREVIEW of 2021-12-14 (COL21.12) - 2021-12-15

• PREVIEW is failed or website software is down (for attention of @mdoering, @gdower): = FIXED

Home page, no tree at all:

Search page is empty:

Source Databases page is empty:

It's back now.

[yroskov]

Checks of PREVIEW of 2021-12-14 (COL21.12) - 2021-12-15 (continue)

• Search does not work in PREVIEW (@mdoering):
  
  

• References are still corrupted (as reported before, incomplete, Problem with References: only Auhtor present, no Year, no Details backend#1081). For example:
  

[yroskov]

Checks of PREVIEW of 2021-12-15 - 2021-12-17

• Search does not work in PREVIEW (@mdoering):
  

[yroskov]

Checks of PREVIEW of 2021-12-18 - 2021-12-20, 9.00-9.45 (Champaign), 16.45 (Leiden)

Markus, 2021-12-18: Hi Yuri, I did a december release today and also just deployed to preview.
The search index is still building, so please be patient with those results and counts.
Olaf, Chantal, it also needs a release post before we put this on prod. Wanna write that up? Markus

As i can see, the indexing completed:

The same problems in final product (@mdoering):

• Search does not work in PREVIEW = FIXED

[yroskov]

Deployed to PROD website 2021-12-21 as "CoL 2021-12-18"