Cell Image Library (CIL) Input Stream (epic)

[arwenhutt]

Brief description

Develop process for regular harvesting of (files and metadata) from the Cell Image Library GitHub repository and transformation of metadata files into ingest template

• Proposal & initial discussion of scope: CIL harvesting and metadata transformation processes  #289

Acceptance criteria

Harvesting of metadata and files & metadata transformation

• spec written, reviewed , and finalized. CIL harvesting and metadata transformation processes  #289 -- Harvesting process
• code written. CIL Harvesting - Download source JSON metadata files and retrieve master source files from Github #297 Add CIL Input Stream for CIL Harvesting #291 Integrate CIL InputStream into DAMS Manager for Ingest #292
• REST API code written. CIL Harvesting - Retrieve initial batch of master source files from CIL's Public REST API #327
• metadata transformation reviewed Mapping CIL metadata transformation QA #317
• testing and updating on QA server. [link to ticket]
• deployed and tested on production server. [link to ticket]

Links:
CIL public repo

[arwenhutt]

@hjsyoo I created a binder ticket for CIL work - I am not sure if the changes to the harvesting process (to use the API instead of their github repo) are included in the comments in #289 or if it would be helpful to have a new ticket for that or not. Or if there is other work that needs a new ticket or to be linked to this one. Please edit freely, and we can touch base next week.

[arwenhutt]

This ticket is for tracking and coordination across the individual tasks/tickets which are part of this work. I'm adding everyone who is involved in some part of this work as assignee's to this ticket.