Tools and Supports

1. Standard Ingest Forms

   • Excel Standard Input Stream
     Import objects in Excel format with column name and control values validation, and pre-processing options for RDF preview, file match, and file validation.

     URL: /damsmanager/excelImport.do  
     Usage:  
     -    To ingest: Choose the source metadata location from dams-staging, then follow the form to choose the fields from Collection Selection (if applicable), Admin Unit, Program, Copyright Status, Copyright and Jurisdiction. Check checkbox next to label Ingest metadata and files and choose the file location from dams-staging that follows. Click the Submit button to perform the batch ingest.  
     -    Pre-processing (make sure that the checkbox Ingest metadata and files is unchecked):  
          .    RDF Preview (default): Choose the source metadata location from dams-staging, then follow the form to choose the fields from Collection Selection (if applicable), Admin Unit, Program, Copyright Status, Copyright and Jurisdiction. Click the Submit button to generate the RDF/XML.   
          .    File match: Check the radio button with label File match, choose the file location from dams-staging that follows, then click the Submit button.  
          .    File validation: Check the radio button with label File match, and choose the file location from dams-staging that follows, then click the Submit button.  
     

   • AT/MARC Standard Input Stream
     Import objects from AT/MARC source with pre-processing options for RDF preview, file match, and file validation.

     URL: /damsmanager/marcModsImport.do  
     Usage:  
     -    To ingest: Choose the source metadata location from dams-staging, then follow the form to choose the fields from Collection Selection (if applicable), Admin Unit, Program, Copyright Status, Copyright and Jurisdiction. Check checkbox next to label Ingest metadata and files and choose the file location from dams-staging that follows. Click the Submit button to perform the batch ingest.  
     -    Pre-processing (make sure that the checkbox Ingest metadata and files is unchecked):  
          .    RDF Preview (default): Choose the source metadata location from dams-staging, then follow the form to choose the fields from Collection Selection (if applicable), Admin Unit, Program, Copyright Status, Copyright and Jurisdiction, click Submit button to generate the RDF/XML.   
          .    File match: Check the radio button with label File matchand, choose the file location from dams-staging that follows, then click the Submit button.  
          .    File validation: Check the radio button with label File match, and choose the file location from dams-staging that follows, then click the Submit button.  
     

   • RDF Edit Form
     Edit single object with RDF XML:

     URL: /damsmanager/rdfImport.do  
     Usage: Enter the ark into the text input box, click the Submit button to load the RDF into the form. Edit the RDF/XML metadata and click the Submit button to save the record.
     

2. Collections Management

* Collection Create/Edit
Create and update the collection record with minimum fields for collection type, title, visibility, and parent/child relationship.

      URL: /damsmanager/collection.do  
      Usage:   
      -    Create new collections: Enter the collection title, choose the Collection Type, Parent Collection (if applicable), Admin Unit, and Visibility. Then click the Submit button to create the stub collection record.  
      -    Edit existing collections: Choose the collection from the Collection Selection drop down list, then enter the new collection title, or choose other values for Collection Type, Parent Collection (if applicable), Admin Unit, and Visibility. Click the Submit button to save it.  

* Collection Release  
  Release objects in a collection for public/local access, or reverse the release.

      URL: /damsmanager/collectionRelease.do  
      Usage:   
      -    Release new collections: Choose the collection from Collection Selection drop down list, select New Collection from the drop down list next to label Release As, then select the release state (public, local, curator) from the drop down list. Click the Release button to release it.    
      -    Merge collections: Choose the collection from Collection Selection drop down list, select Merge Collection from the drop down list next to label Release As, then select the Parent Collection form the drop down list. Click the Release button to release it.   
      -    Release One-offs: Choose the collection from Collection Selection drop down list, select value One-Offs from the drop down list next to label Release As, then click the Release button to release the object as orphans.   

* Object Validation  
  Validate and report objects/files in a collection, check the files for the existence and duplication.  

      URL: /damsmanager/controlPanel.do
      Usage: Select the collection from the Collection Selection drop down, click the Object tab in the collection management control panel, then check the checkbox next to label File Count Validation.
      Option(s):    
      -    Ingest missing files from staging. This will ingest the missing files from the selected directory in dams-staging.  
      -    Rename dams3 files to DAMS4 naming conventions. This will rename the files in DAMS3 naming convention to DAMS4 naming convention.   

* Checksum Validation  
  Fixity check for files in a collection. 

      URL: /damsmanager/controlPanel.do
      Usage: Select the collection from the Collection Selection drop down, click the Object tab in the collection management control panel, then check the checkbox next to label Checksum Validation. Click the Perform Operation to start the fixity check.  

* Technical metadata extraction and report  
  Generate report with technical metadata for the files in a collection.  

      URL: /damsmanager/controlPanel.do
      Usage: Select the collection from the Collection Selection drop down, click the Object tab in the collection management control panel, then check the checkbox next to label Jhove Report.  
      Option(s):    
      -    Jhove report for BYTESTREAM files only.  
      -    Update technical metadata  
             Extract and add Jhove metadata.  
             Correct format and format version.  
             Update duration for audio/video. 
           
* Derivatives creation/update  
  Create/re-create derivatives for the master files in a collection.

      URL: /damsmanager/controlPanel.do
      Usage: Select the collection from the Collection Selection drop down, click the Derivatives tab in the collection management control panel, then check the checkbox next to label Derivatives Creation and select the derivative size.  
      Option(s):    
      -    Replace the derivatives for the selected type(s).

* SOLR Index/Update  
  Update SOLR for objects in a collection.

      URL: /damsmanager/controlPanel.do
      Usage: Select the collection from the Collection Selection drop down, click the Metadata tab in the collection management control panel, then check the checkbox next to label SOLR Indexing.  
      Option(s):    
      -     Clean up SOLR for the collection selected. This will remove those items that were deleted from the triplestore but exist in SOLR.

* Metadata Import/Update  
  + RDF Import/Update  
    This will import the RDF/XML that is valid and consistent with the DAMS data model.

        URL: /damsmanager/controlPanel.do
        Usage: Select the collection from the Collection Selection drop down, click the Import tab in the collection management control panel, then check the checkbox next to label Metadata Import. Choose the RDF XML file from the file chooser.
        Formats:  RDF/XML, N-Triples       
        Option(s):    
        -     Add metadata (Not work with with RDF Validation in damsrepo).  
        -     Replace descriptive metadata only to keep keep file properties (Not work with with RDF Validation in damsrepo).  
        -     Replace the whole record with metadata submitted.  
        -     Same predicates replacement with metadata submitted (Not work with with RDF Validation in damsrepo).  
        -     Delete all submitted records/resources referenced by rdf:about.

        Note: To delete and object and the files, please include the dams:Files structures in the object record as well.
              To remove File(s) and it's technical metadata from an object, just need to include the dams:File structure in the RDF/XML (An empty dams:File element will be fine) For example:
              <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"  xmlns:dams="http://library.ucsd.edu/ontology/dams#">
                   <dams:File rdf:about="http://library.ucsd.edu/ark:/20775/bbxxxxxxxx/1.tif></dams:File>
                   <dams:File rdf:about="http://library.ucsd.edu/ark:/20775/bbxxxxxxxx/2.jpg></dams:File>
                   ...
              </rdf:RDF>

  + External Import  
    With external import, authority records and collections will be lookup from the triplestore, otherwise a new object ID (ARK) will assigned if the authority record or collection doesn't exist in DAMS.

        URL: /damsmanager/controlPanel.do
        Usage: Select the collection from the Collection Selection drop down, click the Import tab in the collection management control panel, then check the checkbox with label External Import. Choose the RDF source metadata from dams-staging, and choose the source files for ingest. 
        Option(s):    
        -  Pre-processing only, no ingest.
        -  Ingest metadata and files
        -  Ingest metadata only 

* RDF Export  
  Export metadata in RDF/N-Triples format for all objects in a collection with options to export part of the metadata by namespace selectively.

        URL: /damsmanager/controlPanel.do
        Usage: Select the collection from the Collection Selection drop down, click the Export tab in the collection management control panel, then check the checkbox with label Metadata Export, then click button Perform Operation to start export the metadata in the collection. 
        Formats:  RDF/XML, N-Triples  
        Option(s):   
        -    Namespace(s) delimited by comma.  
        -    Exclude metadata in components and files.  

* Staging Ingest  
  Ingest files for simple objects and complex objects with no descriptive metadata.  

        URL: /damsmanager/ingest.do  
        Usage: Select the source files from dams-staging, then follow the form to choose the fields for collection, unit,  ARK Setting, and enter the pattern for file filtering. Click button Ingest to start ingest the files. 
        Ark Setting Option(s):  
        -    One ARK to one file (Single Objects).
        -    One ARK to files in the same directory.  
        -    One ARK to files with a suffix ending with 'p' plus page number (Single & Complex).
        -    One ARK to a file and its edited file (Master and Master-edited files).
        -    One ARK to files with different suffixes (Master file and derivatives).
        -    One ARK to complex objects, components order delimited by.
        Option(s) for File:
        -    Files ordered by suffixes (delimited by comma).  
        -    File Use properties applied (delimited by comma).   

3. DAMS Statistics

    Statistics of the DAMS, including dams usage, item usage, collection access, keyword/Phrase, collection quantities like counts, size etc.
   
        URL: /damsmanager/stats.do
   

   • Popular Items
     Listing of the top 100 popular items that are accessed/viewed.

       URL: /damsmanager/statsPopular.do
     

   • Stats Summary
     Summary by month for number of collections, number of items, disk size, number of search, DAMS usage and items usage/access etc.

       URL: /damsmanager/statsSummary.do
       Parameter: start - (Optional) start date yyyy-MM-dd.  
     

   • DAMS Usage
     Statistics for usage of DAMS by month.

       URL: /damsmanager/statsUsage.do
     

   • Items Usage
     Statistics for usage of items in DAMS.

       URL: /damsmanager/statsUsage.do?type=item
     

   • Collection Access
     Statistics for the access of the collections in DAMS by month.

       URL: /damsmanager/statsCollections.do
     

   • Keyword/Phrase
     Statistics of the keywords/Phrases that were used for searching.

       URL: /damsmanager/statsKeywords.do
       Usage: Enter the keyword into the input text box to search. Limit the statistics for a specific time period by choosing the start date and end date from the calendar.  
     

4. DAMS Statistics Analyzing Tools

    Tools that used to collect the statistic data for DAMS.
    + Log Analyzer
      Analyze the Apache weblog to collect the statistics data for dams usage, item usage, collection access etc.  
          URL: /damsmanager/statsWeblogAnalyzer.do
          Usage: Set up to Automatically run nightly.  
          Parameter: start - start date yyyy-MM-dd.  
                     end - end date yyyy-MM-dd.  
                     update - regenerate the statistics.
   
    + Collection Quantity Analyzer
      Collect the quantity related metadata for collections, like collection size, disk size etc.
   
          URL: /damsmanager/statsQuantityAnalyzer.do
          Usage: Set up to run Automatically the first day of each monthly.
   

5. Reports

   • Collection Status Report (Curator access only)
     Report for the status of the collections in DAMS regarding object counts, disk size, the state/view etc.

        URL: /damsmanager/collectionReport.do   
     

6. Other Tools

   • SOLR Dump
     Forms to submit single item or batch of item for SOLR indexing.

     URL: /damsmanager/solrDump.do
     Usage:       
     -    To submit single item or batch of items: Choose Text Input from the drop down list with label Record Source, then enter the ARK or ARKs delimited by comma. Or choose File Attachment from the drop down list with label Record Source, then choose the files that contain the arks (comma or line delimited). Click the Submit button to send the request for SOLR indexing.
     -    To index batch of collections: Click the tab Collections on the top, check one or more collections that need indexing, then click the SOLR Update button.
     

   • File Upload/Replacement
     Replace files or ingest files for objects in DAMS.

     URL: /damsmanager/fileUpload.do  
     Usage: Choose the folder that contains the files for replacement/ingest, click the Upload button to load the form that listing the files, enter the file URL for each file, then click the Upload button to ingest the files. 
     

   • RDF Serialization Serialize/re-serialize RDF/XML metadata to the filestore by collections.

     URL: /damsmanager/serialize.do  
     Usage: check one or more collections that need Serialize/re-serialize, then click the Serialize button to submit the request.