[Issue #2794] Modify export_opportunity_data_task to create ExtractMetadata database records

[mikehgrantsgov]

Summary

Fixes #2794

Time to review: 15 mins

Changes proposed

Add records to database when running export_opportunity_data_task.py.

Context for reviewers

This completes the ExtractMetadata API work. These records will later be queryable by the already-built API around ExtractMetadata records.

Additional information

See attached unit test

[chouinar]

Rather than effectively make the file twice, what if we just ask the file system/s3.

We'd need to do that ourselves, but a method in our file_utils like (hastily thrown together from copying a few different bits of code):

def get_file_length_bytes(path: str) -> int:
     if is_s3_path(path):
          s3_client = get_s3_client() # from our aws utils - handles some of the weird localstack stuff
          
          bucket, key = split_s3_url(path)
          file_metadata = s3_client.head_object(Bucket=bucket, Key=key)
          return file_metadata["ContentLength"]          


     file_stats = os.stat(path)
     return file_stats.st_size

[mdragon]

LGTM