Skip to content

Conversation

@httpdss
Copy link
Owner

@httpdss httpdss commented Nov 26, 2024

Overview:

This pull request introduces a ContentFetcher module, expanding the library's capabilities to fetch content from various protocols like local files, HTTP(S), GitHub repositories, S3, and Google Cloud Storage. It also enhances the logging configuration for better debugging and monitoring.

Changes:

  • content_fetcher.py:
    • New module to handle content fetching across multiple protocols, with support for caching and error handling.
  • README.md and README.es.md:
    • Updated to document examples of using the ContentFetcher for different content locations.
  • requirements.txt:
    • Added dependencies: boto3, google-cloud, and google-api-core.
  • file_item.py:
    • Integrated ContentFetcher for streamlined content retrieval.
    • Removed redundant fetch logic.
  • logging_config.py:
    • Enhanced logging format to include file names and line numbers in debug mode.

Justification:

The addition of ContentFetcher simplifies content retrieval and extends the library's utility by supporting multiple widely-used protocols. Improved logging aids developers in debugging and monitoring the application's execution.

Impact:

  • Users can now fetch content seamlessly from various sources without writing custom logic for each protocol.
  • Enhanced logging improves development and production diagnostics.
  • Minor increase in dependencies for cloud storage support.

@httpdss httpdss changed the title Contect fetcher Add Content Fetcher for Multiple Protocols and Improve Logging Nov 26, 2024
@httpdss httpdss merged commit d9722c8 into main Nov 26, 2024
4 checks passed
@httpdss httpdss deleted the contect-fetcher branch November 26, 2024 03:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants