Missing Plugins when running in cloud environments

[madvillain55]

Congratulations and thank you for developing EODAG! I would like to know if EODAG library can be used with cloud environments like Azure or Google Colab. It seems that Plugins don't get downloaded during the installation. Here is the code & the error I get with Google Colab for instance :

! pip install eodag
from eodag import EODataAccessGateway
from eodag import setup_logging
setup_logging(verbose=3)

dag = EODataAccessGateway()

search_results, total_count = dag.search(
    productType="S2_MSI_L1C",
    start="2021-03-01",
    end="2021-03-31",
    geom={"lonmin": 1, "latmin": 43, "lonmax": 2, "latmax": 44}
)

product_paths = dag.download_all(search_results)

[<ipython-input-6-80b57b283ae2>](https://localhost:8080/#) in <cell line: 8>()
      7 
----> 8 search_results, total_count = dag.search(
      9     productType="S2_MSI_L1C",
     10     start="2021-03-01",

[/usr/local/lib/python3.10/dist-packages/eodag/api/core.py](https://localhost:8080/#) in search(self, page, items_per_page, raise_errors, start, end, geom, locations, **kwargs)
    885             enforced here.
    886         """
--> 887         search_kwargs = self._prepare_search(
    888             start=start, end=end, geom=geom, locations=locations, **kwargs
    889         )

[/usr/local/lib/python3.10/dist-packages/eodag/api/core.py](https://localhost:8080/#) in _prepare_search(self, start, end, geom, locations, **kwargs)
   1306             self.fetch_product_types_list()
   1307 
-> 1308         search_plugin = next(
   1309             self._plugins_manager.get_search_plugins(product_type=product_type)
   1310         )

[/usr/local/lib/python3.10/dist-packages/eodag/plugins/manager.py](https://localhost:8080/#) in get_search_plugins(self, product_type, provider)
    170         try:
    171             for config in self.product_type_to_provider_config_map[product_type]:
--> 172                 yield get_plugin()
    173         except KeyError:
    174             logger.info(

[/usr/local/lib/python3.10/dist-packages/eodag/plugins/manager.py](https://localhost:8080/#) in get_plugin()
    145                 config.search.products = config.products
    146                 config.search.priority = config.priority
--> 147                 plugin = self._build_plugin(config.name, config.search, Search)
    148             except AttributeError:
    149                 config.api.products = config.products

[/usr/local/lib/python3.10/dist-packages/eodag/plugins/manager.py](https://localhost:8080/#) in _build_plugin(self, provider, plugin_conf, topic_class)
    285         if cached_instance is not None:
    286             return cached_instance
--> 287         plugin_class = EODAGPluginMount.get_plugin_by_class_name(
    288             topic_class, getattr(plugin_conf, "type")
    289         )

[/usr/local/lib/python3.10/dist-packages/eodag/plugins/base.py](https://localhost:8080/#) in get_plugin_by_class_name(cls, name)
     44             if name == plugin.__name__:
     45                 return plugin
---> 46         raise PluginNotFoundError(
     47             "'{}' not found for {} class of plugins".format(name, cls)
     48         )

PluginNotFoundError: 'QueryStringSearch' not found for <class 'eodag.plugins.search.base.Search'> class of plugins

Is there any trick for solving this Plugin issue ? I am not facing such issue by running it locally.

[sbrunato]

Hello @madvillain55 and thanks for pointing out this issue.
I also tried on colab, and got the same problem.
It seems that for some reason, entrypoints cannot be loaded:

import pkg_resources
[ep for ep in pkg_resources.iter_entry_points(group='eodag.plugins.search')]

returns

[]

instead of

[EntryPoint.parse('AwsSearch = eodag.plugins.search.qssearch:AwsSearch'), EntryPoint.parse('BuildPostSearchResult = eodag.plugins.search.build_search_result:BuildPostSearchResult'), EntryPoint.parse('CSWSearch = eodag.plugins.search.csw:CSWSearch'), EntryPoint.parse('ODataV4Search = eodag.plugins.search.qssearch:ODataV4Search'), EntryPoint.parse('PostJsonSearch = eodag.plugins.search.qssearch:PostJsonSearch'), EntryPoint.parse('QueryStringSearch = eodag.plugins.search.qssearch:QueryStringSearch'), EntryPoint.parse('StacSearch = eodag.plugins.search.qssearch:StacSearch'), EntryPoint.parse('StaticStacSearch = eodag.plugins.search.static_stac_search:StaticStacSearch')]

Entrypoints seem well installed:

!cat /usr/local/lib/python3.10/dist-packages/eodag-2.10.0.dist-info/entry_points.txt

[console_scripts]
eodag = eodag.cli:eodag

[eodag.plugins.api]
CdsApi = eodag.plugins.apis.cds:CdsApi
EcmwfApi = eodag.plugins.apis.ecmwf:EcmwfApi
UsgsApi = eodag.plugins.apis.usgs:UsgsApi

[eodag.plugins.auth]
AwsAuth = eodag.plugins.authentication.aws_auth:AwsAuth
GenericAuth = eodag.plugins.authentication.generic:GenericAuth
HTTPHeaderAuth = eodag.plugins.authentication.header:HTTPHeaderAuth
HttpQueryStringAuth = eodag.plugins.authentication.qsauth:HttpQueryStringAuth
KeycloakOIDCPasswordAuth = eodag.plugins.authentication.keycloak:KeycloakOIDCPasswordAuth
OAuth = eodag.plugins.authentication.oauth:OAuth
OIDCAuthorizationCodeFlowAuth = eodag.plugins.authentication.openid_connect:OIDCAuthorizationCodeFlowAuth
SASAuth = eodag.plugins.authentication.sas_auth:SASAuth
TokenAuth = eodag.plugins.authentication.token:TokenAuth

[eodag.plugins.crunch]
FilterDate = eodag.plugins.crunch.filter_date:FilterDate
FilterLatestByName = eodag.plugins.crunch.filter_latest_tpl_name:FilterLatestByName
FilterLatestIntersect = eodag.plugins.crunch.filter_latest_intersect:FilterLatestIntersect
FilterOverlap = eodag.plugins.crunch.filter_overlap:FilterOverlap
FilterProperty = eodag.plugins.crunch.filter_property:FilterProperty

[eodag.plugins.download]
AwsDownload = eodag.plugins.download.aws:AwsDownload
HTTPDownload = eodag.plugins.download.http:HTTPDownload
S3RestDownload = eodag.plugins.download.s3rest:S3RestDownload

[eodag.plugins.search]
AwsSearch = eodag.plugins.search.qssearch:AwsSearch
BuildPostSearchResult = eodag.plugins.search.build_search_result:BuildPostSearchResult
CSWSearch = eodag.plugins.search.csw:CSWSearch
ODataV4Search = eodag.plugins.search.qssearch:ODataV4Search
PostJsonSearch = eodag.plugins.search.qssearch:PostJsonSearch
QueryStringSearch = eodag.plugins.search.qssearch:QueryStringSearch
StacSearch = eodag.plugins.search.qssearch:StacSearch
StaticStacSearch = eodag.plugins.search.static_stac_search:StaticStacSearch

Some investigation will be needed.

[sbrunato]

I would like to know if EODAG library can be used with cloud environments like Azure or Google Colab

I do not have an account to try Azure, but EODAG works well on some private instances of Jupyter, or also