Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VPC Virtual Point Cloud - Error when creating VPC from HTTPS/URI sources #59802

Open
2 tasks done
P-SLISSE opened this issue Dec 10, 2024 · 6 comments
Open
2 tasks done
Labels
Bug Either a bug report, or a bug fix. Let's hope for the latter! Point Clouds Processing Relating to QGIS Processing framework or individual Processing algorithms

Comments

@P-SLISSE
Copy link

What is the bug or the crash?

Hello,
When creating VPC with point cloud available in my personnal hard drive, the processing is OK.

But when I create a VPC with the processing tool, using copc.laz files available on cloud storage (https/uri), the processing stop with error

For me, it's really powerfull to create VPC from cloud stored data

For responsible digital : datas are stored one time, and can be used worldwide (without need to upload all the datas before using them)

Steps to reproduce the issue

  1. Import copc.laz files from https/uri
    You can use this URLs
    https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1050_6841_PTS_C_LAMB93_IGN69.copc.laz
    https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1051_6841_PTS_C_LAMB93_IGN69.copc.laz
    OR
    https://s3.eu-west-2.wasabisys.com/ems-sgct-photomaillage/DATA/TEST/VPC_DATA/2035500_7275500_LIDAR2021.copc.laz
    https://s3.eu-west-2.wasabisys.com/ems-sgct-photomaillage/DATA/TEST/VPC_DATA/2035000_7275500_LIDAR2021.copc.laz

  2. Use the processing tool to create VPC
    image
    I choose the 2 pointcloud entities (https://...), and I write the VPC file on my local harddrive
    I explicitely choose the *.vpc file format

  3. The processing stops on error
    Version de QGIS : 3.40.1-Bratislava
    Révision du code : 989853a
    Version de Qt : 5.15.13
    Version de Python : 3.12.7
    Version de GDAL : 3.9.3
    Version de GEOS : 3.13.0-CAPI-1.19.0
    Version de Proj : Rel. 9.5.0, September 15th, 2024
    Version de PDAL : 2.8.1 (git-version: a06325)
    Algorithme commencé à: 2024-12-10T11:26:00
    Démarrage de l'algorithme 'Construire un nuage de points virtuel (VPC)'…
    Paramètres en entrée:
    { 'BOUNDARY' : False, 'LAYERS' : ['copc://https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1050_6841_PTS_C_LAMB93_IGN69.copc.laz','copc://https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1051_6841_PTS_C_LAMB93_IGN69.copc.laz'], 'OUTPUT' : 'D:/TMP/LIDAR2025/IssueVPC/VPCIGN.vpc', 'OVERVIEW' : False, 'STATISTICS' : False }

wrench command: C:/OSGeo4W/apps/qgis/./pdal_wrench.exe build_vpc --output=D:/TMP/LIDAR2025/IssueVPC/VPCIGN.vpc --threads=24 --input-file-list=C:/Users/230095/AppData/Local/Temp/processing_QiXqSO/2b19f486442044dfb8fdfe696f56717e/inputFiles.txt

Le processus s'est arrêté de façon inattendue
L'exécution a échoué après 261.08 secondes (4 minutes 21 secondes)

Chargement des couches de résultat
Les couches suivantes n'ont pas été générées correctement.
• D:/TMP/LIDAR2025/IssueVPC/VPCIGN.vpc
Vous pouvez vérifier le Panel de messages du journal dans la fenêtre principale de QGIS pour trouver plus d'informations à propos de l'exécution de l'algorithme.

Versions

Version de QGIS3.40.1-Bratislava
Révision du code989853a7
 
Libraries
Version de Qt5.15.13
Version de Python3.12.7
Version de GDAL/OGR3.9.3
Version de Proj9.5.0
Version de la base de données du registre EPSGv11.016 (2024-08-31)
Version de GEOS3.13.0-CAPI-1.19.0
Version de SQLite3.46.1
Version de PDAL2.8.1
Version du client PostgreSQL16.2
Version de SpatiaLite5.1.0
Version de QWT6.3.0
Version de QScintilla22.14.1
Version de l'OSWindows 10 Version 2009
 
Extensions Python actives
db_manager0.1.20
grassprovider2.12.99
MetaSearch0.3.6
processing2.12.99

Supported QGIS version

  • I'm running a supported QGIS version according to the roadmap.

New profile

Additional context

No response

@P-SLISSE P-SLISSE added the Bug Either a bug report, or a bug fix. Let's hope for the latter! label Dec 10, 2024
@saberraz
Copy link
Contributor

It works fine in QGIS 3.40. See the attached zip file.
output.zip

@saberraz saberraz added Feedback Waiting on the submitter for answers Processing Relating to QGIS Processing framework or individual Processing algorithms Point Clouds labels Dec 10, 2024
@P-SLISSE
Copy link
Author

It works fine in QGIS 3.40. See the attached zip file. output.zip

Hello,
I'm also in 3.40 (3.40.1)
Can you explain how you manage to produce the VPC file ?
What did you differently from my processing description above ?

@agiudiceandrea
Copy link
Member

agiudiceandrea commented Dec 10, 2024

@saberraz, I can also confirm the issue using QGIS 3.41.0-Master da86bc1 (OSGeo4W) on Windows 10 and following the provided steps with the first 2 URLs.

QGIS version: 3.41.0-Master
QGIS code revision: da86bc17a6
Qt version: 5.15.13
Python version: 3.12.7
GDAL version: 3.11.0dev-d00d363d94
GEOS version: 3.13.0-CAPI-1.19.0
PROJ version: Rel. 9.5.0, September 15th, 2024
PDAL version: 2.8.1 (git-version: a06325)
Algorithm started at: 2024-12-10T17:11:31
Algorithm 'Build virtual point cloud (VPC)' starting…
Input parameters:
{ 'BOUNDARY' : False, 'LAYERS' : ['copc://https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1050_6841_PTS_C_LAMB93_IGN69.copc.laz','copc://https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1051_6841_PTS_C_LAMB93_IGN69.copc.laz'], 'OUTPUT' : 'TEMPORARY_OUTPUT', 'OVERVIEW' : False, 'STATISTICS' : False }

wrench command: C:/OS022F~1/apps/qgis-dev/./pdal_wrench.exe build_vpc --output=C:/Users/Andrea/AppData/Local/Temp/processing_aQCcWF/329371e8ea724c7490d1ba135f9b81e2/OUTPUT.vpc --threads=4 --input-file-list=C:/Users/Andrea/AppData/Local/Temp/processing_aQCcWF/e14e9c606631439aad0f31034c1e948d/inputFiles.txt

Process was unexpectedly terminated
Execution failed after 270.37 seconds (4 minutes 30 seconds)

Loading resulting layers
The following layers were not correctly generated.
• C:/Users/Andrea/AppData/Local/Temp/processing_aQCcWF/329371e8ea724c7490d1ba135f9b81e2/OUTPUT.vpc
You can check the 'Log Messages Panel' in QGIS main window to find more information about the execution of the algorithm.

C:/Users/Andrea/AppData/Local/Temp/processing_aQCcWF/e14e9c606631439aad0f31034c1e948d/inputFiles.txt contains:

https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1050_6841_PTS_C_LAMB93_IGN69.copc.laz
https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1051_6841_PTS_C_LAMB93_IGN69.copc.laz
QGIS version3.41.0-Master
QGIS code revisionda86bc17a6
 
Libraries
Qt version5.15.13
Python version3.12.7
GDAL/OGR version3.11.0dev-4cfbcf8285 (Compiled)
3.11.0dev-d00d363d94 (Running)
PROJ version9.5.0
EPSG Registry database versionv11.016 (2024-08-31)
GEOS version3.13.0-CAPI-1.19.0
SQLite version3.46.1
PDAL version2.8.1
PostgreSQL client version16.2
SpatiaLite version5.1.0
QWT version6.3.0
QScintilla2 version2.14.1
OS versionWindows 10 Version 1903
This copy of QGIS writes debugging output.
 
Active Python plugins
db_manager0.1.20
grassprovider2.12.99
MetaSearch0.3.6
processing2.12.99

@saberraz
Copy link
Contributor

We are aware of the issue in master. The remote COPC crashes QGIS. There will be a fix soon for that.

But the OP is reporting about VPC creation from remote COPC in 3.40, which should work as expected.

@agiudiceandrea
Copy link
Member

agiudiceandrea commented Dec 10, 2024

@saberraz, I didn't experience any crash using QGIS 3.41.0-Master while executing the processing algorithm "Build virtual point cloud (VPC)" (is there an issue report about such crash?), anyway the processing algorithm "Build virtual point cloud (VPC)" (pdal:virtualpointcloud) fails to properly execute.

I can confirm the issue occurs even using QGIS 3.40.1 on my Windows 10 system:

QGIS version: 3.40.1-Bratislava
QGIS code revision: 989853a7
Qt version: 5.15.13
Python version: 3.12.7
GDAL version: 3.9.3
GEOS version: 3.13.0-CAPI-1.19.0
PROJ version: Rel. 9.5.0, September 15th, 2024
PDAL version: 2.8.1 (git-version: a06325)
Algorithm started at: 2024-12-10T17:40:10
Algorithm 'Build virtual point cloud (VPC)' starting…
Input parameters:
{ 'BOUNDARY' : False, 'LAYERS' : ['copc://https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1050_6841_PTS_C_LAMB93_IGN69.copc.laz','copc://https://storage.sbg.cloud.ovh.net/v1/AUTH_63234f509d6048bca3c9fd7928720ca1/ppk-lidar/SE/LHD_FXX_1051_6841_PTS_C_LAMB93_IGN69.copc.laz'], 'OUTPUT' : 'TEMPORARY_OUTPUT', 'OVERVIEW' : False, 'STATISTICS' : False }

wrench command: C:/OS022F~1/apps/qgis/./pdal_wrench.exe build_vpc --output=C:/Users/Andrea/AppData/Local/Temp/processing_dMlcwR/62aa1b8fb8ef4bdab2b1a5c75b4eaaa8/OUTPUT.vpc --threads=4 --input-file-list=C:/Users/Andrea/AppData/Local/Temp/processing_dMlcwR/04c01cc6462642be8a6a623fc99aad97/inputFiles.txt

Process was unexpectedly terminated
Execution failed after 266.50 seconds (4 minutes 27 seconds)

Loading resulting layers
The following layers were not correctly generated.
• C:/Users/Andrea/AppData/Local/Temp/processing_dMlcwR/62aa1b8fb8ef4bdab2b1a5c75b4eaaa8/OUTPUT.vpc
You can check the 'Log Messages Panel' in QGIS main window to find more information about the execution of the algorithm.
QGIS version3.40.1-Bratislava
QGIS code revision989853a7
 
Libraries
Qt version5.15.13
Python version3.12.7
GDAL/OGR version3.9.3
PROJ version9.5.0
EPSG Registry database versionv11.016 (2024-08-31)
GEOS version3.13.0-CAPI-1.19.0
SQLite version3.46.1
PDAL version2.8.1
PostgreSQL client version16.2
SpatiaLite version5.1.0
QWT version6.3.0
QScintilla2 version2.14.1
OS versionWindows 10 Version 1903
 
Active Python plugins
db_manager0.1.20
grassprovider2.12.99
MetaSearch0.3.6
processing2.12.99

@agiudiceandrea agiudiceandrea removed the Feedback Waiting on the submitter for answers label Dec 10, 2024
@jo-chemla
Copy link

Probably related, the french IGN datastore seem to have incorrect SSL certificate or HTTP to HTTPS redirection, see PDAL/wrench#33 (comment), which results in errors Curl failure: SSL peer certificate or SSH remote key was not OK. The above comment describes a procedure, based on proxying the ovh server to localhost, so that this works correctly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Either a bug report, or a bug fix. Let's hope for the latter! Point Clouds Processing Relating to QGIS Processing framework or individual Processing algorithms
Projects
None yet
Development

No branches or pull requests

4 participants