Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Docs] How to use custom dataset for training? #2603

Open
sasuga62complex opened this issue Jun 12, 2023 · 12 comments
Open

[Docs] How to use custom dataset for training? #2603

sasuga62complex opened this issue Jun 12, 2023 · 12 comments

Comments

@sasuga62complex
Copy link

Branch

dev-1.x branch https://mmdetection3d.readthedocs.io/en/dev-1.x/

📚 The doc issue

I run the following command:

python tools/create_data.py custom --root-path ./data/custom --out-dir ./data/custom --extra-tag custom

in https://github.com/open-mmlab/mmdetection3d/blob/dev-1.x/docs/en/advanced_guides/customize_dataset.md.
The command, however, went wrong with NotImplementedError: Don't support custom dataset.
I think there is no related code about custom dataset format in 'tools/create_data.py`.

I want to use pure point cloud dataset and its annotated dataset prepared using SUSTechPoints.
How can I do to use them to train pointpillars model?

Suggest a potential alternative/fix

No response

@sasuga62complex sasuga62complex changed the title [Docs] [Docs] How to use custom dataset for training? Jun 13, 2023
@xiaodiadai
Copy link

I also encountered this issue, there is no processing code for 'custom' in script tools/create_data.py

@kekaodechenye
Copy link

so do i!!!

@sunjiahao1999
Copy link
Collaborator

You need to emulate other datasets to generate train/test/val_infos.pkl, for pure point cloud datasets I recommend KITTI/ScanNet format for Outdoor/Indoor scenes.

@sasuga62complex
Copy link
Author

@sunjiahao1999 Thanks. I already covert my point cloud datasets to KITTI data format.

@dikubab
Copy link

dikubab commented Jun 30, 2023

@sasuga62complex Can share the how you converted it?

@xiaodiadai
Copy link

@sasuga62complex Can share the how you converted it?

+1

@calmelo
Copy link

calmelo commented Aug 3, 2023

You need to emulate other datasets to generate train/test/val_infos.pkl, for pure point cloud datasets I recommend KITTI/ScanNet format for Outdoor/Indoor scenes.

How do you solve the problem? I can't use my customized datasets to train the mmdetection3d models. I would be very appreciate it if you can tell me how should I do it. Thanks!

@HydrogenWasser
Copy link

u need to rewrite data_converter.py and create_data.py for ur own datasets

@linClubs
Copy link

linClubs commented Dec 8, 2023

my annotated dataset prepared using SUSTechPoints ,and I already covert my point cloud datasets to KITTI data format. the next, due to my classes more than 3, how do rewrite data_converter.py and create_data? @sunjiahao1999 @HydrogenWasser

@sasuga62complex
Copy link
Author

my annotated dataset prepared using SUSTechPoints ,and I already covert my point cloud datasets to KITTI data format. the next, due to my classes more than 3, how do rewrite data_converter.py and create_data? @sunjiahao1999 @HydrogenWasser

7 classes are already included for KITTI data format (I think it's related class KittiDataset in mmdet3d/datasets/kitti_datasets.py, maybe...) In addition, You need to check configs/base/datasets/*.py which you use.

@18722013889
Copy link

You need to emulate other datasets to generate , for pure point cloud datasets I recommend KITTI/ScanNet format for Outdoor/Indoor scenes.train/test/val_infos.pkl
when i convert mydataset to kitti, i have no images in mydataset , excute "python tools/create_data.py kitti --root-path .\data\mydata\ --out-dir .\data\mydata\ --extra-tag mydata" i got"file not exist: training\image_2\001.png" how can i solve thi problem.thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

10 participants