Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Numpy error #7

Open
hieuhthh opened this issue Jun 24, 2024 · 0 comments
Open

Numpy error #7

hieuhthh opened this issue Jun 24, 2024 · 0 comments

Comments

@hieuhthh
Copy link

I follow your tutorial and Lora on my own data. Got this error.

A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last): File "/workspace/my-musicgen-dreamboothing/dreambooth_musicgen.py", line 1211, in
main()
File "/workspace/my-musicgen-dreamboothing/dreambooth_musicgen.py", line 830, in main
vectorized_datasets = raw_datasets.map(
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/dataset_dict.py", line 869, in map
{
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/dataset_dict.py", line 870, in
k: dataset.map(
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 602, in wrapper
out: Union["Dataset", "DatasetDict"] = func(self, *args, **kwargs)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 567, in wrapper
out: Union["Dataset", "DatasetDict"] = func(self, *args, **kwargs)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 3161, in map
for rank, done, content in Dataset._map_single(**dataset_kwargs):
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 3522, in _map_single
example = apply_function_on_filtered_inputs(example, i, offset=offset)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 3421, in apply_function_on_filtered_inputs
processed_inputs = function(*fn_args, *additional_args, **fn_kwargs)
File "/workspace/my-musicgen-dreamboothing/dreambooth_musicgen.py", line 819, in prepare_audio_features
target_sample = batch[target_audio_column_name]
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/formatting/formatting.py", line 273, in getitem
value = self.format(key)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/formatting/formatting.py", line 371, in format
return self.formatter.format_column(self.pa_table.select([key]))[0]
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/formatting/formatting.py", line 443, in format_column
column = self.python_features_decoder.decode_column(column, pa_table.column_names[0])
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/formatting/formatting.py", line 219, in decode_column
return self.features.decode_column(column, column_name) if self.features else column
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/features/features.py", line 2008, in decode_column
[decode_nested_example(self[column_name], value) if value is not None else None for value in column]
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/features/features.py", line 2008, in
[decode_nested_example(self[column_name], value) if value is not None else None for value in column]
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/features/features.py", line 1351, in decode_nested_example
return schema.decode_example(obj, token_per_repo_id=token_per_repo_id)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/features/audio.py", line 191, in decode_example
array = librosa.to_mono(array)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/lazy_loader/init.py", line 83, in getattr
attr = getattr(submod, name)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/lazy_loader/init.py", line 82, in getattr
submod = importlib.import_module(submod_path)
File "/root/miniconda3/envs/mg/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/librosa/core/audio.py", line 15, in
import soxr
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/soxr/init.py", line 10, in
from . import cysoxr
preprocess datasets: 0%| | 0/100 [00:00<?, ? examples/s]
Traceback (most recent call last):
File "/workspace/my-musicgen-dreamboothing/dreambooth_musicgen.py", line 1211, in
main()
File "/workspace/my-musicgen-dreamboothing/dreambooth_musicgen.py", line 830, in main
vectorized_datasets = raw_datasets.map(
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/dataset_dict.py", line 869, in map
{
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/dataset_dict.py", line 870, in
k: dataset.map(
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 602, in wrapper
out: Union["Dataset", "DatasetDict"] = func(self, *args, **kwargs)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 567, in wrapper
out: Union["Dataset", "DatasetDict"] = func(self, *args, **kwargs)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 3161, in map
for rank, done, content in Dataset._map_single(**dataset_kwargs):
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 3522, in _map_single
example = apply_function_on_filtered_inputs(example, i, offset=offset)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 3421, in apply_function_on_filtered_inputs
processed_inputs = function(*fn_args, *additional_args, **fn_kwargs)
File "/workspace/my-musicgen-dreamboothing/dreambooth_musicgen.py", line 819, in prepare_audio_features
target_sample = batch[target_audio_column_name]
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/formatting/formatting.py", line 273, in getitem
value = self.format(key)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/formatting/formatting.py", line 371, in format
return self.formatter.format_column(self.pa_table.select([key]))[0]
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/formatting/formatting.py", line 443, in format_column
column = self.python_features_decoder.decode_column(column, pa_table.column_names[0])
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/formatting/formatting.py", line 219, in decode_column
return self.features.decode_column(column, column_name) if self.features else column
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/features/features.py", line 2008, in decode_column
[decode_nested_example(self[column_name], value) if value is not None else None for value in column]
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/features/features.py", line 2008, in
[decode_nested_example(self[column_name], value) if value is not None else None for value in column]
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/features/features.py", line 1351, in decode_nested_example
return schema.decode_example(obj, token_per_repo_id=token_per_repo_id)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/datasets/features/audio.py", line 191, in decode_example
array = librosa.to_mono(array)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/lazy_loader/init.py", line 83, in getattr
attr = getattr(submod, name)
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/lazy_loader/init.py", line 82, in getattr
submod = importlib.import_module(submod_path)
File "/root/miniconda3/envs/mg/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/librosa/core/audio.py", line 15, in
import soxr
File "/root/miniconda3/envs/mg/lib/python3.10/site-packages/soxr/init.py", line 10, in
from . import cysoxr
File "src/soxr/cysoxr.pyx", line 1, in init soxr.cysoxr
ImportError: numpy.core.multiarray failed to import (auto-generated because you didn't call 'numpy.import_array()' after cimporting numpy; use 'numpy._import_array' to disable if you are certain you don't need it).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant