Error when finetune with "wide_multivariate" data type

[HenryLee829]

When I use
python -m uni2ts.data.builder.simple train Datasets/data.csv --date_offset '2015-12-27 07:36:00'
to generate a wide .csv file to an arrow file, then use
python -m cli.train -cp conf/finetune run_name=train model=moirai_1.0_R_small data=train val_data=train
to finetune the model, it works out well.
However when I want to try to change the data type into wide_multivariate, I use
python -m uni2ts.data.builder.simple train Datasets/data.csv --date_offset '2015-12-27 07:36:00' --dataset_type wide_multivariate
and using the same command to finetune the model, there's an error:
AssertionError: Sample length must be less than or equal to max_length (512)
I don't know how to fix this. Could you give me some advice? Thanks a lot.

[gorold]

I'm guessing your time series are too short

[HenryLee829]

Thanks a lot for answering! Actually the time series I used to generate arrow file has the shape of (475200, 51), so I think short might not be the problem. I also tried other datasets like the ETTH dataset and use it to generate an "wide_multivariate" arrow file then use it to finetune the model and it has the same error.

I found the assert line in "loader.py", PackCollate class:
assert all( [len(sample[self.target_field]) <= self.max_length for sample in batch] ), f"Sample length must be less than or equal to max_length ({self.max_length})"

I printed len(sample[self.target_field]) and I found out that all sample length are multiples of the number of variables and is much larger than the set max_length(512). I think this is due to the method in your paper "flattening a multivariate time series to consider all variates as a single sequence". But when I set max_length to a larger number, it takes more memory to run. I want to know if there's something I'm doing wrong or there's anything else I can do.

Also, I tried a dataset with two variables and no errors were reported. I used the"moirai_1.0_R_small" model. But the finetuning process took only 5 epochs and stopped to improve. The result is not very good. The following three figures show the finetuning process, predictions before finetuning and predictions after finetuning respectively. I want to know if there's something I'm doing wrong.

[lukc12138]

Thanks a lot for answering! Actually the time series I used to generate arrow file has the shape of (475200, 51), so I think short might not be the problem. I also tried other datasets like the ETTH dataset and use it to generate an "wide_multivariate" arrow file then use it to finetune the model and it has the same error.

I found the assert line in "loader.py", PackCollate class: assert all( [len(sample[self.target_field]) <= self.max_length for sample in batch] ), f"Sample length must be less than or equal to max_length ({self.max_length})"

I printed len(sample[self.target_field]) and I found out that all sample length are multiples of the number of variables and is much larger than the set max_length(512). I think this is due to the method in your paper "flattening a multivariate time series to consider all variates as a single sequence". But when I set max_length to a larger number, it takes more memory to run. I want to know if there's something I'm doing wrong or there's anything else I can do.

Also, I tried a dataset with two variables and no errors were reported. I used the"moirai_1.0_R_small" model. But the finetuning process took only 5 epochs and stopped to improve. The result is not very good. The following three figures show the finetuning process, predictions before finetuning and predictions after finetuning respectively. I want to know if there's something I'm doing wrong.

I got the same problem as you mentioned in paragragh 4. Did you solve it?

[HenryLee829]

Sorry, I haven't solved it yet. Have you experienced the "max_length" problem I mentioned above(If you are using "wide_multivariate" type)?