Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Producer phase data and/or model available for download? #12

Open
JViggiani opened this issue Jun 6, 2024 · 2 comments
Open

Producer phase data and/or model available for download? #12

JViggiani opened this issue Jun 6, 2024 · 2 comments

Comments

@JViggiani
Copy link

Hello!

I have downloaded this repository and I'm interested in training this model to play around with.

However, the LLB producer phase I estimate will take 182 days of continuous training for me to just synthesise the text embeddings before training the model.

Is the producer.py synthetic data available for download anywhere?

And further is the stage 1 and stage 2 trained model(s) available to download anywhere?

Thank you!

@smw1996
Copy link
Collaborator

smw1996 commented Jun 26, 2024

Dear user,

Thank you for your interest in our project. You can find the trained models in our README file; they are available for direct download via this link: https://huggingface.co/Hualouz/Qformer/tree/main.

Regarding the synthetic data generated by producer.py, we are currently evaluating the possibility of making it open-source. If we determine it is feasible to do so, we will strive to make it available as soon as possible so that community members like yourself can more easily engage in experimentation and research.

We appreciate your patience and interest once again. Should there be any updates, we will be sure to inform the community promptly.

Best regards!

@xxxl123
Copy link

xxxl123 commented Dec 25, 2024

Could you please tell me approximately how much time each step takes on the same device, V100?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants