New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

text encoder #83

Open

wangyf8848 opened this issue Mar 22, 2024 · 1 comment

wangyf8848 commented Mar 22, 2024

作者您好！请问网络架构中最初的文本编码器是使用的什么预训练模型？这个文本编码器和图像编码器之前有经过对齐训练吗？

hxx-who commented Mar 24, 2024

我觉得是ImageBind的text encoder，在OpenLLAMAPEFTModel类里应该能找到相关代码

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment