1.6B parameter model built by @vikhyatk using SigLIP, Phi-1.5 and the LLaVa training dataset. The model is release for research purposes only, commercial use is not allowed. Try it out on Huggingface Spaces! Usage pip install transformers timm einops from transformers import AutoModelForCausalLM, CodeGenTokenizerFast as Tokenizer
from PIL import Image model_id = "vikhyatk/moondream1"
model = AutoModelForCausalLM.from_pretrained(model_id, trust_remote_code=True)
tokenizer = Tokenizer.from_pretrained(model_id) image = Image.open('<IMAGE_PATH>')
enc_image = model.encode_image(image)
print(model.answer_question(enc_image, "<QUESTION>", tokenizer)) reupload #4. I assume this service doesn't like emojis. https://huggingface.co/vikhyatk/moondream1
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum You cannot attach files in this forum You can download files in this forum
!ATTENTION!
The site does not give electronic versions of products, and is engaged only in a collecting and cataloguing of the references sent and published at a forum by our readers. If you are the legal owner of any submitted material and do not wish that the reference to it was in our catalogue, contact us and we shall immediately remove her. Files for an exchange on tracker are given by users of a site, and the administration does not bear the responsibility for their maintenance. The request to not fill in the files protected by copyrights, and also files of the illegal maintenance!
![[Code]](./styles/templates/default/images/lang/en/icon_code.gif "Code"){kind=icon}
![[Profile]](./styles/templates/default/images/lang/en/icon_profile.gif "View user's profile"){kind=icon}
![[PM]](./styles/templates/default/images/lang/en/icon_pm.gif "Send private message"){kind=icon}
