Fine tuning moondream for OCR

#33

by sunilchandwani - opened Aug 8, 2024

Discussion

sunilchandwani

Aug 8, 2024

•

edited Aug 8, 2024

The model has shown commendable results on OCR for printed text, but for handwritten text, it faces some challenges. How can we fine-tune the model for OCR, especially for handwritten text?

akhil2808

Oct 6, 2024

Were you able to get any solution man?I also wanna use it for a medical OCR

vikhyatk

Owner Oct 21, 2024

This should work? https://github.com/vikhyat/moondream/blob/main/notebooks/Finetuning.ipynb

Youss

13 days ago

The link is inaccessible @vikhyatk
It returns "404 - page not found"

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment