TUTuringNYC·Aug 23, 2023
Dear @garrinm Firstly, thank you for sharing this!
We built something like this at work, and i'd love if you could share details on your effort.
I tried to follow: https://github.com/clint-llm/clint-cli/blob/main/clint/scrip... but it wasnt clear -- are you indexing the medical literature in entirety or just abstracts?
We tried to do this with arXiv and others, but getting commercial rights was difficult and we got stuck on that, could you share which medical literature source you used.
I tried to follow the code and it looks like you embed, so i'm assuming you're using RAG, is that it, or are you trying to fine-tune also? I didnt see any fine-tune code. (We didnt fine tune due to cost)
Did you benchmark different embedding chunk sizes, etc?
(Yes for us! We've tried a matrix search of chunk sizes, including sliding window and found the sw
Read the rest
eet spot for different types of media, usually a single paragraph)
Did you manage to get access to a fine-tuned model like MedPALM and benchmark that? (we are still awaiting access)