BLIP

I suggest trying BLIP for this. I've had really good results from that. https://github.com/salesforce/BLIP I built a tiny Python CLI wrapper for it to make it easier to try: https://github.com/simonw/blip-caption

From what I understand, what's most important to you is having a model that's already trained on something, rather than the architecture. Yolo is probably fine, as would be some of the older ones. You should be able to find a model that's been pretrained on COCO - you can look at see what classes are included. I don't know if there are other broadly trained models available that will serve your purpose. What I'd do is just run your picture through a COCO trained object detection model and see if the annotations do what you want. Though backing up a bit, there are also image captioning models that may better do what you want to do for organizing your photos. I'm not really familiar with any - though I did come across BLIP the other day but I haven't used it: https://github.com/salesforce/BLIP This may be a better way to get at what you wa