semantic-router

Had stumbled on this library in the past https://github.com/aurelio-labs/semantic-router I guess it is based on the same fundamentals as well.

there's RouteLLM: https://github.com/lm-sys/RouteLLM nvidia has LLMRouter https://build.nvidia.com/nvidia/llm-router llama-index also supports routing https://docs.llamaindex.ai/en/stable/examples/low_level/rout... semantic router seems interesting https://github.com/aurelio-labs/semantic-router/ you could also just use langchain to route https://jimmy-wang-gen-ai.medium.com/llm-router-in-langchain... interesting paper PickLLM: Context-Aware RL-Assisted Large Language Model Routing https://arxiv.org/abs/2412.12170

Built my own expense tracker on top of Teable. I’m partly lucky because I live in Taiwan and almost any receipt here comes with itemised breakdown as a QR code, so I can scan that from my phone and pipe it off to a queue for ingestion Didn’t want to use LLMs, but wanted automated categorisation of transactions, did that with some vector embeddings and Semantic Router (https://github.com/aurelio-labs/semantic-router). … oh and it’s run off a RPi, yes the embeddings as well

Thanks for sharing! These are useful toos, but they are a bit different, more based on similarity search in prompt space (a bit like semantic router: https://github.com/aurelio-labs/semantic-router). Our router uses a neural network for the routing decisions, and it can be trained on your own prompts [https://youtu.be/9JYqNbIEac0]. We're also adding support for on-prem deployment soon!