BayJarvis: Blogs on mllm

paper MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training - 2024-03-17

In this work, we discuss building performant Multimodal Large Language Models (MLLMs). Through careful and comprehensive ablations of the image encoder, the vision language connector, and various pre-training data choices, we identified several crucial design lessons: …

llm Unleashing Dual Power: Switching Seamlessly Between Zephyr & Mistral 7B Models in Multiple LLMs - 2023-11-09

In today's rapidly growing world of conversational AI, developers often seek ways to leverage multiple models seamlessly to diversify outputs and enhance user experience. One such scenario involves using different Local Language Models (LLMs) to serve different purposes or to offer a variety of responses. In this article, we'll explore a method to set up and switch between multiple local LLMs, particularly Zephyr and Mistral 7B, using the Chainlit and Langchain libraries. …