Tools to go from prototype to production — The Quick-start Guide Isn’t Enough “Retrieval augmented generation is the process of supplementing a user’s input to a large language model (LLM) like ChatGPT with additional information that you (the system) have retrieved from somewhere else. The LLM can then use that information to augment the response that it generates.” — Cory Zue LLMs are…

Vector Databases Vector databases, also known as vector storage or vector databases, are specialized databases designed to store and retrieve vector data efficiently. In the context of computer science and artificial intelligence, a vector refers to an array or list of numerical values that represent a point in a multi-dimensional space. Each…

Combining recursive retrieval and document agents for advanced retrieval — Let’s continue our exploration on building production-ready LLM apps with LlamaIndex. This time let’s focus on recursive document agents, developed by LlamaIndex co-founder and CEO Jerry Liu. Recursive Document Agent We explored data agent in our previous article Low-Code and No-Code Task Automation With LlamaIndex Data Agents, Zapier NLA, Snowflake, and Streamlit. Document…

GitHub Archive data analysis and task automation — LlamaIndex recently introduced Data Agents, LLM-powered knowledge workers that can intelligently perform various tasks over your data. Both LlamaIndex co-founders, Jerry Liu and Simon Suo, have written great blogs on this topic, Data Agents and Data Agents + Zapier NLA. In this article, let’s take a closer look at what…

Streamlining data ingestion and querying in Retrieval-Augmented Generation Applications — If you have been on vacation for the past six months, first of all, congratulations. Secondly, you should know that since the introduction of ChatGPT-like large language models (LLM), the technology ecosystem has changed dramatically. Nowadays, it’s all about retrieval-augmented generation (RAG) applications. The idea behind RAG applications is to…

An Introduction to LlamaIndex — LlamaIndex, previously known as the GPT Index, is a remarkable data framework aimed at helping you build applications with LLMs by providing essential tools that facilitate data ingestion, structuring, retrieval, and integration with various application frameworks. The capabilities offered by LlamaIndex are numerous and highly valuable: ✅ Ingest from…

Integrating Open Source LLMs and LangChain for Free Generative Question Answering (No API Key required) — In the past few months, Large Language Models (LLMs) have gained significant attention, capturing the interest of developers across the planet. These models have created exciting prospects, especially for developers working on chatbots, personal assistants, and content creation. The possibilities that LLMs bring to the table have sparked a wave…

In this tutorial, we bring you an easy-to-follow tutorial on how to train an AI chatbot using Streamlet for the front-end, and the chatbot powered by the LLM model, which we’ll access through API calls to the Llama 2 model hosted on Replicate. What is LLam2? Llama 2 is an open-source language model…

Llama 2 is the next generation of large language model (LLM) developed and released by Meta, a leading AI research company. It is pretrained on 2 trillion tokens of public data and is designed to enable developers and organizations to build generative AI-powered tools and experiences. Llama 2 outperforms other…

It was not hard, just tricky. — Meta’s newly open-sourced LLama 2 Chat model has been making waves on the OpenLLMs Leaderboard. This powerful language model is now available for anyone, even commercially. Intrigued, I decided to try implementing LLama 2 myself. …

Llama 2 is a family of open-source large language models released by Meta. They can be used for a variety of tasks, such as writing different kinds of creative content, translating languages, and sentiment analysis. Llama models come in two flavors — pre-trained and fine-tuned. …

In this article I will point out the key features of the Llama2 model and show you how you can run the Llama2 model on your local computer. If you like videos more, feel free to check out my YouTube video to this article: Wohoo, yesterday was a big…

In this article I will point out the key features of the Llama2 model and show you how you can run the Llama2 model on your local computer. If you like videos more, feel free to check out my YouTube video to this article: Wohoo, yesterday was a big…

A one command line tool to adapt a Falcon model to your data — The Falcon models are the large language models that are among the most popular now for various reasons: They are very good, especially at problem-solving They are smaller than other LLMs while performing better They are entirely free (Apache 2.0 License) They are available in several versions, including instruct-version that…