RunPod

Run ANY LLM Using Cloud GPU and TextGen WebUI (aka OobaBooga)

In this video, I'll show you how to use RunPod.io to quickly and inexpensively spin up top-of-the-line GPUs so you can run any large language model. It's super easy, and you can run even the largest models such as Guanaco 65b. This also includes a tutorial on Text Generation WebUI (aka OobaBooga), which is like Automatic1111 but for LLMs. Basically, an open-source interface for your LLM. Enjoy :) Join My Newsletter for Regular AI Updates 👇🏼 https://forwardfuture.ai/ My Links 🔗 👉🏻 Subscribe: https://www.youtube.com/@matthew_berman 👉🏻 Twitter: https://twitter.com/matthewberman 👉🏻 Discord: https://discord.gg/xxysSXBxFW 👉🏻 Patreon: https://patreon.com/MatthewBerman Media/Sponsorship Inquiries 📈 https://bit.ly/44TC45V Links: Runpod (Affiliate)- https://bit.ly/3OtbnQx Runpod The Bloke Template - https://runpod.io/gsc?template=qk29nkmbfr&ref=54s0k2f8 HuggingFace - https://www.huggingface.co Guanaco Model - https://huggingface.co/TheBloke/guanaco-65B-GPTQ TextGen WebUI - https://github.com/oobabooga/text-generation-webui

Build and Deploy an AI Chatbot Using LLMs, Python, RunPod, Hugging Face, and React Native

RunPod: https://rebrand.ly/Runpod-Abdullah 🚀 Introduction: ================================ In this tutorial, we’ll build and deploy a complete coffee shop customer service AI chatbot that takes orders, provides menu info, blocks irrelevant conversations, and even recommends products based on Market Basket Analysis! We'll cover cutting-edge topics like Prompt Engineering, Retrieval-Augmented Generation (RAG), and the modular power of Agent-Based Systems. You'll also learn how to deploy Large Language Models (LLMs) and custom APIs using RunPod, and build a full React Native app that connects to Firebase and the RunPod endpoints. By the end, you’ll have a fully functional chatbot app and level up your AI, development, and deployment skills! 🔄 Update: Runpod seems to have changed the place to access the openAI URL here it is: https://api.runpod.ai/v2/{RUNPOD_ENDPOINT_ID}/openai/v1 and the RunPod endpoint ID is the string right under the endpoint name. here is a link for more information: https://docs.runpod.io/serverless/workers/vllm/openai-compatibility 💡 What You’ll Learn: ================================ 1. 🧠 Prompt Engineering: Guide your chatbot with precise instructions. 2. 🔍 Retrieval-Augmented Generation (RAG): Enhance chatbot answers using personalized data. 3. 🛠️ Agent-Based Systems: Create specialized components for efficient and accurate chatbot responses. 4. 📊 Market Basket Analysis Recommendation Engine: Build a recommendation engine from scratch. 5. 🖥️ RunPod Deployment: Deploy LLMs, embedding models, and custom APIs effortlessly. 6. 📱 React Native App: Build an end-to-end mobile app connected to Firebase and RunPod. 🔗 Links: ================================ RunPod: https://rebrand.ly/Runpod-Abdullah Github Repo: https://github.com/abdullahtarek/coffee_shop_customer_service_chatbot Coffee Shop Transactions Kaggle Dataset Link: https://www.kaggle.com/datasets/ylchang/coffee-shop-sample-data-1113 🎁 Free Credit Codes: ================================ Grab one of the 20 credit codes in the description to get free credits on RunPod! How to Redeem: Go to the left panel, click on Billing, scroll down to Credit Codes, and paste one of the codes below. 1602zubevdxd7xbzm4ap mpbictqmksolp73td4mq opruk1yoqatfc1jw2nry 7l6kusubtdy3cb95906t 7rhjrmch9ilvnwd3dt0r oiykzqwrk2vhqgkvyh8c 4s5vjcl2irojl1bnkh89 vn7wpd7jkpdnamq3q516 6st9nt72etun8xcvlb6j svsg0g0fjiuozkaam82t 8kjapravfr1se22126it 6itba529k8083pm15dtj oy9k1wombmml0pyoo1ba vyoryb2v9q4tr58etfjh v6smwvna8c10racrv5si 🔑 TIMESTAMPS ================================ 0:00 - Introduction 5:27 - Deploy Llama LLM with RunPod 30:15 - Prompt Engineering Tutorial 52:00 - RAG Introduction 1:15:35 - Recommendation engine Development 2:17:20 - Firebase DB setup 2:47:10 - Pinecone Vector DB setup 3:13:13 - Agent Based System 5:49:20 - Deploy chatbot API with RunPod 6:15:31 - React Native application Front End 11:14:30 - ChatBot React Native Page

1-Minute Guide to Installing Falcon-40B LLM on RunPod.io #falcon40b #openllm #ai #artificialintelligence #hermes13b #runpodio #llm #learnai LLM Model: https://huggingface.co/TheBloke/falcon-40b-instruct-GPTQ RunPod IO Template: TheBloke Local LLMs One-Click UI Troubleshooting: - If the server does not restart correctly. Rebuild and unload the Falcon-40b every time you shutdown. - Make sure you run the TheBloke Local LLMs One-Click UI template for the server. - If you resume the server and no GPU is available. Just try again later, or rebuild on a new server (Doesn't take long).