Machine Learning: Python & TypeScript Tips from Freelance Software Engineer

Sign in Subscribe

How to Fine-Tune Falcon LLM on Vast.ai with QLoRa and Utilize it with LangChain

How to Fine-Tune Falcon LLM on Vast.ai with QLoRa and Utilize it with LangChain

Today, I will show you how to fine-tune Falcon LLM on a single GPU with QLoRa. This is a demonstration of how to fine-tune the model for later use with LangChain. We will use misconceptions from the truthful_qa dataset available at Hugging Face. We will be fine-tuning the Falcon-7b-Instruct

LangChain + MPT-30B-Chat with TGI on Vast.ai

LangChain + MPT-30B-Chat with TGI on Vast.ai

Today, I'm going to guide you through running the quantized MPT-30B-Chat with text-generation-inference on a platform known as Vast.ai, and show you how to integrate it with LangChain. The notebook is available on GitHub notebooks/2023_07_08_mpt-30b-chat_langchain_vastai.ipynb at master · experienced-dev/notebooksExperienced Dev Blog Jupyter

Stoic ChatGPT Plugin: Inspiring Quotes for Modern Minds

Stoic ChatGPT Plugin: Inspiring Quotes for Modern Minds

I'm excited to announce that Stoic ChatGPT Plugin is now available in the plugin store! This plugin helps you to find stoic quotes for your text easily. Just type 'stoic', and the plugin finds a quote that is relevant to your input using a similarity search. Some example prompts to

Build Your Own ChatGPT Plugin with Your Data, Fast!

Build Your Own ChatGPT Plugin with Your Data, Fast!

Today, I will show you how to build a ChatGPT plugin using your custom data. Video version: First, I would like to show you what we are building. It is a simple plugin that finds a quote based on a search query. GitHub - experienced-dev/chatgpt-plugin-fastapi-langchain-chroma: An Example Plugin for

Turn 1¢ Into a Startup Idea & Landing Page Using LangChain & ChatGPT

Turn 1¢ Into a Startup Idea & Landing Page Using LangChain & ChatGPT

Today, I will show you how to turn 1 cent into a startup idea and a landing page draft. You can look at the code on GitHub or We are creating a PromptTemplate to generate the startup idea. Feel free to modify it if you want to generate ideas in

LangChain + Falcon-40B-Instruct on RunPod with Text Generation Inference

LangChain + Falcon-40B-Instruct on RunPod with Text Generation Inference

Today, I will show you how to operate Falcon-40B-Instruct, currently ranked as the best open LLM according to the Open LLM Leaderboard We will be running Falcon on a service called RunPod. For hardware, we are going to use 2x NVIDIA A100 80GB GPUs. To fully utilize the GPUs, we

Falcon-7B-Instruct - The Open-Source ChatGPT Alternative with LangChain on Google Colab

Falcon-7B-Instruct - The Open-Source ChatGPT Alternative with LangChain on Google Colab

Today, I'll show you how to run the Falcon 7b instruct model with LangChain on the free Google Colab. Video version: The Falcon-7b model is now licensed under the Apache 2.0 license, making it free for commercial use. It is developed by the Technology Innovation Institute and its bigger

Microsoft FY23 Q1: Earnings Breakdown & AI Insights with Custom Questions using LangChain & OpenAI

Microsoft FY23 Q1: Earnings Breakdown & AI Insights with Custom Questions using LangChain & OpenAI

Today I am going to show what I've learned from Microsoft's 2023 Q1 earnings report. You can watch a video version: ⚠️ Disclaimer: It is educational content, for financial advice seek a professional licensed in your jurisdiction. I described my process of fundamental analysis in a previous post. I often look

How to calculate basic EPS(Earnings Per Share) from EDGAR API with pandas

How to calculate basic EPS(Earnings Per Share) from EDGAR API with pandas

Today I will show you how to calculate a financial metric called basic Earnings Per Share (EPS). Click here if you are not sure what EPS is. Imagine a pie representing a company's profits. Divide this pie into slices, each representing one share of the company. The size of the

Earnings Report Insights: Alphabet's Q1 2023 10-Q MD&A Summary + Custom Questions with LangChain and OpenAI

Earnings Report Insights: Alphabet's Q1 2023 10-Q MD&A Summary + Custom Questions with LangChain and OpenAI

Today I will show you what I've learned from Management Discussion and Analysis (MD&A) section of Alphabet's Q1 2023 10-Q form. ⚠️ Disclaimer: It is educational content, for financial advice seek a professional licensed in your jurisdiction. If you need to know what form 10-Q is please read my previous

Earnings Report Insights: Programmer Decodes Coca-Cola's Q1 2023 10-Q Form

Earnings Report Insights: Programmer Decodes Coca-Cola's Q1 2023 10-Q Form

⚠️ Disclaimer: It is educational content, for financial advice seek a professional licensed in your jurisdiction. Today I will show you what I've learned from Coca-Cola's first quarter report. Click if you need to know what 10-Q Form is. It is a financial report, that U.S. publicly traded companies are

Build your own AI-Powered chat app with Next.js and LangChain

Build your own AI-Powered chat app with Next.js and LangChain

Today I will show how to build an AI-powered chat application with Next.js and LangChain. App features: * You could set an AI persona for your chat * You could send a message and get a streaming response from LLM * It auto-scrolls the received message into view. * The chat model has

Integrate Large Language Models in your project with LangChain #1

Integrate Large Language Models in your project with LangChain #1

Integrating Large Language Models in your business is challenging. The main pain points are: 1. Existing systems - most systems were not designed to handle the amounts of data ingested and outputted by LLMs. 2. Bias: if a biased LLM is asked, "Who is better at [task]?", it might respond,