Educational

How to Use PEFT with Llama 2 for Model Inference

This guide will help you understand how to set up and use the PEFT (Parameter-Efficient Fine-Tuning) model using the Llama-2-7b for inference. Whether you're a beginner or an experienced developer, we will break down the process into easy-to-follow steps. Let's dive...

How to Utilize the PEFT Library for FinGPT Forecasting

How to Utilize the PEFT Library for FinGPT Forecasting

In this article, we will guide you through the wonderful journey of using the PEFT (Parameter-Efficient Fine-Tuning) library alongside the FinGPT forecasting model. By the end of this guide, you’ll be armed with the knowledge to harness this powerful tool for your own...

How to Create Your Own Custom GPT Using the GPT Crawler

How to Create Your Own Custom GPT Using the GPT Crawler

Are you looking to create a custom GPT (Generative Pre-trained Transformer) from specific websites? The GPT Crawler is a fantastic tool that allows you to crawl a website and generate knowledge files to train your own model. In this post, we'll walk you through the...

Llama-3-8B-Instruct-80K-QLoRA-Merged: A User Guide

Llama-3-8B-Instruct-80K-QLoRA-Merged: A User Guide

In this blog post, we'll delve into the remarkable capabilities of the Llama-3-8B-Instruct model, specifically its extension to handle a context length of up to 80,000 tokens using QLoRA. Let's explore how to get started with this versatile text generation model,...