Faster LLM fine-tuning with Unsloth and using QLORA technique for memory reduction

Introduction In this article I have explained how to fine-tune Llama 3.1 8B model using QLoRA technique. In the previous article I explained about using full-tuning and LoRA to fine-tune the model...

Jul 7, 2024 Projects, LLMs

Fine-tune LLM using Reinforcement Learning from Human Feedback (RLHF)

Introduction In this blog, I have discussed how to fine-tune LLM to generate less toxic content with Meta AI’s hate speech reward model. The reward model is a binary classifier that predicts eithe...

May 10, 2024 Projects, LLMs

Dialogue summarization using zero shot, one shot and few shot inferences

Dialogue Summarization using LLMs In this blog I have discussed about dialogue summarization using LLMs. I have explored different techniques such as zero shot , one shot and few shot inferences. ...

Feb 10, 2024 Projects, LLMs

Full fine-tuning & PEFT techniques with LLMs

Dialogue summarization using full fine-tuning & PEFT techniques with LLMs This is my first blog. (Yay!) I’m jumping on the bandwagon to kickstart a series of blog articles all about ML and sha...

Feb 9, 2024 Projects, LLMs

Faster LLM fine-tuning with Unsloth and using QLORA technique for memory reduction

Fine-tune LLM using Reinforcement Learning from Human Feedback (RLHF)

Dialogue summarization using zero shot, one shot and few shot inferences

Full fine-tuning & PEFT techniques with LLMs

Trending Tags