721 57 257

Younes Belkada

ybelkada

AI & ML interests

Large Language Models, Quantization, Vision, Multimodality, Diffusion models

Articles

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 79

Introducing RWKV — An RNN with the advantages of a transformer

May 15, 2023

• 12

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Apr 5, 2023

• 15

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Mar 9, 2023

• 29

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

Aug 17, 2022

• 56

Organizations

Posts 4

Post

2043

Falcon Mamba now available now in llama.cpp !
Check out GGUF files uploaded here: tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a

Post

2899

FalconMamba 7B - a new model from TII (Technology Innovation Institute) is out !

- Blogpost: https://huggingface.co/blog/falconmamba
- Link to collection: tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a
- Link to playground: tiiuae/falcon-mamba-playground

View all posts

Collections 1

Papers 7

spaces 25

Sleeping

🦙

GGUF My Repo

No application file

👀

Test Zero

Sleeping

🐠

Dlai Test 2

No application file

🚀

Blip Imagecaptioning Dlai

Running

⚡

Open Source List Models

Running on Zero

🌖

Llava 1.5 Dlai

models 143

ybelkada/test-gguf-trainer-Q8_0-GGUF

Updated May 28 • 5

ybelkada/test-gguf-trainer

Text Generation • Updated May 28 • 8 • 1

ybelkada/tiny-random-llama-Q6_K-GGUF

Updated May 28 • 9

ybelkada/test-gguf-trainer-Q4_K_M-GGUF

Updated May 27 • 13

ybelkada/tiny-random-llama-Q4_K_M-GGUF

Updated May 22 • 6

ybelkada/tiny-random-llama

Text Generation • Updated May 22 • 3

ybelkada/TinyLlama-1.1B-Chat-v1.0-Q4_0-GGUF

Updated Apr 12 • 28 • 1

ybelkada/test-llava-13b

Image-Text-to-Text • Updated Apr 10

ybelkada/blip-image-captioning-base-football-finetuned

Other • Updated Apr 10 • 120 • 2

ybelkada/falcon-7b-sharded-bf16

Text Generation • Updated Apr 10 • 5.24k • 20

datasets 12

ybelkada/model_cards_correct_tag

Viewer • Updated Mar 19 • 54 • 7

ybelkada/model-info-library-name

Updated Jan 23 • 4

ybelkada/test-model-info-library-name

Viewer • Updated Jan 23 • 1 • 4

ybelkada/documentation-images

Viewer • Updated Jan 19 • 2 • 2

ybelkada/oasst1-tiny-subset

Viewer • Updated May 11, 2023 • 44.1k • 2 • 2

ybelkada/oasst1

Viewer • Updated May 11, 2023 • 44.1k • 2 • 1

ybelkada/food101-tiny

Viewer • Updated May 5, 2023 • 100 • 5

ybelkada/test-onepiece-dataset

Viewer • Updated May 5, 2023 • 10 • 2

ybelkada/common_voice_mr_11_0_copy

Viewer • Updated Apr 4, 2023 • 10.8k • 121

ybelkada/english_quotes_copy

Viewer • Updated Apr 4, 2023 • 2.51k • 1.1k

Younes Belkada

AI & ML interests

Articles

Welcome FalconMamba: The first strong attention-free 7B model

Welcome Llama 3 - Meta's new open LLM

GaLore: Advancing Large Model Training on Consumer-grade Hardware

quanto: a pytorch quantization toolkit

Fine-Tuning Gemma Models in Hugging Face

Mixture of Experts Explained

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

Overview of natively supported quantization schemes in 🤗 Transformers

Making LLMs lighter with AutoGPTQ and transformers

Fine-tune Llama 2 with DPO

The Falcon has landed in the Hugging Face ecosystem