From 15GB to 4.7GB: Quantizing AI Models Locally
13:42
From 15GB to 4.7GB: Quantizing AI Models Locally
7.6K views1 month ago
YouTubeNeuralNine
How to Run 70B LLMs Locally on RTX 3090 OR 4060 - AQLM
13:18
Find in video from 01:00Overview of AQLM Method
How to Run 70B LLMs Locally on RTX 3090 OR 4060 - AQLM
4.3K viewsFeb 8, 2024
YouTubeFahd Mirza
Deep Dive: Quantizing Large Language Models, part 1
40:28
Find in video from 34:50bitsandbytes
Deep Dive: Quantizing Large Language Models, part 1
23.1K viewsMar 6, 2024
YouTubeJulien Simon
Deep Dive: Quantizing Large Language Models, part 2
27:13
Find in video from 07:00Group-wise Precision Tuning Quantization (GPTQ)
Deep Dive: Quantizing Large Language Models, part 2
4.4K viewsMar 6, 2024
YouTubeJulien Simon
Optimize Your AI - Quantization Explained
12:10
Optimize Your AI - Quantization Explained
465.1K viewsDec 28, 2024
YouTubeMatt Williams
2-bit Quantization is Magical! See How to Run Mixtral-8x7B on Free-tier Colab
12:05
Find in video from 02:31Performance of AQLM 2bit Model
2-bit Quantization is Magical! See How to Run Mixtral-8x7B on Free-t…
875 viewsFeb 21, 2024
YouTubeYeyu Lab
LLM Quantization Explained Simply! | 8-bit vs 16-bit #ai #machinelearning #programming #llm #viral
1:21
LLM Quantization Explained Simply! | 8-bit vs 16-bit #ai #machinelearni…
4.5K views9 months ago
YouTubeNull Type
22:35
GLM 5.1 at 2-Bit?! 🤯 Can Local AI Extreme Quantisation Be GOOD?
10.4K views1 month ago
YouTubexCreate
10:09
TurboQuant Explained: 3-Bit KV Cache Quantization
866 views3 weeks ago
YouTubeTales Of Tensors
0:44
Quantization: What Everyone Gets Wrong (Accuracy Myths)
65 views2 weeks ago
YouTubeCode & Capital
0:45
Quantization Explained: How LLMs Get Smaller and Faster
88 views1 month ago
YouTubeDev Alpha Lab
8:04
The Engineering of LLM: Building Quantization from Float32 to 4-Bit
37 views1 month ago
YouTubeLLMagic
26:26
Quantizing LLMs - How & Why (8-Bit, 4-Bit, GGUF & More)
25K viewsNov 18, 2024
YouTubeAdam Lucek
13:07
Quantization Process Explained | Basics, Waveforms, Parameters, a…
5.2K views7 months ago
YouTubeEngineering Funda
7:29
Model Quantization Explained 8 bit, 4 bit & Inference Optimization #ge…
32 views2 months ago
YouTubeSmartSkale
5:17
IF4: Adaptive 4-bit quantization for LLMs
56 views1 month ago
YouTubeAI Research Roundup
30:14
LLM Quantization Explained: GPTQ, AWQ, QLoRA, GGUF and More
1.2K views2 months ago
YouTubeTales Of Tensors
11:01
ADC Sampling Rate, Quantization & Bit Rate Calculation - Step by Step
579 views3 months ago
YouTubeWylly Rhichy
59:04
LLM Quantization Techniques Explained - GPTQ AWQ GGUF HQ…
584 views10 months ago
YouTubeJoydeep Bhattacharjee
1:36
Pay less for LLM inference (Tip #2: Quantization)
1.3K views3 months ago
YouTubeDigitalOcean
1:36
What Is Quantization? | Decoding LLM File Names
1.3K views4 months ago
YouTubeAnaconda, Inc.
14:35
From Waves to Bits: Understanding Quantization, Encoding, and ADC …
334 views6 months ago
YouTubeLearnHub
19:07
Quantum Characterization, Benchmarking, and Mitigation
52 views6 months ago
YouTubeNERSC
3:39
Digital Coding of Quantized Signals (Simple Guide)
369 views5 months ago
YouTubeNumeryst
22:22
This New Method Just Killed RAM Limitations
93.3K views1 month ago
YouTubeAI News & Strategy Daily | Nate B Jones
2:12:21
LLM Fine-Tuning 12: LLM Quantization Explained( PART 1) | …
7.7K views9 months ago
YouTubeSunny Savita
3:21:13
LLM Fine-Tuning 13: LLM Quantization Explained (PART 2) | …
5.1K views7 months ago
YouTubeSunny Savita
58:43
LLMs Quantization Crash Course for Beginners
5.9K viewsMay 19, 2024
YouTubeAI Anytime
45:42
Quantization in vLLM: From Zero to Hero
1.4K views9 months ago
YouTubeSiemens Knowledge Hub
1:22
What is quantization? | Why essential for LLM deployment? #S…
8.8K views6 months ago
YouTubeGeeksforGeeks
See more videos
Static thumbnail place holder