YouTube Videos (2025)

Technical Videos

Machine Learning & Deep Learning

  1. Transformer and Its Use in RecSys (12:37)
    • Published: Apr 27, 2025
    • Views: 53
    • Likes: 6
  2. Understanding Linformer (12:26)
    • Published: Apr 20, 2025
    • Views: 353
    • Likes: 14
    • Content:
      • Attention recap: 00:00:17
      • Attention complexity analysis: 00:01:01
      • LinFormer theorem 1: 00:02:38
      • Theorem1 math proof: 00:04:40
      • Theorem1 empirical proof: 00:06:29
      • LinFormer theorem 2: 00:07:44
      • Tuning Techniques: 00:09:19
      • Experiment Results: 00:10:37
      • Conclusion: 00:11:43
  3. Attention Part1 (9:58)
    • Published: Mar 9, 2025
    • Views: 114
    • Likes: 10
    • Content:
      • Sequential data problem: 0:33
      • Evolution: 1:16
      • Attention intuition: 3:48
      • MHA: 6:23
      • MQA: 7:16
      • GQA: 8:07

PyTorch & GPU Optimization

  1. PyTorch Dataset Memory Duplicate Problem & Its Cure (8:23)
    • Published: Feb 16, 2025
    • Views: 37
    • Likes: 5
    • Content:
      • Problem deep dive: 0:19
      • Solution1: forkserver: 5:14
      • Solution2: iterable dataset: 7:19
      • When to use what?
  2. Understanding Low GPU Usage And The Cure (3:59)
    • Published: Feb 9, 2025
    • Views: 29
    • Likes: 5
    • Description: Understanding why your GPU utilization rate is low. Even after adding more worker to data loader doesn’t help! The cure is to decouple CPU and GPU resources.
  3. Pytorch Part1: Build a Bare Minimum Text Classification Model (22:32)
    • Published: Jan 20, 2025
    • Views: 43
    • Likes: 5
    • Content:
      • Step1: download data and data exploration: 0:46
      • Step2: build vocab: 5:16
      • Step3: dataset & dataloader: 6:57
      • Step4: model: 10:21
      • Step5: loss function: 15:28
      • Step6: optimizer: 17:58
      • Step7: train loop: 18:26
      • Step8: evaluation: 20:44

Cloud & Infrastructure

  1. Creating GPU VM in AWS (8:37)
    • Published: Jan 5, 2025
    • Views: 125
    • Likes: 7
    • Description: A step-by-step guide on how to create GPU VM in AWS EC2.

Large Language Models

  1. LLM Gestalt: From ChatGPT to Silicon (5:46)
    • Published: Feb 2, 2025
    • Views: 50
    • Likes: 7
    • Content:
      • Intro: LLM Pipeline: 0:50
      • Skills & Jargon: 2:32
      • Major Player: 3:59
    • Note: Focus on application layer for most developers. Skills and tools include: RAG/LangChain/LlamaIndex/VLLM

Personal Content

  1. Let’s chat about Dune (5:43)
    • Published: Mar 9, 2025
    • Views: 91
    • Likes: 8
    • Content:
      • Paul’s physical training: 0:32
      • Paul’s mental training: 2:01
      • Body and mind: 3:38
      • Hardship: 4:34
  2. Debugging my 2024 Self (3:59)
    • Published: Jan 25, 2025
    • Views: 57
    • Likes: 6
    • Links:
      • Full recap of 2024: https://xuanguo.com/2025/01/25/2024-recap-2025-forward.html
      • 2025 goals: https://xuanguo.com/about/