- pytorch
- transformer
- docker
- LLM
- machine learning
- engineering
- research
•
•
•
•
•
•
-
LLMs Efficient Inference with KV-cache
KV-cache in Large Language Models and its implementation (GPT-2 model as an example)
-
Container for Deep Learning Environment
containerizing and deploying deep learning environments (e.g., Docker, Apptainer)
-
ViT model from scratch
a step-by-step implementation of Vision Transformer (ViT) model introduced in the paper ``An Image is Worth 16x16 Words Transformers for Image Recognition at Scale`` (ICLR 2021) with PyTorch.
-
Transformer model from scratch
a step-by-step implementation of Transformer model introduced in the paper ``Attention is All You Need`` (NeurIPS 2017) with PyTorch.
-
Distributed Training with PyTorch
a summary of some experiences about distributed training with PyTorch.