Apple silicon에서도 pytorch에서의 gpu acceleartion이 적용됐다. 이참에 사용하는 프레임워크에서 gpu acceleartion을 사용하는 방법들을 정리하고자 한다.

Pytorch

2022-05-20 기준.

Pytorch 1.12를 설치하면 된다. Nightly build에서만 작동한다.

1
import torch
2
import torchvision.models as models
3
from torchsummary import summary
4

5
print(torch.__version__)
6
mps_device = torch.device("mps")
7

8
print(mps_device)
9

10
# Create a Tensor directly on the mps device
11
x = torch.ones((1, 3, 224, 224), device=mps_device)
12
print(x.shape)
13

14
# Move your model to mps just like any other device
15
model = models.resnet18()
16
summary(model, (3, 244, 244))
17
model.to(mps_device)
18

19
# Now every call runs on the GPU
20
pred = model(x)
21

22
print(pred, pred.shape)

HuggingFace

pip, conda로 설치가 안되므로 직접 빌드해야 한다. rust tokenizer를 사용했다.

# install rust on arm terminal
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh


# intsall tokenizer
git clone https://github.com/huggingface/tokenizers
cd tokenizers/bindings/python
pip install setuptools_rust
python setup.py install

# install transformers
pip install git+https://github.com/huggingface/transformers

# install datasets
pip install git+https://github.com/huggingface/datasets

1
from transformers import AutoTokenizer, BertModel
2

3
device = "mps"
4
sentence  = 'Hello World!'
5
tokenizer = AutoTokenizer.from_pretrained('bert-large-uncased', use_fast=True)
6
model     = BertModel.from_pretrained('bert-large-uncased')
7

8
inputs    = tokenizer(sentence, return_tensors="pt").to(device)
9
model     = model.to(device)
10
outputs   = model(**inputs)
11
print(outputs)

m1 gpu acceleration

Pytorch

HuggingFace

Ref