Tutorial
Download the tokenizer from the official grok-1 repository.
wget
https://github.com/xai-org/grok-1/raw/main/tokenizer.model
Run inference scripts
./run_inference_fast.sh hpcaitech/grok-1 tokenizer.model
Model weights will be downloaded and loaded automatically.
More details can be found in:
https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/grok-1
Colossal-AI will further introduce optimizations for Grok-1 in parallel acceleration, quantitative reduction of cost, etc. in the near future. Welcome to stay tuned.
Colossal-AI open source address:
https://github.com/hpcaitech/ColossalAI