---
title: Grok-1 of PyTorch + HuggingFace version is now available!
description: Colossal-AI team followed up Grok-1 at the first time and provided an easy-to-use Python + PyTorch + HuggingFace version of Grok-1 for all AI developers.
---

[Blog - Colossal-AI ](https://company.hpc-ai.com/blog)

# [Grok-1 of PyTorch + HuggingFace version is now available!](https://company.hpc-ai.com/blog/grok-1-of-pytorch-huggingface-version-is-now-available)

 Written by [Team](https://company.hpc-ai.com/blog/author/team) | Mar 22, 2024 7:07:47 AM

Grok-1, the **314-billion-parameter** Mixture of Experts (MoE) model open-sourced by Musk's xAI, is the largest open-source large language model, and allows for free distribution and commercialization of changes.

 

Grok-1 has attracted a lot of attention in the open source community since its release, and has been ranked No. 1 in the world on the GitHub Trending.

However, **Grok-1 is built using ****Rust****+JAX**, which has a high threshold for users who are used to mainstream software ecosystems such as Python+PyTorch+HuggingFace to get started.

 

Colossal-AI team followed up immediately and provided an **easy-to-use Python + ****PyTorch**** + HuggingFace version of Grok-1** for all AI developers.

 

Grok-1 greedy search test

 

HuggingFace Download:

[https://huggingface.co/hpcai-tech/grok-1](https://huggingface.co/hpcai-tech/grok-1)

 

### **Tutorial**

 

Download the tokenizer from the official grok-1 repository.

 

`wget` `https://github.com/xai-org/grok-1/raw/main/tokenizer.model`

 

Run inference scripts

 

`./run_inference_fast.sh hpcaitech/grok-1 tokenizer.model`

```
 
```

Model weights will be downloaded and loaded automatically.

More details can be found in:

**https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/grok-1**

 

Colossal-AI will further introduce optimizations for Grok-1 in parallel acceleration, quantitative reduction of cost, etc. in the near future. Welcome to stay tuned.

 

Colossal-AI open source address:

** https://github.com/hpcaitech/ColossalAI**

 

[View full post](https://company.hpc-ai.com/blog/grok-1-of-pytorch-huggingface-version-is-now-available)

```json
{
  "@context" : "http://schema.org",
  "@type" : "BlogPosting",
  "author" : {
    "@type" : "Person",
    "name" : "Team"
  },
  "dateModified" : "2024-03-22T08:41:38.283Z",
  "datePublished" : "2024-03-22T07:07:47Z",
  "headline" : "Grok-1 of PyTorch + HuggingFace version is now available!",
  "image" : {
    "@type" : "ImageObject",
    "height" : 762,
    "url" : "https://26563514.fs1.hubspotusercontent-eu1.net/hubfs/26563514/20240322-134030-1.jpg",
    "width" : 1015
  },
  "mainEntityOfPage" : "https://company.hpc-ai.com/blog/grok-1-of-pytorch-huggingface-version-is-now-available",
  "publisher" : {
    "@type" : "Organization",
    "logo" : {
      "@type" : "ImageObject",
      "height" : 60,
      "url" : "/hs/hsstatic/content_shared_assets/static-1.4092/img/default-amp-logo.png",
      "width" : 60
    },
    "name" : "Blog - Colossal-AI"
  }
}
```