Skip to content

Commit 748a454

Browse files
author
Copybara
committed
Copybara import of gpu-recipes:
 - 7f9a398eb5021129f95efa20320ebda157103a56 Change naming convention to match names from bigquery GitOrigin-RevId: 7f9a398eb5021129f95efa20320ebda157103a56
1 parent 02faffe commit 748a454

34 files changed

+78
-74
lines changed

‎README.md‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -21,26 +21,26 @@ Welcome to the reproducible benchmark recipes repository for GPUs! This reposito
2121
Models | GPU Machine Type | Framework | Workload Type | Orchestrator | Link to the recipe
2222
----------------- | --------------------------------------------------------------------------------------------------------- | --------- | ------------- | ------------ | ------------------
2323
**GPT3-175B** | [A3 Mega (NVIDIA H100)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-mega-vms) | NeMo | Pre-training | GKE | [Link](./training/a3mega/gpt3-175b/nemo-pretraining-gke/README.md)
24-
**Llama-3-70B** | [A3 Mega (NVIDIA H100)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-mega-vms) | NeMo | Pre-training | GKE | [Link](./training/a3mega/llama-3-70b/nemo-pretraining-gke/README.md)
25-
**Llama-3.1-70B** | [A3 Mega (NVIDIA H100)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-mega-vms) | NeMo | Pre-training | GKE | [Link](./training/a3mega/llama-3.1-70b/nemo-pretraining-gke/README.md)
24+
**Llama-3-70B** | [A3 Mega (NVIDIA H100)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-mega-vms) | NeMo | Pre-training | GKE | [Link](./training/a3mega/llama3-70b/nemo-pretraining-gke/README.md)
25+
**Llama-3.1-70B** | [A3 Mega (NVIDIA H100)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-mega-vms) | NeMo | Pre-training | GKE | [Link](./training/a3mega/llama3-1-70b/nemo-pretraining-gke/README.md)
2626
**Mixtral-8-7B** | [A3 Mega (NVIDIA H100)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-mega-vms) | NeMo | Pre-training | GKE | [Link](./training/a3mega/mixtral-8x7b/nemo-pretraining-gke/README.md)
2727

2828
### Training benchmarks A3 Ultra
2929

3030
Models | GPU Machine Type | Framework | Workload Type | Orchestrator | Link to the recipe
3131
------------------ | ----------------------------------------------------------------------------------------------------------- | --------- | ------------- | ------------ | ------------------
32-
**Llama-3.1-70B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | MaxText | Pre-training | GKE | [Link](./training/a3ultra/llama-3.1-70b/maxtext-pretraining-gke/README.md)
33-
**Llama-3.1-70B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | NeMo | Pre-training | GKE | [Link](./training/a3ultra/llama-3.1-70b/nemo-pretraining-gke/README.md)
34-
**Llama-3.1-405B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | MaxText | Pre-training | GKE | [Link](./training/a3ultra/llama-3.1-405b/maxtext-pretraining-gke/README.md)
35-
**Llama-3.1-405B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | NeMo. | Pre-training | GKE | [Link](./training/a3ultra/llama-3.1-405b/nemo-pretraining-gke/README.md)
32+
**Llama-3.1-70B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | MaxText | Pre-training | GKE | [Link](./training/a3ultra/llama3-1-70b/maxtext-pretraining-gke/README.md)
33+
**Llama-3.1-70B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | NeMo | Pre-training | GKE | [Link](./training/a3ultra/llama3-1-70b/nemo-pretraining-gke/README.md)
34+
**Llama-3.1-405B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | MaxText | Pre-training | GKE | [Link](./training/a3ultra/llama3-1-405b/maxtext-pretraining-gke/README.md)
35+
**Llama-3.1-405B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | NeMo. | Pre-training | GKE | [Link](./training/a3ultra/llama3-1-405b/nemo-pretraining-gke/README.md)
3636
**Mixtral-8-7B** | [A3 Ultra (NVIDIA H200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a3-ultra-vms) | NeMo | Pre-training | GKE | [Link](./training/a3ultra/mixtral-8x7b/nemo-pretraining-gke/README.md)
3737

3838
### Training benchmarks A4 High
3939

4040
Models | GPU Machine Type | Framework | Workload Type | Orchestrator | Link to the recipe
4141
------------------ | ----------------------------------------------------------------------------------------------------------- | --------- | ------------- | ------------ | ------------------
42-
**Llama-3.1-405B** | [A4 High (NVIDIA B200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4-high-vms) | MaxText | Pre-training | GKE | [Link](./training/a4high/llama-3.1-405b/maxtext-pretraining-gke/README.md)
43-
**Llama-3.1-405B** | [A4 High (NVIDIA B200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4-high-vms) | NeMo | Pre-training | GKE | [Link](./training/a4high/llama-3.1-405b/nemo-pretraining-gke/README.md)
42+
**Llama-3.1-405B** | [A4 High (NVIDIA B200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4-high-vms) | MaxText | Pre-training | GKE | [Link](./training/a4high/llama3-1-405b/maxtext-pretraining-gke/README.md)
43+
**Llama-3.1-405B** | [A4 High (NVIDIA B200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4-high-vms) | NeMo | Pre-training | GKE | [Link](./training/a4high/llama3-1-405b/nemo-pretraining-gke/README.md)
4444

4545
### Inference benchmarks A3 Mega
4646

‎src/frameworks/a3mega/nemo-configs/llama3.1-70b-256gpus-bf16.yaml‎ renamed to ‎src/frameworks/a3mega/nemo-configs/llama3-1-70b-256gpus-bf16.yaml‎

File renamed without changes.

‎src/frameworks/a3ultra/maxtext-configs/llama-3.1-405b-1024gpus-a3u-fp8.yaml‎ renamed to ‎src/frameworks/a3ultra/maxtext-configs/llama3-1-405b-1024gpus-a3u-fp8.yaml‎

File renamed without changes.

‎src/frameworks/a3ultra/maxtext-configs/llama-3.1-405b-256gpus-a3u-fp8.yaml‎ renamed to ‎src/frameworks/a3ultra/maxtext-configs/llama3-1-405b-256gpus-a3u-fp8.yaml‎

File renamed without changes.

‎src/frameworks/a3ultra/maxtext-configs/llama-3.1-405b-512gpus-a3u-fp8.yaml‎ renamed to ‎src/frameworks/a3ultra/maxtext-configs/llama3-1-405b-512gpus-a3u-fp8.yaml‎

File renamed without changes.

‎src/frameworks/a3ultra/maxtext-configs/llama-3.1-405b-768gpus-a3u-fp8.yaml‎ renamed to ‎src/frameworks/a3ultra/maxtext-configs/llama3-1-405b-768gpus-a3u-fp8.yaml‎

File renamed without changes.

‎src/frameworks/a3ultra/maxtext-configs/llama-3.1-70b-1024gpus-a3u-fp8-gbs2048.yaml‎ renamed to ‎src/frameworks/a3ultra/maxtext-configs/llama3-1-70b-1024gpus-a3u-fp8-gbs2048.yaml‎

File renamed without changes.

‎src/frameworks/a3ultra/maxtext-configs/llama-3.1-70b-256gpus-a3u-bf16.yaml‎ renamed to ‎src/frameworks/a3ultra/maxtext-configs/llama3-1-70b-256gpus-a3u-bf16.yaml‎

File renamed without changes.

‎src/frameworks/a3ultra/maxtext-configs/llama-3.1-70b-256gpus-a3u-fp8.yaml‎ renamed to ‎src/frameworks/a3ultra/maxtext-configs/llama3-1-70b-256gpus-a3u-fp8.yaml‎

File renamed without changes.

‎src/frameworks/a3ultra/maxtext-configs/llama-3.1-70b-512gpus-a3u-bf16.yaml‎ renamed to ‎src/frameworks/a3ultra/maxtext-configs/llama3-1-70b-512gpus-a3u-bf16.yaml‎

File renamed without changes.

0 commit comments

Comments
 (0)