From 81b8674085298a836a1e48eed2c9a850f4e28fa0 Mon Sep 17 00:00:00 2001 From: Leah Karasek Date: Tue, 4 Mar 2025 11:48:10 -0800 Subject: [PATCH] Update README to run sudo apt-get update and specify directories When running `sudo apt install python3.10-venv` in Step 2 on a fresh TPU, I got an error prompting me to run `sudo apt-get update`. Added a step to run `sudo apt-get update` first. Also, the `bash download.sh` script in step 3 must be run from the ~/maxtext/llama directory, but if you follow the instructions, you'd be in the ~/maxtext directory. Added a step to change directories first. Similarly, `gsutil cp -r llama/llama-2-7b/* ${CHKPT_BUCKET}` must be run from ~/maxtext. Added a step to change back to ~/maxtext first. --- inference/trillium/JetStream-Maxtext/Llama2-7B/README.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/inference/trillium/JetStream-Maxtext/Llama2-7B/README.md b/inference/trillium/JetStream-Maxtext/Llama2-7B/README.md index a74b4ed..14a5dcd 100644 --- a/inference/trillium/JetStream-Maxtext/Llama2-7B/README.md +++ b/inference/trillium/JetStream-Maxtext/Llama2-7B/README.md @@ -16,6 +16,7 @@ git checkout main ## Step 2: Setup JetStream and MaxText ```bash cd ~ +sudo apt-get update sudo apt install python3.10-venv python -m venv venv-maxtext source venv-maxtext/bin/activate @@ -36,17 +37,18 @@ bash setup.sh ```bash # Go to https://llama.meta.com/llama-downloads/ and fill out the form git clone https://github.com/meta-llama/llama +cd ~/maxtext/llama bash download.sh # When prompted, choose 7B. This should create a directory llama-2-7b inside the llama directory export CHKPT_BUCKET=gs://... export MAXTEXT_BUCKET_SCANNED=gs://... export MAXTEXT_BUCKET_UNSCANNED=gs://... +cd ~/maxtext gsutil cp -r llama/llama-2-7b/* ${CHKPT_BUCKET} # Checkpoint conversion -cd maxtext bash ../JetStream/jetstream/tools/maxtext/model_ckpt_conversion.sh llama2 7b ${CHKPT_BUCKET} ${MAXTEXT_BUCKET_SCANNED} ${MAXTEXT_BUCKET_UNSCANNED} # The path to the unscanned checkpoint should be set by the script, but set it explicitly if it hasn't