Skip to content

Commit 2ca105a

Browse files
marcenacpThe TensorFlow Datasets Authors
authored andcommitted
Change imagenet_v2 URLs.
In modestyachts/ImageNetV2#12, the author of the dataset warns that they uploaded all the resources to the Hugging Face hub. PiperOrigin-RevId: 523369004
1 parent 15c92de commit 2ca105a

File tree

3 files changed

+7
-6
lines changed

3 files changed

+7
-6
lines changed

docs/overview.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -675,7 +675,7 @@
675675
"\n",
676676
"To find out which urls to download, look into:\n",
677677
"\n",
678-
" * For new datasets (implemented as folder): [`tensorflow_datasets/`](https://github.com/tensorflow/datasets/tree/master/tensorflow_datasets/)`\u003ctype\u003e/\u003cdataset_name\u003e/checksums.tsv`. For example: [`tensorflow_datasets/text/bool_q/checksums.tsv`](https://github.com/tensorflow/datasets/blob/master/tensorflow_datasets/text/bool_q/checksums.tsv).\n",
678+
" * For new datasets (implemented as folder): [`tensorflow_datasets/`](https://github.com/tensorflow/datasets/tree/master/tensorflow_datasets/)`\u003ctype\u003e/\u003cdataset_name\u003e/checksums.tsv`. For example: [`tensorflow_datasets/datasets/bool_q/checksums.tsv`](https://github.com/tensorflow/datasets/blob/master/tensorflow_datasets/datasets/bool_q/checksums.tsv).\n",
679679
"\n",
680680
" You can find the dataset source location in [our catalog](https://www.tensorflow.org/datasets/catalog/overview).\n",
681681
" * For old datasets: [`tensorflow_datasets/url_checksums/\u003cdataset_name\u003e.txt`](https://github.com/tensorflow/datasets/tree/master/tensorflow_datasets/url_checksums)\n",
Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
1-
https://s3-us-west-2.amazonaws.com/imagenetv2public/imagenetv2-matched-frequency.tar.gz 1264079360 f0c37fdf925916b19ea1323cd9a2208cdb6959ba2c32eef2a7fc393835c9ca7c imagenetv2-matched-frequency.tar.gz
2-
https://s3-us-west-2.amazonaws.com/imagenetv2public/imagenetv2-threshold0.7.tar.gz 1249906176 32142bfe998f9cfa4141be691f6a80eeb1e27b24bd532a668eb08c26d98897a2 imagenetv2-threshold0.7.tar.gz
3-
https://s3-us-west-2.amazonaws.com/imagenetv2public/imagenetv2-top-images.tar.gz 1245927936 85e4ace30f3f0d660152062254b8759dda66267b27f7ec0fd8d5768f1073a04b imagenetv2-top-images.tar.gz
1+
https://huggingface.co/datasets/vaishaal/ImageNetV2/resolve/main/imagenetv2-matched-frequency.tar.gz 1264079360 f0c37fdf925916b19ea1323cd9a2208cdb6959ba2c32eef2a7fc393835c9ca7c imagenetv2-matched-frequency.tar.gz
2+
https://huggingface.co/datasets/vaishaal/ImageNetV2/resolve/main/imagenetv2-threshold0.7.tar.gz 1249906176 32142bfe998f9cfa4141be691f6a80eeb1e27b24bd532a668eb08c26d98897a2 imagenetv2-threshold0.7.tar.gz
3+
https://huggingface.co/datasets/vaishaal/ImageNetV2/resolve/main/imagenetv2-top-images.tar.gz 1245927936 85e4ace30f3f0d660152062254b8759dda66267b27f7ec0fd8d5768f1073a04b imagenetv2-top-images.tar.gz

tensorflow_datasets/datasets/imagenet_v2/imagenet_v2_dataset_builder.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222

2323
# Note: Bump the version if the links change.
2424

25-
_ROOT_URL = 'https://s3-us-west-2.amazonaws.com/imagenetv2public'
25+
_ROOT_URL = 'https://huggingface.co/datasets/vaishaal/ImageNetV2/resolve/main'
2626
_IMAGENET_V2_URLS = {
2727
'matched-frequency': _ROOT_URL + '/imagenetv2-matched-frequency.tar.gz',
2828
'threshold-0.7': _ROOT_URL + '/imagenetv2-threshold0.7.tar.gz',
@@ -36,7 +36,7 @@
3636

3737

3838
class ImagenetV2Config(tfds.core.BuilderConfig):
39-
""" "Configuration specifying the variant to use."""
39+
"""Configuration specifying the variant to use."""
4040

4141
def __init__(self, *, variant, **kwargs):
4242
"""The parameters specifying how the dataset will be processed.
@@ -80,6 +80,7 @@ class Builder(tfds.core.GeneratorBasedBuilder):
8080
'Fix file_name, from absolute path to path relative to '
8181
'data directory, ie: "class_id/filename.jpg".'
8282
),
83+
'3.1.0': 'New URLs for resources from Hugging Face.',
8384
}
8485
BUILDER_CONFIGS = list(_create_builder_configs())
8586

0 commit comments

Comments
 (0)