Comment/feature request: Huggingface 502s from GHA

[Scott-Simmons]

This is no longer a pressing issue, but for completeness I am reporting that in August 26th, GET requests to https://datasets-server.huggingface.co/info\?dataset\=livebench/math were returning 502s when invoked from github actions (that link will expire eventually, here are the logs).

When invoked from actions, it appeared to be consistently failing for ~6 hours. However, these 502s never occurred when the request was invoked from my local machine in that same time period.

I suspect that this is related to how the requests are routed with github actions versus locally.

Its not clear to me if the request even reached huggingface servers or if its the github proxy that stopped it from going through, but I wanted to report it nonetheless in case this is helpful information. I'm curious if huggingface can do anything on their end to confirm cause.

And a feature request for if this happens in the future (assuming huggingface has visibilty on it): A "datasets status" page highlighting if 502s occur for specific individual datasets could be useful for people debugging on the other end of this!