Avoid double cache

[blegat]

I extracted it from #309 to isolate the changes making the tests failed as detailed in #309 (comment) but now it's passing 😆

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 89.01%. Comparing base (3b29d7f) to head (99ab2f4).
⚠️ Report is 2 commits behind head on master.

Additional details and impacted files

@@           Coverage Diff           @@
##           master     #311   +/-   ##
=======================================
  Coverage   89.01%   89.01%           
=======================================
  Files          16       16           
  Lines        2057     2057           
=======================================
  Hits         1831     1831           
  Misses        226      226           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.