Skip to content

feat: implement S3 integration for storing and retrieving digest files #427

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jul 26, 2025

Conversation

MickaelCa
Copy link
Member

@MickaelCa MickaelCa commented Jul 18, 2025

@MickaelCa MickaelCa force-pushed the feat/add-s3-upload-of-ingest branch from 0c9ef62 to f94bbf9 Compare July 20, 2025 14:52
Copy link
Contributor

@ix-56h ix-56h left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes to the ingestion api endpoint are wrong, if you need help correcting them, i can do it for you !

@MickaelCa MickaelCa force-pushed the feat/add-s3-upload-of-ingest branch from 46e5acb to 10ef67d Compare July 20, 2025 22:57
@MickaelCa MickaelCa force-pushed the feat/add-s3-upload-of-ingest branch from 46b40ea to 85ff2ce Compare July 22, 2025 01:05
Copy link

github-actions bot commented Jul 23, 2025

⚙️ Preview environment was undeployed.

ix-56h
ix-56h previously approved these changes Jul 25, 2025
@MickaelCa MickaelCa dismissed ix-56h’s stale review July 25, 2025 16:32

still not working in PR env with aws s3

Copy link
Contributor

@NicolasIRAGNE NicolasIRAGNE left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few points

  1. S3_DIRECTORY_PREFIX is ignored when retrieving
  2. the ingest file name should be user-repo.txt (like we have today) i think
  3. when we do
# Extract source from URL or default to "unknown"
    git_source = {
        "github.com": "github",
        "gitlab.com": "gitlab",
        "bitbucket.org": "bitbucket",
    }.get(hostname, "unknown")

can't we just do raw hostname/... ? eg /github.com/blablabla
kinda like what golang does

@NicolasIRAGNE
Copy link
Contributor

LGTM

@MickaelCa MickaelCa merged commit 414e851 into main Jul 26, 2025
38 of 42 checks passed
@MickaelCa MickaelCa deleted the feat/add-s3-upload-of-ingest branch July 26, 2025 14:28
@coderamp-ci coderamp-ci bot mentioned this pull request Jul 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants