.juliabundleignore doesn't work?

[ranjanan]

I tried to to launch a batch job with a large folder in my bundle (but tried to use .juliabundleignore file to ignore it). It doesn't seem to work.

To Reproduce

Put a large file > 2GB at the top level and tried the following patterns:
*.avi
assets/ (having moved the file there)

Environment

Using extension 0.7.11 locally on my mac.

• Is this happening locally, in a JuliaHub IDE, or in a JuliaHub batch job?
• JuliaHub.jl version: 6.9.1
• Relevant JuliaHub instance: internal.juliahub.com
• Julia version: 1.11.4
• Operating system: Mac

Need this to work with a series of files too (*.csv etc etc)

[ranjanan]

We tried putting things in a folder because we saw the following code:

JuliaHub.jl/src/PackageBundler/utils.jl

Lines 76 to 80 in ec56e19

	function get_bundleignore(file, top)
	dir = dirname(file)
	patterns = Set{Any}()
	try
	while dir != top

.

And so a patch was to be able to do something like this: (suggested by @mbauman):

@eval JuliaHub._PackageBundler function get_bundleignore(file, top)
    dir = dirname(file)
    patterns = Set{Any}()
    try
        while true
            if isfile(joinpath(dir, ".juliabundleignore"))
                union!(
                    patterns,
                    Glob.FilenameMatch.(strip.(readlines(joinpath(dir, ".juliabundleignore")))),
                )
                return patterns, dir
            end
            if dir == dirname(dir) || dir == top
                break
            end
            dir = dirname(dir)
        end
    catch err
        @warn "Internal error" exception = (err, catch_backtrace())
    end
    return patterns, top
end

where it checks the top level as well. This seemed to work when we tried using the client (not extension). I suspect two issues are going on here:

1. the extension (0.7.11) is old - does it bundle the latest client 0.1.14?
2. there's a bug in the client where it doesn't check the top level.

So a solution could be to:

1. fix the bug in the client
2. release a new extension with the latest version of the client bundled.

[pfitzseb]

I can't repro this, unfortunately. Both the extension and JuliaHub.jl directly seem to remove files as expected with the following test case:

/tmp/tmp.SK4BD4l0EF 
❯ tree -a 
.
├── .juliabundleignore
├── large_file.csv
├── Manifest.toml
├── Project.toml
├── test
│   ├── asdf.jl
│   └── large_file.csv
└── .vscode
    └── settings.json

3 directories, 7 files

/tmp/tmp.SK4BD4l0EF 
❯ cat .juliabundleignore  
*.csv%  

I've attached the directory I submitted as well, in case you wanna try to repro the issue with that:
bundleignoretest.tar.gz

[ranjanan]

@pfitzseb the file size for this large file is zero bytes?

[ranjanan]

If you use a really large file, you get this: