Export.json SOQL LIMIT Clause Failing

[nwoolz]

I am having an issue with hardis when adding a LIMIT to the SOQL query in the Export.json. It appears that there is a hard-set LIMIT in the code somewhere that is trying to override the LIMIT that I set in the json file.

Export.json:

{

"sfdxHardisLabel": "AllRFQFiles",
"sfdxHardisDescription": "AllRFQFiles",
"soqlQuery": "SELECT Id,Name FROM RFQ__c LIMIT 200",
"fileTypes": "all",
"outputFolderNameField": "Name",
"outputFileNameFormat": "title_id",
"overwriteParentRecords": true,
"overwriteFiles": true
}

Error:

[sfdx-hardis] [BulkApiV2] SELECT Id,Name FROM RFQ__c LIMIT 200 ORDER BY Id LIMIT 100000
✖ [BulkApiV2] Bulk query error: Query parsing error: unexpected token: 'ORDER'
Error (1): Query parsing error: unexpected token: 'ORDER'

hardis: v5.44.0
CLI: v2.95.6
Windows 10
VS Code: v1.101.2

[nvuillam]

@nwoolz this command automatically handles the LIMIT option, as you can see in the built SOQL

Maybe you could reduce the number of results using a WHERE clause ?

What is your use case that would require to add a limit when exporting all files related to SObjects ?

[nwoolz]

The biggest use case for using LIMIT is testing purposes. My only option to see if the files come out the way that I need is to let the export run in full. This took 3 hours yesterday. I would like to LIMIT the SOQL until I know that the query is setup how I need, then execute the query to run.

[nvuillam]

For testing purposes, you can not use LIMIT, but you can use WHERE criteria :)

Example to extract only for files created in february 2024:

{

"sfdxHardisLabel": "AllRFQFiles",
"sfdxHardisDescription": "AllRFQFiles",
"soqlQuery": "SELECT Id,Name FROM RFQ__c WHERE CreatedDate >= 2024-02-01T00:00:00Z AND CreatedDate < 2024-03-01T00:00:00Z",
"fileTypes": "all",
"outputFolderNameField": "Name",
"outputFileNameFormat": "title_id",
"overwriteParentRecords": true,
"overwriteFiles": true
}

[nwoolz]

That makes sense. I can attempt to append the soqlQuery with a WHERE statement. Could I set it somehow to only find and download files that are over a certain ContentSize?

[nvuillam]

@nwoolz filtering on size is not implemented, usually people just want to download all files matching some criteria, to either:

• migrate them to another system (Salesforce or other)
• or just save paid storage by archiving their files on a sharepoint then delete them :)

Do you have a -not for tests- use case that would justify an evolution to filter using file size ?

[nwoolz]

@nvuillam - We are facing storage overages in a couple of orgs. We were hoping to search for files over X-size and target the removal of those after exporting them. Since there is no real correlation between fields and file size, that we could find, being able to search for files over X-size would allow us to target the exact type of files we need to remove without having to download many files that are unneeded to get the ones we do need. Does that make sense?

Thanks for your help thus far, Nicolas. This plugin has really been an amazing tool to use.