Skip to content

Implement maximum memory usage ceiling and default auto-detection #2

@gregeva

Description

@gregeva

A normal user is not going to think about the RSS memory used by LTL, they are just going to run it. How much memory it will use depend on various parameters like how long the start to end time range is, how large the time windows are, the number of log entries, if there are durations in the entries, etc.

The memory will really start to increase based around the statistical calculations as for each time window and message, there are data structures being populated so that the statistical analysis can be done once the file processing is complete.

I am printing the memory in use so that people think about it, however unbounded memory use could be a problem in production environments with very little free memory before being OOM killed.

The goal for this feature is to auto-detect the amount of free memory and set the ceiling accordingly; while also giving the user the possibility via a command line parameter to specify the --memory-max.

For the purpose of this feature, execution should just stop if the ceiling is hit, and then results printed.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions