Skip to content

Conversation

isoos
Copy link
Collaborator

@isoos isoos commented Jan 28, 2025

  • The callback will start a timer that, if not cancelled, will call exit to make sure the VM is restarted.
  • Added regular timeouts to storage download and also upload calls.

@isoos isoos requested review from jonasfj and sigurdm January 28, 2025 15:21
stderr.writeln('Timeout triggering VM termination\n$trace');
_logger.pubNoticeShout(
'vm-termination',
'Timeout triggering VM termination',
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this terminate the VM or does AppEngine just restart the process?

await for (final package in dbService.query<Package>().run()) {
if (package.isNotVisible) {
continue;
await withVmTerminationTimeout(timeout: Duration(hours: 12), () async {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not just add .timeout(Duration(hours: 12)) when calling doCreateAndUpdateSnapshot?

If such a timeout does happen there, isn't that a good place to just not catch the timeout and let it bubble all the way up? Do we need to explicitly kill the VM?

@isoos
Copy link
Collaborator Author

isoos commented Feb 3, 2025

Closing in favor of #8525.

@isoos isoos closed this Feb 3, 2025
@isoos isoos deleted the snapshot-timeouts branch February 3, 2025 16:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants