E2e integration tests

[MattiasGees]

What this PR does / why we need it:
Takes over #518

Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged): fixes #

Special notes for your reviewer:
This needs #527

Release note:

NONE

[jetstack-bot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approver: dippynark

If they are not already assigned, you can assign the PR to them by writing /assign @dippynark in a comment when ready.

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[MattiasGees]

Tested this all now and both tests pass. I created a branch that merges #544 and #527 to test this
https://github.com/mattiasgees/tarmak/tree/e2e-integration-tests-with-destroy-env

I will now look into upgrading of Tarmak tests.

[MattiasGees]

I have the following scenarios covered now:

• Setup single cluster
• Setup multi cluster
• Upgrade of Tarmak from latest release to master release
• Upgrade of Kubernetes

TODO:

• Make sure tests can run all at once (possible spread over multiple regions)
• Make running limited amount of tests possible (eg only the single cluster setup)
• Make running Sonobuoy possible as optional test

[jetstack-bot]

@MattiasGees: PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[MattiasGees]

Replace by #743
/close

[jetstack-bot]

@MattiasGees: Closed this PR.

In response to this:

Replace by #743
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.