The deployment object in the helm chart only allows for labels. We want to use a controller that operates on annotations. Pretty easy fix.