Given that the plugins are hosted in separate repositories, changes in the main repository can break the plugin. It would be good to create a couple of basic tests that at least make sure that the plugins can be installed and the software can boot. Might be a good feature to pursue after the plugins are pip installable.