module_adapter: generic: Clean up and optimize mod_free_all() #21616

Job	Run time
LP64-WIP	4m 14s
manifest-check	3m 5s
build-windows (mtl lnl)	12m 4s
build-windows (imx8 imx8x imx8m imx8ulp)	14m 34s
build-windows (-d, lnl)	10m 58s
build-windows (tgl tgl-h)	10m 48s
build-linux (mnfst, ptl)	5m 14s
build-linux (mnfst, tgl tgl-h)	5m 48s
build-windows (ptl)	8m 10s
build-linux (mnfst, imx8 imx8x imx8m imx8ulp)	7m 17s
build-linux (zmain, imx8 imx8x imx8m imx8ulp)	7m 24s
build-linux (zmain, ptl)	5m 0s
build-linux (mnfst, mtl lnl)	6m 9s
build-linux (zmain, mtl lnl)	6m 42s
build-linux (zmain, tgl tgl-h)	6m 6s
build-linux (mnfst, --all)	16m 28s
build-linux (-d, mnfst, lnl)	4m 39s
compare-linux-win	1m 43s
	2h 16m 23s

Provide feedback