BREAKING: More Span/stackalloc optimizations

[paulirwin]

• You've read the Contributor Guide and Code of Conduct.
• You've included unit or integration tests for your change, where applicable.
• You've included inline docs for your change, where applicable.
• There's an open issue for the PR that you are making. If you'd like to propose a change, please open an issue to discuss the change or find an existing issue.

More Span/stackalloc optimizations to reduce allocations.

Fixes (TBD)

Description

This replaces some array allocations with Spans on the stack where possible to reduce some allocations.

This is a breaking change because of the change to the API surface, although it's fairly minor and not likely to affect most users.