Skip to content

Slow STFT/FFT/IFFT/RFFT layers #8573

@georg95

Description

@georg95

Current implementation is naive and for maxtix of 512x2048 takes 512x2048x2048 - 2 billion loops

for (var i = 0; i < uniforms.realShape[1]; i = i + 1) {

STFT/RFFT current Framing window implementation also very slow because of hundreds gpu calls in a loop

while (start < signal.size) {

Made faster implementation for webgl/webgpu (up to 100+ times faster)
https://github.com/georg95/tfjs-fast-fft
Built it to speed up BirdNET, bird calls audio recognition.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions