Skip to content

In dashboard, Scribes should report tokens per second, not MPS #16

@db0

Description

@db0

image

Scribes are LLM text generators. They do not have MPS, resolution. Instead their speed is determined by tokens/second and their max_power is measured in "max_length" and "max_context_length"

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions