GPTQV2 for DeepSeekV3 #1676

Open

opened

on Aug 12, 2025

Has anyone tried to determine how many resources are needed to run DeepSeekV3? Can the A100 40G run?

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests