Skip to content

Human accuracy comparison to Good/Bad/Mean/Evil Gyal? #21

@clawsoon

Description

@clawsoon

@dkappe has trained a number of nets on Lichess data, with some Stockfish mixed in to fill in gaps where the Lichess data tends to be sparse (e.g. endgames after a material imbalance, where human players in most games resign). Any chance you'd be able to do a "how human does it play?" comparison against his nets to see how they stack up against the Maia nets? I've been playing the Maia 1100 net, and it misses some very obvious moves that an 1100 human would make (e.g. Maia 1100 sometimes fails to take back during an exchange, leaving the game lost). I'm wondering if his mix of human and Stockfish data might create a "more human" player than human data alone. And since you've already got the code to make those comparisons between human play and engine play... ;-)

https://github.com/dkappe/leela-chess-weights/wiki/Mean-Girl:--the-most-fun-leela-style-net
https://github.com/dkappe/leela-chess-weights/wiki/Bad-Gyal

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions