[Inference GPT] Fix 345M load path and use auto_model to export quant model #1025

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

RichardWooSJTU wants to merge 1 commit into PaddlePaddle:develop from RichardWooSJTU:update_gpt_inference

Contributor

RichardWooSJTU commented Jan 31, 2023

Add auto export shell script and config file for GPT quant model
Fix GPT fp16 model exporting error


          fix 345M load path and use auto to export quant model

c2d6724

CLAassistant commented Sep 25, 2024 •

edited

Loading

All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet