Automatic Conversion to Pruned FP16 Safetensors

Originally posted on Discord @ https://discord.com/channels/1037799583784370196/1075206509392302120/1075206509392302120 TLDR: Civitai should automatically convert model uploads to the "safetensors" file format (as opposed to legacy/insecure "ckpt" files), prune them (ie discard the NonEMA weights, as those don't get used in practice and just double the filesize for no reason), and optionally also compress to FP16 (as opposed to FP32, as most users run models in half anyway, and the quality difference is nearly nonexistent). This would limit checkpoint models to 2GiB, as opposed to 4 or 7 GiB. Other model types would also have (relatively) small size. Of course, sane uploaders are uploading in these formats anyway. The conversion naturally only applies to uploaders who use inappropriate file formats. I would argue that the original file should be discarded in favor of the conversion, but some people might argue that they want the original. Doesn't make a difference to me, as long as the end user gets a sanely formatted file by default.

Please authenticate to join the conversation.

Upvoters
Status

Awaiting Dev Review

Board

πŸ’‘ Feature Request

Date

Almost 3 years ago

Author

mcmonkey

Subscribe to post

Get notified by email when there are changes.