To support int8 model deployment on mobile devices,we provide the universal post training quantization tools which can convert the float32 model to int8 model. mean and norm are the values you passed ...
🍲 ms-swift is an official framework provided by the ModelScope community for fine-tuning and deploying large language models and multi-modal large models. It currently supports the training ...