This repository contains a production-ready distributed training benchmark framework designed to compare and analyze the performance of different parallelization strategies for Large Language Model ...