The Smart Garment Sorting System allows efficient management of post-consumer textile waste in the garment recycling industry by integrating artificial intelligence, and in conjunction with image analysis techniques, that mainly focuses on hyperspectral spectroscopy. The system consists of a classification module, a material classification module, and a fabric construction classification module. The goal of the system is to cut down garment wastage by achieving a reliable method for sorting textile waste stream and to reduce operation cost for garment recycling companies.