Fabric is widely used in daily life and hand-knitting practices, and its visual form often extends beyond utility, gradually accumulating as a perceptible carrier of emotional experience and family memory. This study takes color as a visual entry point into the emotional experience of textiles and further incorporates the symbolic narratives of patterns to examine the formation of emotional structures and cultural memory within textiles. Based on hand-made textile samples collected from Shanghai, Zhejiang, Jiangsu, Jiangxi, and Henan, the findings reveal that color and pattern together form a dual emotional code in textile design. In this way, textiles function not only as everyday objects, but also as carriers of family narratives, social culture, and individual memory.