Clothing Pattern Structure Modeling and Reconstruction via Multi-Module Fusion Graph Neural Networks with Path Planning and Reinforcement Learning
Abstract
There are core difficulties in the intelligent recognition and generation application of clothing pattern structure, such as irregular geometric topology, weakened semantic structure, and unstable path planning. To solve such problems, an intelligent feature extraction and structure reconstruction path learning scheme that integrates graph neural networks is constructed. In the stage of structural diagram modeling, a clothing structure diagram is constructed based on the node edge surface configuration relationship. The graph convolutional network is used to embed the spatial adjacency relationship in multiple dimensions, supplemented by attention mechanism to enhance the response ability of key nodes and improve the stability of extracting local salient features. To better express the relationship between structural semantics and geometry, a multi-scale graph embedding strategy and structural context aggregation module are introduced to enable nodes to have stronger expressive power in both topological and semantic dimensions. In terms of reconstructing path generation, a graph autoencoder architecture is introduced to achieve controllable mapping of structure to path space, integrating geometric consistency constraints to enhance structural accuracy. The path decision-making process adopts a reinforcement learning model based on policy gradient, and optimizes the path guidance process through feedback mechanism. This experiment is based on the DeepFashion2 public dataset and our self built clothing structure graph data, with a total of 4826 samples and an average of 43 vertices. The results show that the accuracy index of our model reaches 91.3%+0.5, the Topology Score reaches 88.0%+0.6, and the F1 Structure Score reaches 88.4%+0.6, which is much higher than the basic method. The innovation of this study is mainly reflected in three aspects: proposing the use of graph convolution+attention to achieve multi task feature extraction; Introducing geometric constraints and policy networks to achieve reconstruction methods that maintain path consistency; The first application of GNN in the establishment of clothing style structure brings a new approach compared to traditional graph mapping.
Full Text:
PDFReferences
Putri R G A , Djamal E C , Sundari S .Clothing type classification using convolutional neural networks[J].AIP ConferenceProceedings,2023,2714(1):7.https://dol:10.1063/5.0129363.
Emma P M , Jereesh A S , Kumar G S .Reconstruction of gene regulatory networks using graph neural networks[J].Applied Soft Computing, 2024,163(000):13.https://dol:10.1016/j.asoc.2024.111899.
Zhou Z , Deng W , Wang Y ,et al.Classification of clothing images based on a parallel convolutional neural network and random vector functional link optimized by the grasshopper optimization algorithm:[J].Textile Research Journal, 2022,92(9-10):1415-1428.https://dol:10.1177/00405175211059207.
Feng K , Rao G , Zhang L C Q .An interlayer feature fusion-based heterogeneous graph neural network[J].Applied Intelligence: The International Journal of Artificial Intelligence, Neural Networks, and Complex Problem-Solving Technologies, 2023,53(21):25626-25639.https://dol:10.1007/s10489-023-04840-w
Zhao R , Baili W U , Chen Z ,et al.Graph Neural Network for Fault Diagnosis with Multi-Scale Time-Spatial Information Fusion Mechanism[J].Journal of South China University of Technology (Natural Science Edition), 2023, 51(12):42-52.https://dol:10.12141/j.issn.1000-565X.220593.
Li X , Wang J , Tan J ,et al.A graph neural network-based stock forecasting methodutilizing multi-source heterogeneous data fusion[J].Multimedia Tools and Applications, 2022, 81(30):43753-43775.https://dol:10.1007/s11042-022-13231-1.
Dong Y , Liu Q , Du B ,et al.Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification[J].IEEE Transactions on ImageProcessing,2022(31-):31.https://dol:10.1109/TIP.2022.3144017.
Sun X , Zheming L U .Attributed Graph Clustering Network with Adaptive Feature Fusion[J].IEICE Transactions on fundamentals of electronics, communications & computer sciences, 2024,E107/A(10):1632-1636.https://dol:10.1587/transfun.2023EAL2116.
Liu C , Qu D , Yang X ,et al.Multi-attention feature fusion network for lightweight image super-resolution[J].Proceedings of SPIE,2022,12173(000):6.https://dol:10.1117/12.2634640.
Chen J , Yu X , Wu C ,et al.Feature radiance fields (FeRF): A multi-level feature fusion method with deep neural network for image synthesis[J].Applied SoftComputing,2024,167(PartA):19.https://dol:10.1016/j.asoc.2024.112262.
Yi C .Application of Convolutional Networks in Clothing Design from the Perspective of Deep Learning[J].Scientific programming,2022,2022(Pt.18):6173981.1-6173981.8.https://dol:10.1155/2022/6173981.
Yan Z , Xing Y , Xiao T J ,et al.SDAN: Semantic-Driven Dual Attentional Network for Image Generation[J].2022 5th International Conference on Pattern Recognition and Artificial Intelligence (PRAI),2022:521-525.https://dol:10.1109/PRAI55851.2022.9904248.
Liao L , Zhang S , Li Z ,et al.Clothing classification method based on convolutional network and attention mechanism[J].Proceedings of SPIE, 2022, 12285(000):12.https://dol:10.1117/12.2637531.
Ning C , Di Y , Menglu L .Survey on clothing image retrieval with cross-domain[J].Complex & Intelligent Systems,2022,8(6):5531-5544.https://dol:10.1007/s40747-022-00750-5.
Liu S , Wang X , Jiang M ,et al.MAS-DGAT-Net: A dynamic graph attention network with multibranch feature extraction and staged fusion for EEG emotion recognition [J].Knowledge-Based Systems, 2024,305(000):19.https://dol:10.1016/j.knosys.2024.112599.
Gadhave R , Sedamkar R R , Alegavi S .Hyperspectral image classification using neural networks with effect of feature optimization on fused convolutional features[J].AIP Conference Proceedings, 2023,2842(1):11.https://dol:10.1063/5.0175906.
Xiao Z , Chen H , Li W K .WGDPool: A broad scope extraction for weighted graph data[J].Expert Systems with Application, 2024,249(Sep.Pt.B):123678.1-123678.9.https://dol:10.1016/j.eswa.2024.123678.
Wu D , Wang Y , Wang H ,et al.DCFNet: Infrared and Visible Image Fusion Network Based on Discrete Wavelet Transform and Convolutional Neural Network[J].Sensors,2024,24(13):27.https://dol:10.3390/s24134065.
Wang S , Zhang M , Miao M .The super-resolution reconstruction algorithm of multi-scale dilated convolution residual network[J].Frontiers in Neurorobotics, 2024,18(000):10.https://dol:10.3389/fnbot.2024.1436052.
Hua C , Zhang H , Li J ,et al.Continuous-dilated temporal and inter-frame motion excitation feature learning for gait recognition[J].IET ComputerVision(CVI),2024,18(6):13.https://dol:10.1049/cvi2.12278.
DOI: https://doi.org/10.31449/inf.v49i14.10683
This work is licensed under a Creative Commons Attribution 3.0 License.








