A Hyper-Transformer model for Controllable Pareto Front Learning with Split Feasibility Constraints.
Neural Netw
; 179: 106571, 2024 Nov.
Article
in En
| MEDLINE
| ID: mdl-39121789
ABSTRACT
Controllable Pareto front learning (CPFL) approximates the Pareto optimal solution set and then locates a non-dominated point with respect to a given reference vector. However, decision-maker objectives were limited to a constraint region in practice, so instead of training on the entire decision space, we only trained on the constraint region. Controllable Pareto front learning with Split Feasibility Constraints (SFC) is a way to find the best Pareto solutions to a split multi-objective optimization problem that meets certain constraints. In the previous study, CPFL used a Hypernetwork model comprising multi-layer perceptron (Hyper-MLP) blocks. Transformer can be more effective than previous architectures on numerous modern deep learning tasks in certain situations due to their distinctive advantages. Therefore, we have developed a hyper-transformer (Hyper-Trans) model for CPFL with SFC. We use the theory of universal approximation for the sequence-to-sequence function to show that the Hyper-Trans model makes MED errors smaller in computational experiments than the Hyper-MLP model.
Key words
Full text:
1
Collection:
01-internacional
Database:
MEDLINE
Main subject:
Neural Networks, Computer
Limits:
Humans
Language:
En
Journal:
Neural Netw
Year:
2024
Document type:
Article