Conflicting gradients

Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization
We connect the problem of modality collapse with conflicting gradients, and leverage solutions from multitask learning to alleviate it.
Adrián Javaloy, Maryam Meghdadi, Isabel Valera
Cite Code Poster Slides Video arXiv thread Proceedings
Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization
RotoGrad: Gradient Homogenization in Multitask Learning
We propose an algorithm to simultaneously homogenize gradient magnitudes and directions across tasks in multitask learning.
Adrián Javaloy, Isabel Valera
PDF Cite Code arXiv thread
RotoGrad: Gradient Homogenization in Multitask Learning