Optimization Analysis for LoRA-Soups Weighting
- A computational intelligence study comparing optimization strategies for merged LoRA weighting.
LoRAOptimizationMergeBLEUROUGE
About
This final project compares Grey Wolf Optimization, CMA-ES, and Genetic Algorithm strategies for finding effective LoRA-Soups weights in large language model adaptation. It evaluates outputs with BLEU and ROUGE across bilingual and instruction datasets.
Combines adapter research with classical optimization search.