Get target_modules

#56
by danny3 - opened

Please how can I get the target_modules for LLMs in general? I need this for fine-tuning

Microsoft org

The following should do the trick:

  - q_proj
  - v_proj
  - k_proj
  - o_proj
  - gate_proj
  - down_proj
  - up_proj
nguyenbh changed discussion status to closed

Sign up or log in to comment