Answer
Mass and centre of gravity both matter. Recheck total mass, balance, control authority, endurance, and manufacturer limits for the actual installation.
Explanation
A lighter payload can still create a worse balance or aerodynamic configuration.