Think of it like your car. Fuel usage goes up if driving into a strong headwind, i.e more power required to maintain speed due to increased load from wind resistance.
Your generator also requires a certain amount of fuel just to run even if little or no load.
The engine also has a "Sweet Spot" as far as load. Above this point the amount of fuel required goes up more for the same increase in load.