When the Oscar nominee dismissed it as an art form ‘no one cares about’, singers erupted in outrage. But I understand the instinct – I spent years resisting it myself