Typically there isn't any sugar involved with flavouring of coffee. Its mainly aroma. If the drinker puts sugar in......it highlights the aromas, which simply become sweetened and your perception tells you what it tastes like.....based on the aroma affecting your olfactory senses!!

Sure, there may be the odd flavoured bean that contains sugar, but you'd know immediately if you tasted it!