Not necessarily. With proper planning, small amounts of sugar can fit into a balanced diet. The key is consistency and portion control.