Does one really need to add bicarbonate of soda if one already uses baking powder?

I find the taste of bicarbonate of soda ruins the taste of many cakes and cookies. If I'm using double acting baking powder, do I need to add the soda as well? I have come accross so many recipes that require both ingredients.