The answers to this question may differ based on location, but I can tell you that in my part of the world there is legislation in place for controlling populations of certain birds (as well as other pesky critters).
Bird feeders are for bird watchers who want to attract birds into their yards. I'm the other type of people. I have raspberries, saskatoons, cherries, and apples growing in my yard, so I want the birds to stay away. I have bird nets protecting my trees and bushes, owl decoys to scare the birds away (as do many of my neighbours), and a list of all the birds considered "nuisance birds" under Alberta legislation that anyone can legally dispose off using good husbandry.
There is no ecological justification for feeding birds, they don't need the food, the vast majority of the birds eating from your feeders aren't threatened species. Odds are many of the birds you're feeding are in the same boat as sparrows, starlings, magpies and rock doves are in Alberta; they're considered nuisance birds, and do damage to the crops meant for people. Providing them with food only increases their numbers, and gives added cause for agriculturalist to cull them in order to control their numbers.
If you enjoy having the birds in your yard, that's fine. But you're not helping them. In fact. you're doing the opposite. Some of the birds you so generously feed likely become dependant on the food you provide them to the point where they would struggle if you were to stop.
Bird feeders are for bird watchers. They aren't for the birds, they're for the people who fill the feeders and like to watch the birds. There's nothing wrong with feeding the birds, just keep in mind that there are also lots of places where there's nothing wrong with killing them just to reduce their numbers (or teaching them a lesson for ruining all my cherries).