Tap water in Colorado is good, even excellent. It's always bugged me that we have a filter in our fridge that needs to be replaced. Eventually I thought "surely there is a way to bypass the filter" and GUESS WHAT THERE IS. It's called *drum roll* a "filter bypass plug".
If you live somewhere with decent or better water, I highly recommend it.
@lyonsinbeta careful, sometimes the filters are more about keeping minerals from building up inside your device than about human safety. Fresh spring water for example can have a ton of minerals that are not at all bad for a human, but can cause mass damage to a frig.
@lyonsinbeta I believe it is because they cool the water. As cold water can not hold as many elements in a solution as hotter water. Also, for household plumbing you can't use galvanized pipes with copper pipes or they will corrode faster, it might be something similar to that.