Totally agree.
I stopped drinking tap water decades ago, mostly because it always had a strange chemical taste. Grew up drinking well water (with a strong iron/sulfur aftertaste) I still remember how refreshing it was when I was really thirsty on a hot day.
In China, most people drink bottled water, or filtered tap water. (which is probably the same)
Not sure how to eliminate plastic, many of the storage tanks and water pipes are PVC.