Ice that tastes of the freezer has usually absorbed smells from the cabinet, or it was made from water that already tasted off. A lid, fresh water and a clean freezer clear most of it.