We brushed our teeth with the tap water as well. No issues for us.