There are household products (find at grocery store or hardware store) that remove stains. One is ZUD which is a powder but others are available in liquid form. They contain acid but it will not harm glass. (Only hydrofluoric acid acts upon glass)
However, painted labels such as on milk bottles are relatively fragile so you are probably limited to hand washing around the labels with dish washing detergent on a sponge.