**Warning!** I am not a medical professional.

However, I asked my favorite doctor and she seemed to think it would be okay.

She said rust would just look like iron to your body and it would be consumed like food. So, I guess it is broadly safe.

She also said that she wouldn't do it under any circumstances.  If the container is rusting so extensively you swallow sharp flakes of metal, you can die really horribly.