There is rust inside my inner container. Is it poisonous or safe to use as it is?

If citric acid solution did not troubleshoot the issue, then the next step would be to replace the inner container reservoir for your water heater.