Milk in vacuum flask?

Is it possible to keep warm milk in a vacuum flask for a day? I'm worried about the small organisms that may grow faster in numbers because of the warmth, and make me ill.