I also rely on a jerry can solution. Advantages: easy cleaning, removable and therefore easy to fill (or easy disposal, if really bad water was filled), as well as individual manageable quantities. With a small canister, I can get water even in poorer countries if I ask for it. If I would try to fill a whole tank with hundreds of liters like some ExMos have them on board, that would not be ok in my opinion.
We have 3 to 4 jerry cans with us for fresh water, 10 liters or 2.5 gallons each. In addition, 20 liters or 5 gallons of water to wash hands, etc. and a water bag (black, heated by the sun) for shower water when needed.
The jerry cans are made of plastic and have their permanent place on board, where they are securely lashed. If jerry cans are used, they should of course be as light as possible and at the same time unbreakable. From a hygiene point of view, glass or stainless steel would be the optimum. Glass is of course not a solution from a saftey and sturdiness point of view. Plastic is comparatively porous and offers colonization surfaces for germs. With watertanks, stainless steel is not a problem, so the choice of canisters is limited in practice or cost-intensive. I therefore take plastic canisters and clean them thoroughly on a regular basis (keep an eye on possible recontamination!) My canisters have a large opening (wide-neck canisters), so that they can be cleaned better. In addition, you can of course use different filter systems (have such a small hand filter) or in regions where drinking water is really critical in terms of cleanliness or one is very sensitive there also buy water in large containers from the supermarket.