Using generic bleach to purify emergency water?

Bleach is for killing microbes more than anything else... it wouldn't 'purify' the water. All contaminants would remain in the water after it's been treated with bleach, and of course you'd have the bleach, which is also a contaminant, remain in the water, and it'd be fit for nothing more than washing non-food surfaces, such as floors