Agnosticism means you are thinking about what you know. Babies don't do that. All they know is that the big thing has bags of food they like to suck on.
No, it means that you don't know/are not certain. If 100% is certainty than 0% "I don't know". Since baby's don't know, they are Agnostic.