Shocking thing is was only discovered weeks after the child died.