I looked that question up a few years ago and, IIRC, the term originates from the German or French, and is based on the fact that the first normal schools were actual schools - i.e. operating schools where young teachers were trained. The term obviously fell out of favour as the teacihing profession was increasingly professionalized over the course of the 20th century.