Id guess sometime in the 1800s when certain types of clothes layering became common, more specifically chaps. The jump from pants meaning underwear to pants equals under chaps wear isn’t that far.