Broadcasters failed to take action on “inappropriate behaviour” by David Walliams years before allegations against him came to light, it has been claimed.