Factoring in Fashion