Polymer quantum mechanics, as a non-standard representation of quantum mechanics, is based on a symmetric sector of loop quantum gravity known as loop quantum cosmology. In this work, by analyzing the Hamiltonian and Friedmann equations in the standard Hilbert space and polymer Hilbert space, we show that polymer quantization is a successful formalism for a non-Abelian gauge field driving the cosmological inflation, the so-called gauge-flation, in order to remove initial singularity and also keeping the inflationary trajectories in this model as attractors of dynamics after the bounce.