In this paper, we develop the Crank-Nicolson finite difference method (C-N-FDM) to solve the linear time-fractional diffusion equation, formulated with Caputo's fractional derivative. The resultant large system of equations is studied using conjugate gradient method (CG).