Theoretical study of Kondo effect and related transport properties in topological insulator systems