During the process of modernization of state governance, the quality of human resources in civil service plays an important role. Based on the reports published by OECD during the past decade, this paper analyzes the reform strategies related to human resource management in civil service of OECD member countries. The results show that most OECD member countries learn from the characteristics of civil service of different types, attach importance to the management of senior civil servants, delegate management authority, emphasize the competence and performance managements, and use empirical survey techniques. Most of these practices are similar to those in China’s civil service system. The modernization of state governance should be realized on the basis of experience of other countries and China’s national conditions. The Chinese governments should continue reforms by realizing the legalization, formulating a competence model of senior civil servants, improving training systems, examining performance and incentive mechanisms, and developing a human-caring organizational culture.