The long-term inefficient use of pesticides increases the cost of agricultural production, resulting in a large loss of pesticides, threatening food safety and the ecological environment. Improvement of existing pesticide formulations by using pesticide controlled release technology is an effective measure to improve pesticide utilization. Stimuli-responsive polymers are a class of emerging carrier materials that sense and respond to changes in the surrounding environment to achieve targeted controlled release of active ingredients. In the field of biomedicine, the research of stimuli-responsive polymers as drug carriers has been quite extensive, and it has been effective in the targeted treatment of cancer. However, the application in the field of pesticide controlled release is still in the basic stage. There are still a series of factors restricting the development of such materials, such as carrier cost, pesticide loading performance, system stability, and application of processing technology. In this paper, the research progress and application status of stimuli-responsive polymer materials in the field of controlled release of pesticides are reviewed, and the application prospect was also discussed.