Research on intelligent interaction for emotion understanding and regulation
If you don't follow us, you'll lose your chance!
Suddenly, starting from scratch
校门口值周时的一次突发奇想,开启了自己这段“小小”的科研旅程。
项目初衷源于我对学校生活的思考。2016年底,在组织学校值周时,我发现同学们进入校门大多低着头,行色匆匆。紧张的学习让同学们难以放松,忘记微笑。是否可以有效地引导情绪,让同学们绽放笑容呢?
通过查阅心理学和人工智能文献,我逐渐萌发了智能化识别、引导情绪的构想。
前排:左一 北师大附属实验中学校长蔡晓东 左二 本文作者李镇尧 左三 北京市委常委、副市长阴和俊
The first results are achieved, but the innovation competition is broken
我在学校门口树立了一块能识别表情的智能板,并对所识别到的人进行针对性反馈。但经过数日的数据采集和实验,发现了自己的不足:首先,交互装置放在校门口是无法证明引导效果的,因为人流量太大,无法确定识别人群。另外,算法漏洞很多,鲁棒性和准确性都很低。仔细思考,我用了整整一年时间去尝试改变:大幅改进算法,同时,在老师的引导下,我将目标聚集到服务窗口的工作人员,可以近距离、相对固定地获取表情,便于研究。
The 17th "Little Scientists of Tomorrow" public exhibition site
According to statistics, the service sector will account for 55 per cent of the country's gross national product by 2020. Service levels and customer experience satisfaction have become a top priority for the development of the service industry. "Service with a Smile" was born out of necessity and is a pressing issue in the current service industry.
In view of this, I have chosen the service personnel who are most closely related to the people as the entry point to study the delivery of sincere smiles and services to the public through correct, proactive, intelligent and effective identification of emotions and guidance of emotions.
The project research designed an intelligent interactive device for recognizing the emotions of service personnel and performing emotional guidance. The device collects the service personnel's face video in real time by camera, improves the LBP-SVM expression recognition algorithm using the embedded 3D-based expression model, establishes a human-computer interaction system, recognizes the facial expressions in the video, judges the emotional state in which the facial expressions in the video are located, gives auditory stimulation of different intensities according to the emotional state, guides the service personnel's emotions in a positive direction, and finally achieves the effect of happy conduction and improves service quality. Under the guidance of my teacher, I finally completed the development of the expression recognition program and was able to implement the complete functions of image pre-processing, facial feature extraction, expression feature recognition, and active emotion intervention through images. I was so happy that my idea had become a reality that I participated in the "Youth Science and Technology Innovation Competition", but I didn't expect it to be a failure.
Building on the momentum, winning the second prize for Ming Primary
Undiscouraged myself, the loss made me realize that my research is far from mature and needs to be improved in terms of accuracy and usefulness. Improving robustness and accuracy in real-world application scenarios by optimizing expression recognition algorithms. Hands-on fabrication of stand-alone hardware devices to form intelligent interactive systems that combine hardware and software to improve usability for deployment in real-world scenarios.
Experiment in real scenarios to verify the actual results, and tune the system based on the results to really realize your original idea. An officer must have a beginning and an end. With her research results, she confidently stepped on the stage of "Tomorrow's Little Scientists" and won the second prize of the 17th national "Tomorrow's Little Scientists". Extraction and expression recognition framework. Enriching emotional guidance methods, such as introducing strong guidance measures like visual flash signals, to improve the effectiveness of emotional guidance. Also, improve the user-friendliness of the interactive interface based on the feedback from the audience during the presentation.
Beijing Municipal Committee Standing Committee and Vice Mayor Yin Hejun presenting the Mayor's Award to the winner of the 38th Beijing Youth Innovation Competition (7th from left, Li Zhenyao)
再接再厉,获得“北京市青少年科技创新市长奖” (“计算机科学与技术”类别唯一获奖者),这不仅让我收获了北京市青少年学生科技创新的最高荣誉,更是传递了一份 “创新变革、服务社会”的责任。
一路有您,常怀感恩
Thank you to the expert judges for their coaching. Thank you for your scientific and rigorous attitude, and for giving us pertinent advice and guidance from a professional point of view, inspiring us to think pioneeringly in our future studies and research, to be more realistic, truth-seeking and perfect, and to make a new leap forward! Thanks to my alma mater. Qian Xuesen, the "father of space" and "father of missiles" in China, recalled that seven of the 17 people he influenced in his life were from his high school. It was a school that didn't drive through the night even for proms, didn't study to death, and really grasped and understood what they were learning. It was a school that taught us to behave, to seek knowledge, to do things, and to live.
感谢默默辛苦付出的组织者。因为您们无微不至的照顾,我们才有机会站在绚烂夺目的舞台上,才有机会接受专家学者的点评和指导,才有机和五湖四海的英才接触五彩斑斓的未知世界。 因为您们,我懂得思考自己对他人的意义,对社会的意义。
知道科学的广阔
For the past year and more, scrapping and working hard to get the project done, achieving a little bit of success and being excited and happy about it. However, when I went to the stage of Ming Primary and Mayor's Award, hearing the shortcomings pointed out by the experts and seeing the achievements of other contestants, I deeply felt the vastness of the world of science and the drop in the ocean as an individual.
Understanding the meaning of science
科学,引领我们以热情、严谨、执着、专注的精神,去感悟、研究、探索宇宙、万物的变化规律。路漫漫其修远兮,成功只有一次,失败却可能有很多回,我们所能做的只有“上下而求索”,迈向更远、更难、更值得探索的科学之路!
认识到科学的重要性
Today, science and technology has become a necessary condition for the future survival of enterprises and even national development, and "Made in China" is changing to "Innovation in China". Time is running out, we need to learn, need to hone, need to have a sense of innovation and keen judgment, logical reasoning ability and strong overall quality; focus on practical applications, through their own technical ingenuity, dare to pioneering attempts, practice and breakthroughs, and knowledgeable people together to create, have a better tomorrow!
不忘初心,本立道生
古人云:“大德不官,大道不器,大信不约,大时不齐。察于此四者,可以有志于本矣。”在探索科学的路上,思考自己对他人的意义,对社会的意义,我更收获对自己成长的认识,以及今后自己的成长目标。
◆人,坚守本心。做一个品德高尚,对社会有用的人。
◆Heart, macro vision. "To establish a heart for heaven and earth, to establish a life for the living, to succeed the sages of the past, and to open up peace for all generations." A long way to go, a long way to persevere.
◆Technology, the basis of establishing a career. Learn, hone, and have your own research direction and use your platform well.
◆Wise, wise and clever thoughts. Have the technical ingenuity to think outside the box, touch the box and dare to think pioneeringly, experiment and break through in your own platform.
◆Get, longingly, enlightened. Through practice, ingenuity, and truly owning your own stunts, you can truly serve society and humanity.
◆Dao, the concept of the realm of transformation. We will teach and teach our own skills, just like the experts in the Mayor's Award. Then learn and be knowledgeable, ask questions and think.
The society of the future is an international one. I want to learn more foreign languages and go out to see a wider world, a more magnificent universe.
未来的社会,是一个服务化的社会。我希望发挥自己的优势,去做更多有意义的事,让自己的生命如水滴一般汇入大海,获得恒久的生命力。
The society of the future is a managed society. I want to learn more advanced management knowledge and techniques so that our nation, our country, can lead the way to world innovation!
我希望做一个优秀的中国人,让北京因我而自豪!
祝贺李镇尧同学获得荣获第十六届“北京青少年科技创新市长奖”,这也是我校获得的第11个科技创新市长奖。感谢高三学部主任金光泽老师、班主任田密老师和任课老师们对李镇尧同学的培养。
摄影、后期编辑/丁立
北京师范大学实验中学科技体育艺术中心