Graduating PhD student Guodong Zhang intends to lead the next generation of AI experts.
“The public should embrace AI (Artificial Intelligence) as a catalyst for positive change,” says Guodong Zhang, who graduates this month with his PhD from the Department of Computer Science.
“Ensuring that AI systems align with human values and remain under human control becomes increasingly critical. Addressing AI safety is one of the most important and impactful problems we face today.”
Zhang intends to be part of the solution. He applied to U of T for his PhD several years ago, inspired by the “godfather of AI,” University Professor Emeritus in the Department of Computer Science in the Faculty of Arts & Science, Geoffrey Hinton.
As a PhD student, Zhang taught many courses at U of T. His study of theoretical foundations and practical algorithms for machine learning have already been adopted by major AI players including Google Brain, DeepMind and OpenAI.
Ahead of convocation, Zhang spoke about his research and how U of T prepared him to excel in what is certain to be a promising career ahead.
Why was U of T the best place to earn your PhD?
I was captivated by the immense potential of deep learning, so U of T was an obvious choice for me given its leadership in this area. Geoffrey Hinton and his students shocked the world with their results on ImageNet in 2012 with AlexNets, a neural network architecture which started a golden age for deep learning. Furthermore, the prospect of collaborating with the Vector Institute rendered U of T even more special.
How do you explain your work with AI to people outside your field?
I focused on developing neural network models and algorithms that excel in fast training, robust generalization and accurate uncertainty estimation. With neural networks often comprising millions or billions of parameters, the challenge lies in understanding effective optimization techniques for these networks. I am also exploring the phenomenon of why neural networks have such impressive generalization abilities. And finally, another key aspect of my research was investigating whether neural networks can possess awareness of their knowledge gaps.
How is your work with AI going to improve life for the average person?
My research on neural network training dynamics holds significant importance in the realm of large language models and AI research. These models used in programs such as ChatGPT, which have become ubiquitous in our daily lives, play a vital role in various applications. For example, they assist us with translation, enhance our essay writing and serve as virtual assistants to address our queries.
There’s controversy surrounding how AI is being used in some respects. Why do you think the public needs to embrace AI as a catalyst for positive change in society?
The public should embrace AI as a catalyst for positive change because it enhances efficiency and productivity across industries, automates mundane tasks allowing for more meaningful work and improves problem-solving and decision-making through data analysis. In addition, it augments human capabilities and drives innovation while also helping us to address societal challenges like inequality and sustainability.
Embracing AI responsibly ensures transparency, accountability and ethical considerations, unlocking AI's potential for positive impact in our society. I think the public should also be involved in regulating AI as AI systems could be very powerful and misuse of them could lead to catastrophic consequences.
What career path will you pursue after graduation and how do you think your U of T education will help you excel in that journey?
I will work as an AI researcher in industry, focusing on large language models. My education at U of T has equipped me with extensive knowledge in deep learning and artificial intelligence. Under the guidance of my advisor, Roger Grosse, and collaboration with colleagues, I have gained valuable insights into neural network training dynamics and AI safety. This expertise enables me to enhance the efficiency of large language model training while ensuring alignment with human values. My PhD work on understanding neural network training with a noisy quadratic model has already been used by many big industrial labs (including Anthropic, DeepMind, OpenAI) in training the latest models.
What advice do you have for people considering their PhD — in your field or beyond?
I recommend everyone maintains a curious mindset and pursues their passions. Curiosity is vital for scientific progress. It is also crucial to remain open-minded and committed to lifelong learning. Our field is rapidly evolving, rendering knowledge from just a few years ago potentially outdated. Therefore, continuous learning is essential.
— Original story by David Goldberg for A&S News