May 24, 2023
Welcome to Eye on AI, the podcast that keeps you informed about
the latest trends, obstacles, and possibilities in the realm of
artificial intelligence. In this episode, we have the privilege of
engaging in a thought-provoking discussion with Aidan Gomez, an
exceptional AI developer and co-founder of Cohere.
Aidan’s passion lies in enhancing the efficiency of massive neural
networks and effectively deploying them in the real world. Drawing
from his vast experience, which includes leading a team of
researchers at For.ai and conducting groundbreaking research at
Google Brain, Aidan provides us with unique insights and anecdotes
that shed light on the AI landscape.
During our conversation, Aidan explains his collaboration with the
legendary Geoffrey Hinton and their remarkable project at Google
Brain. We delve into the intricate architecture of AI systems,
demystifying the construction of the transformative transformer
algorithm. Aidan generously shares his knowledge on the creation of
attention within these models and the complexities of scaling such
systems.
As we explore the fascinating domain of language models, Aidan
discusses their learning process, bridging the gap between code and
data. We uncover the immense potential of these models to suggest
other large-scale counterparts. We gain invaluable insights into
Aidan’s journey as a co-founder of Cohere, an innovative platform
revolutionizing the utilization of language technology.
Tune in to Eye on AI now to immerse yourself in a captivating
conversation that will expand your understanding of this
ever-develop field.
(00:00) Preview
(00:33) Introduction & sponsorship
(02:00) Aidan's background with machine learning & AI
(05:10) Geoffrey Hinton & Aidan Gomez working together
(07:55) Aidan Gomez & Google Brain's project
(12:53) Aidan's role in building AI architecture
(15:25) How the transformer algorithm is built
(18:25) How do you create attention?
(20:40) How do you scale the model?
(25:10) How language models learn from code and data
(29:55) Did you know the potential of the project?
(34:15) Can LLMs suggest other large models?
(36:45) How Aidan Gomez started Cohere
(41:10) How do people use Cohere?
(46:50) Examples of language technology models
(48:40) How Cohere handles hallucinations
(52:53) The dangers of AI
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI