How does AI write an answer?

It learned from the world’s text long before you asked. Now a neural network, running on GPUs, writes the reply one word at a time.

The world’s text
What it learned from
trained
WebsitesBooksCodeScience papers
Trillions of words, read once, during training. It does not search them when you ask.
Your question
Pick one to ask
Neural network
Everything it learned, stored as tuned connections
70B parameters
layer – / 80pass 0
GPU cluster
The chips that do the maths
8 online
Maths per word140 billion
Memory140 / 640 GB
Speed40 words/s
power 0.6 kW · 34 °C · fans 20%
Answer
Written one word at a time
idle
0 words–
Multiplications so far0idle
100%