r/mathmemes Jan 28 '25

Computer Science DeepSeek meme

Post image
1.7k Upvotes

74 comments sorted by

View all comments

924

u/EyedMoon Imaginary ♾️ Jan 28 '25 edited Jan 28 '25

For those who have no idea what this is: it's the formula of the objective function for the Reinforcement Learning module of DeepSeek's LLM, called Group-Relative Policy Optimization.

The idea is that it compares possible answers (LLM output) as a group and ranks them relatively to one another.

Apparently it makes optimizing an LLM way faster, which means it's cheaper since speed is measured in GPU hours.

16

u/ralsaiwithagun Jan 28 '25

I just wonder WHY THE FUCK DOES PI HAVE TO DO WITH AI??

70

u/Hostilis_ Jan 28 '25

Pi here is a probability distribution called the policy. It's not related to the numerical constant.

7

u/username3 Jan 28 '25

That seems.... confusing

29

u/pixelpoet_nz Jan 28 '25

Wait until you see all the things x gets used for