3-large
First, we graduated from ada-002 to 3-large.
The number of dimensions has doubled from 1536 to 3072, but the new model can freely reduce the number of dimensions using the Matryoshka method, and even if the number is reduced to 256, the performance exceeds that of ADA.
https://x.com/kenn/status/1826112390754349165
https://x.com/kenn/status/1826112390754349165
---
This page is auto-translated from /nishio/3-large using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.