We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 09499ad commit f9bac97Copy full SHA for f9bac97
README.md
@@ -240,6 +240,14 @@ Authorization: Bearer your_secret_api_key
240
```
241
## SOTA results on benchmarks with optillm
242
243
+### readurls&memory-gpt-4o-mini on Google FRAMES Benchmark (Oct 2024)
244
+| Model | Accuracy |
245
+| ----- | -------- |
246
+| readlurls&memory-gpt-4o-mini | 65.66 |
247
+| gpt-4o-mini | 50.0 |
248
+| Gemini Flash 1.5 | 66.5 |
249
+| Gemini Pro 1.5 | 72.9 |
250
+
251
### plansearch-gpt-4o-mini on LiveCodeBench (Sep 2024)
252
253
| Model | pass@1 | pass@5 | pass@10 |
0 commit comments