Skip to content

Commit f9bac97

Browse files
authored
Update README.md
1 parent 09499ad commit f9bac97

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

README.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -240,6 +240,14 @@ Authorization: Bearer your_secret_api_key
240240
```
241241
## SOTA results on benchmarks with optillm
242242

243+
### readurls&memory-gpt-4o-mini on Google FRAMES Benchmark (Oct 2024)
244+
| Model | Accuracy |
245+
| ----- | -------- |
246+
| readlurls&memory-gpt-4o-mini | 65.66 |
247+
| gpt-4o-mini | 50.0 |
248+
| Gemini Flash 1.5 | 66.5 |
249+
| Gemini Pro 1.5 | 72.9 |
250+
243251
### plansearch-gpt-4o-mini on LiveCodeBench (Sep 2024)
244252

245253
| Model | pass@1 | pass@5 | pass@10 |

0 commit comments

Comments
 (0)