Closed QA: Результаты тестирования 50 вопросов за 16.08.2023

 

model_name temperature top_p estimation mean
0 GigaChat:v1.13.0 0.00001 0.0 14.50 0.2900
1 gpt-3.5-turbo 0.00001 28.50 0.5700
2 Random selection 1 answer 12.78 0.2556

 

Closed QA: Результаты тестирования 365 вопросов за 16.08.2023

 

model_name temperature top_p estimation mean
0 GigaChat:v1.13.0 0.00001 0.0 88.821429 0.247413
1 gpt-3.5-turbo 0.00001 161.805556 0.450712
2 Random selection 1 answer 12.780000 0.255600