时间:2024-11-24 13:11:32 来源:网络整理编辑:時尚
Just when you started coming to terms with ChatGPT's eerie capabilities, OpenAI dropped a new versio
Just when you started coming to terms with ChatGPT's eerie capabilities, OpenAI dropped a new version of its AI language model.
OpenAI says GPT-4 is much more advanced than GPT-3, which powers ChatGPT. And to prove it, they made GPT-4 sit down for a bunch of exams. OpenAI tested GPT-4 with a variety of standardized tests from high school to graduate to professional level and spanning across mathematics, science, coding, history, literature, and even the one you take to become a sommelier. The exams were comprised of multiple choice and free-response question and GPT-4 was scored using the standard methodology for each exam.
SEE ALSO:How to get access to GPT-4 right nowPut your pencil down, GPT-4, it's time to see check your scores.
GPT-4 didn't just get into law school, it passed the bar. The AI language model scored in the 88th percentile on the LSATs (Law School Admission Test) and did even better on the Bar (Uniform Bar Exam) by scoring in the 90th percentile. By comparison, GPT-3 was in the bottom 40 percent of the LSATs and 10 percent on the Bar.
GPT-4 took both the math and reading/writing sections of the SATs and all three sections of the GREs which are broken down into quantitative, verbal, and writing skills. It scored in the 80th or 90th percentile of all sections except for the writing section of the GREs... which it kind of bombed in the 54th percentile.
The quintessential overachiever, GPT-4 also took allthe AP (Advanced Placement) high school exams. It aced most of them, scoring between the 84th and 100th, except for a few outliers.
GPT-4 scored 44th in AP English Language and a measly 22nd in AP English Literature. So all you wordsmiths out there might have some more time before GPT-4 replaces you. GPT-4 didn't do so hot on AP Calculus BC scoring between 43rd and 59th, proving that even for a supercomputer, calculus is not easy. But that still earns GPT-4 a four, so it might still place out of college calculus.
GPT-4 still has some work to do with its coding skills, which is curious since one of its marketed uses is for helping developers. Its rating for Codeforces, which hosts competitive programming events, is 392, which puts it way down in the Newbie category of anything below 1199.
It did pretty well on the easy level of the Leetcode (31 out of 41 problems solved) but struggled when it came to medium or hard level of difficulty (21/80 and 3/45 respectively). As we saw in the developer demo livestream, GPT-4 is fully capable of writing Python, but required some manual tweaking to set the right parameters, which might explain some these test scores. Or maybe it didn't eat breakfast that morning.
GPT-4 passed the sommelier exams with flying colors. It placed lowest (77th percentile) in the most advanced sommelier exam. But for a non-human entity that's never tasted wine, we'll let that one slide.
OpenAI has released a full breakdown of how GPT-4 performed. GPT-4 might not write the next great American novel...yet, but GPT-4's future as a mathematically brilliant lawyer and wine connoisseur looks pretty bright.
TopicsArtificial IntelligenceChatGPT
Uber's $100M settlement over drivers as contractors may not be enough2024-11-24 12:48
8 Asian budget airlines form 'world's biggest' low2024-11-24 12:27
Ancient mega tsunamis on Mars are newest clues to past life2024-11-24 12:09
16 cats that are absolutely terrible at hide2024-11-24 11:40
One of the most controversial power struggles in media comes to a close2024-11-24 11:40
Sudoku book is so hard, even the cover gets it wrong2024-11-24 11:20
Snapchat finally lets you zoom in with just one hand2024-11-24 11:19
Half of your friends may not actually consider you to be their friend2024-11-24 11:13
You can now play 'Solitaire' and 'Tic2024-11-24 11:02
Mom writes 'permission slip' letting sons climb trees after adult chastises them2024-11-24 10:58
Here's what 'Game of Thrones' actors get up to between takes2024-11-24 12:56
Classic birthday cakes will give you a dose of nostalgia and a sugar high2024-11-24 12:31
Choir performance is like watching 1,000 angels whip and nae nae2024-11-24 12:17
There are big changes to BBC's food site and people aren't happy2024-11-24 12:07
Early Apple2024-11-24 12:02
How MTV got away with live streamed murder mayhem2024-11-24 11:41
Justice Department fires back at North Carolina with lawsuit of its own2024-11-24 11:05
Man quits his job to travel Australia in a campervan with his cat2024-11-24 11:01
Honda's all2024-11-24 10:46
Justin Bieber's face tattoo may be a loving Ryan Gosling tribute2024-11-24 10:24