Github/screenshot-to-code
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update evaluating-claude.md

Browse Source
This commit is contained in:
Abi Raja 2024-03-05 21:52:24 -05:00 committed by GitHub
parent 6029a9bec5
commit cd7cd841ed
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
blog/evaluating-claude.md
View File

@ -2,6 +2,8 @@
Claude 3 dropped yesterday, claiming to rival GPT-4 on a wide variety of tasks. I maintain a very popular open source project called “screenshot-to-code” (this one!) that uses GPT-4 vision to convert screenshots/designs into clean code. Naturally, I was excited to see how good Claude 3 was at this task. Claude 3 dropped yesterday, claiming to rival GPT-4 on a wide variety of tasks. I maintain a very popular open source project called “screenshot-to-code” (this one!) that uses GPT-4 vision to convert screenshots/designs into clean code. Naturally, I was excited to see how good Claude 3 was at this task.
**TLDR:** Claude 3 is on par with GPT-4 vision for screenshot to code, better in some ways but worse in others.
## Evaluation Setup ## Evaluation Setup
I don’t know of a public benchmark for “screenshot to code” so I created simple evaluation setup for the purposes of testing: I don’t know of a public benchmark for “screenshot to code” so I created simple evaluation setup for the purposes of testing: