Commit Graph

155 Commits

Author SHA1 Message Date
Abi Raja
9a13fcc3d0 Merge branch 'main' into hosted 2024-05-13 16:06:10 -04:00
Abi Raja
43214bbbf8 add another unit test for new model 2024-05-13 15:26:12 -04:00
Abi Raja
8e6a9c48f8 support GPT-4o 2024-05-13 15:24:47 -04:00
Abi Raja
a5fe0960d8 support best of n evals 2024-04-24 14:54:03 -04:00
Abi Raja
522b7b8e23 Merge branch 'main' into hosted 2024-04-15 14:19:35 -04:00
Abi Raja
bb642b320e improve evaluation docs and the way the model is passed into the evaluation script 2024-04-11 10:52:25 -04:00
Abi Raja
6587b626c5 clean up model strings and add support for GPT-4 Turbo (Apr 2024) 2024-04-11 09:55:55 -04:00
Abi Raja
c51ff4d7ad remove more references 2024-04-10 15:38:03 -04:00
Abi Raja
60171bcc0b Merge branch 'main' into hosted 2024-04-10 14:55:07 -04:00
Abi Raja
9e1bcae545 remove access code/token functionality 2024-04-10 14:51:15 -04:00
Abi Raja
1aec82f53d stop writing logs to disk since we're capturing them in the DB 2024-04-10 13:52:49 -04:00
Abi Raja
a197bd9223 update error message 2024-04-10 13:43:13 -04:00
Abi Raja
fa944890ad Merge branch 'main' into hosted 2024-04-10 13:39:17 -04:00
Abi Raja
29cea327cc improve error UX (particular when no OpenAI API key is found) 2024-04-10 13:20:42 -04:00
Abi Raja
e1f39cac78 Merge branch 'main' into hosted 2024-03-25 14:41:05 -04:00
Abi Raja
dc52ff4cce store intermediate artifacts for video for easier debugging 2024-03-25 14:09:13 -04:00
Abi Raja
6a0201a5c0 fix up mock data 2024-03-22 11:14:15 -04:00
Abi Raja
196cf5865b set a default for inputMode param 2024-03-19 18:21:17 -04:00
Abi Raja
7f44228a95 fix bug where open AI key is required to use it with Anthropic 2024-03-19 13:57:57 -04:00
Abi Raja
62272e3a68 update error message for video 2024-03-19 13:51:30 -04:00
Abi Raja
1d8f6641a2 do not allow non-subscribers to use Claude 2024-03-19 13:38:09 -04:00
Abi Raja
b6222ddbc9 hide & disable video functionality on prod 2024-03-19 13:12:41 -04:00
Abi Raja
785a135460 Merge branch 'main' into hosted 2024-03-19 12:09:31 -04:00
Abi Raja
b57f34d73a close anthropic client after it's done streaming 2024-03-19 12:09:25 -04:00
Abi Raja
7edbe16325 Merge branch 'main' into hosted 2024-03-19 10:31:12 -04:00
Abi Raja
212aa228ab fix bug with using enum as string 2024-03-19 10:30:58 -04:00
Abi Raja
f67cfb6d8a send along llm_version to database 2024-03-19 10:15:35 -04:00
Abi Raja
f6079542f7 Merge branch 'main' into hosted 2024-03-19 09:56:07 -04:00
Abi Raja
81c4fbe28d identify exact llm being used during generation 2024-03-18 17:44:05 -04:00
Abi Raja
71dfde3892 Merge branch 'main' into hosted 2024-03-18 16:41:14 -04:00
Abi Raja
1a42f6a91b add haiku claude constant 2024-03-15 13:35:15 -04:00
Abi Raja
a58c95c8c7 add more mock data 2024-03-14 15:59:57 -04:00
Abi Raja
c08cf0ae57 support screen recording 2024-03-14 15:57:44 -04:00
Abi Raja
a0f5af0fdc improve mock functionality 2024-03-08 05:02:23 -05:00
Abi Raja
28d33a4d7e do multiple passes for video claude 2024-03-07 17:31:39 -05:00
Abi Raja
4937a92f42 support video uploads through the interface 2024-03-07 14:59:26 -05:00
Abi Raja
c2f230a8c9 initial version of script 2024-03-06 20:47:28 -05:00
Abi Raja
123e8ffce2 Add Claude prompts file (not used yet - we use the same prompts for both models) 2024-03-05 20:22:09 -05:00
Abi Raja
c69edeb4b6 send correct media type to Claude 2024-03-05 14:02:48 -05:00
Abi Raja
3a23d9eae3 add pyright as part of pre-commit (but disable it for now due to failing type check) 2024-03-05 13:50:55 -05:00
Abi Raja
a7e51f6f1a update error message from anthropic 2024-03-05 13:39:49 -05:00
Abi Raja
7b62147a58 support Claude 3 Sonnet 2024-03-05 12:24:30 -05:00
Abi Raja
bd407e51f9 code clean up 2024-03-04 14:58:01 -05:00
Abi Raja
5e3a174203 test again with fixed test now 2024-02-23 15:33:23 -05:00
Abi Raja
d58d66d7ff test committing a failing test 2024-02-23 15:26:09 -05:00
Abi Raja
5e2c2b25c3 add pre-commit to run tests before each commit 2024-02-23 15:08:34 -05:00
Abi Raja
c0e084aa86 update evals 2024-02-21 09:30:42 -05:00
Abi Raja
9f7c0b4b35 add TODO 2024-01-30 14:33:50 -05:00
Abi Raja
ab15aff021 Support screenshot by URL for all paying customers 2024-01-30 14:32:57 -05:00
Abi Raja
e9140c331b for a subscription, regardless of the key setting, it should just work 2024-01-30 13:51:35 -05:00