Mayank Chhabra
|
9d086c2e28
|
Lock 13B and 70B models in memory for faster interference
|
2023-08-18 03:11:42 +07:00 |
|
Mayank Chhabra
|
bc1300fba5
|
Update docker service names for different model APIs
|
2023-08-17 23:28:55 +07:00 |
|
Mayank Chhabra
|
bb8e5fccaa
|
Add restart on-failure policy
|
2023-08-17 04:17:47 +07:00 |
|
Mayank Chhabra
|
b45347173e
|
Disable 13B docker builds, add images to docker-compose.yml
|
2023-08-16 04:59:40 +07:00 |
|
Mayank Chhabra
|
680ff5144f
|
Increase api ping timeout to 10 min
|
2023-08-16 01:27:51 +07:00 |
|
Mayank Chhabra
|
b0b059a05a
|
Wait for api to be available before starting UI
|
2023-08-15 23:42:08 +07:00 |
|
Mayank Chhabra
|
ee97955bb7
|
Add support for 13B and 70B models, workflow, readme
|
2023-08-15 23:11:39 +07:00 |