Adding working combination of LLM and Embedding Model to recipes (#1315)
Co-authored-by: ishaandatta <ishaandatta50@gmail.com>
This commit is contained in:
		
							parent
							
								
									aabdb046ae
								
							
						
					
					
						commit
						28d03fdda8
					
				|  | @ -81,4 +81,15 @@ Context: None | |||
| Situation: tu es au milieu d'un champ. | ||||
| Tache: va a la rivière, en bas du champ. | ||||
| Décrit comment aller a la rivière. | ||||
| ``` | ||||
| 
 | ||||
| ### Optimised Models | ||||
| GodziLLa2-70B LLM (English, rank 2 on HuggingFace OpenLLM Leaderboard), bge large Embedding Model (rank 1 on HuggingFace MTEB Leaderboard) | ||||
| `settings-optimised.yaml`: | ||||
| ```yml | ||||
| local: | ||||
|   llm_hf_repo_id: TheBloke/GodziLLa2-70B-GGUF | ||||
|   llm_hf_model_file: godzilla2-70b.Q4_K_M.gguf | ||||
|   embedding_hf_model_name: BAAI/bge-large-en | ||||
|   prompt_style: "llama2" | ||||
| ``` | ||||
		Loading…
	
		Reference in New Issue