ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
Hi there
I am trying to use this model online, by it keeps generating this error, I think I succussed once today, but after that its keep failing, Do you have any suggestion?
Hi there, i solved the issue, seems like i need to put LLMout before embeddings,but right now I do have this issue, could you please help?
C:\llmProject>python stream.py
Device used for LLM: cuda
Loading Callback Manager
Loading embeddings
Traceback (most recent call last):
File "C:\llmProject\stream.py", line 43, in
main()
File "C:\llmProject\stream.py", line 30, in main
embedding = HuggingFaceEmbeddings(model_name="all-MiniLM-L6-v2", model_kwargs={"device": device})
File "C:\Users\caleb\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\langchain_community\embeddings\huggingface.py", line 72, in init
self.client = sentence_transformers.SentenceTransformer(
File "C:\Users\caleb\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\sentence_transformers\SentenceTransformer.py", line 197, in init
modules = self._load_sbert_model(
File "C:\Users\caleb\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\sentence_transformers\SentenceTransformer.py", line 1309, in _load_sbert_model
module = module_class.load(module_path)
File "C:\Users\caleb\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\sentence_transformers\models\Pooling.py", line 227, in load
with open(os.path.join(input_path, "config.json")) as fIn:
FileNotFoundError: [Errno 2] No such file or directory: 'C:\Users\caleb\.cache\huggingface\hub\models--sentence-transformers--all-MiniLM-L6-v2\snapshots\e4ce9877abf3edfe10b0d82785e83bdcb973e22e\1_Pooling\config.json'