Here is a simple code to use Redis and embeddings but It's not clear how can I build and load own embeddings and then pull it from Redis and use in search from langchain.embeddings import OpenAIEmbeddings from langchain.vectorstores.redis import Redis…
I have put my Open AI service behind Azure API Management gateway, so if the client has to access the Open AI service they have to use the gateway URL. Lets say the gateway URL is [email protected]. Before the gateway…
llm = AzureOpenAI(openai_api_key=OPENAI_API_KEY, deployment_name=OPENAI_DEPLOYMENT_NAME, model_name=MODEL_NAME) # Configure the location of the PDF file. pdfReader = PdfReader('databorders.pdf') # Extract the text from the PDF file. raw_text = '' for i, page in enumerate(pdfReader.pages): text = page.extract_text() if text: raw_text += text…
I'm using Langchain with OpenAI to create embeddings from some PDF documents to ask questions of these PDF documents. I'm working in NodeJS and attempting to save vectors in Mongo Atlas. At service start, I am calling the fromDocuments() method…
this is my current code: from langchain.llms import HuggingFacePipeline from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline, BitsAndBytesConfig from langchain import PromptTemplate, LLMChain import torch model_id = "../models/openbuddy-llama2-34b-v11.1-bf16" tokenizer = AutoTokenizer.from_pretrained(model_id) nf4_config = BitsAndBytesConfig( load_in_4bit=True, bnb_4bit_compute_dtype=torch.bfloat16, bnb_4bit_quant_type='nf4', bnb_4bit_use_double_quant=False, max_memory=24000 ) model =…
Can we somehow pass an option to run multiple threads/processes when we call Chroma.from_documents() in Langchain? I am trying to embed 980 documents (embedding model is mpnet on CUDA), and it take forever. Specs: Software: Ubuntu 20.4 (on Win11 WSL2…
I'm working with AzureOpenAI and langchain, constantly getting hit by PermissionError. This mostly could be due to the proxy, but can someone please check the code -- from langchain.llms import OpenAI, AzureOpenAI from langchain.prompts import PromptTemplate from langchain.chains import LLMChain…
Im creating a text document QA chatbot, Im using Langchainjs along with OpenAI LLM for creating embeddings and Chat and Pinecone as my vector Store. See Diagram: After successfully uploading embeddings and creating an index on pinecone. I am using…
Hello StackOverflow community, I've developed a Next.js application that uses the Langchain library for chat functionality and is deployed on AWS Amplify. The application works perfectly when running locally, but fails after deployment on AWS Amplify. The application uses the…
I am trying to use Langchain for structured data using these steps from the official document. I changed it a bit as I am using Azure OpenAI account referring this. Below is the snippet of my code - from langchain.agents…