I'm working on a multiprocessing python application where multiple processes need access to a large, pre-loaded spaCy NLP model (e.g., en_core_web_lg). Since the model is memory-intensive, I want to avoid loading it separately in each process, since I quickly run…
I am new relatively new to Python and working with Anaconda and I attempting to install NLPre using the following commands within the Anaconda command prompt: pip install nlpre The install hangs when installing build dependencies for spacy 2.1.0 and…
I'd like to run multiple spacy language models on various docker containers. I don't want the docker image to contain the line RUN python -m spacy download en_core_web_lg, as other processes might have different language models. My question is: Is…
I am using spacy and after installing all the dependencies, I use this command: spacy download en_core_web_trf I am running this command while creating a Docker image. I want to reduce the size of the Docker image. I know that…
Synonyms in Python can be easily found using NLTK or Spacy for a single word like Cat, Dog, Happy, or sad But when it comes to compound words like Artificial- Intelligence or Call-Taxi the language processor always gives output for…
I am trying to run a simple workflow using celery and using this documentation. I am using chain to sequentially run the tasks, with following workflow Extract a file, tokenize it and load JSON dumps of sentence tokens of a…
I have two files, file1.py which have ML model size of 1GB and file2.py which calls get_vec() method from file1 and receives vectors in return. ML model is being loaded everytime when file1 get_vec() method is called. This is where…
I'm trying to identify user similarities by comparing the keywords used in their profile (from a website). For example, Alice = pizza, music, movies, Bob = cooking, guitar, movie and Eve = knitting, running, gym. Ideally, Alice and Bob are…