I have deployed Llama 3.1 70B and Llama 3.1 8B on my system and it works perfectly for the 8B model. When I tested it for 70B, it underutilized the GPU and took a lot of time to respond. Here…
I'm trying to get Tensorflow working on my Ubuntu 24.04.1 with a GPU. According to this page: Docker is the easiest way to run TensorFlow on a GPU since the host machine only requires the NVIDIA® driver So I'm trying…
I am building and training a neural network model on tensorflow version 2.17.0-nightly. After that I convert it to a tflite model. But when I try to load the model I get the following message: Didn't find op for builtin…
MissingPluginException (MissingPluginException(No implementation found for method loadModel on channel tflite)) I have stuck withh flutter and tflite : loadModel() async { await Tflite.loadModel( model: 'assets/model_unquant.tflite', labels: 'assets/labels.txt', ); } I used latest version tflite: ^1.1.2 I try downgrade but not…
do anyone know how to archieve this? I have been trying it with tensorflow lite but i always get "Interpreter has not been initialized" and im not getting more error messages. there are other lib that can do this work?…
I have a piece of code I need to run but it is only compatible with tensorflow 1.3,1.4 and 1.5. I think I need to downgrade python in order to run this however the terminal has python 3.10 I have…
I am trying to install TensorFlow 2.16.1 on my Ubuntu 22.04 system using pip, but I keep encountering an error saying that no matching distribution is found. Below are the details of my system: OS: Ubuntu 22.04.4 LTS Python Version:…
I have created a Dockerfile as shown below: FROM tensorflow/tensorflow:latest WORKDIR /code COPY ./requirements.txt /code/requirements.txt RUN pip install --no-cache-dir --upgrade -r /code/requirements.txt COPY ./app /code/app CMD ["fastapi", "run", "app/main.py", "--port", "80"] and requirements.txt file with following values: fastapi>=0.110.0,<0.113.0 pydantic>=2.7.0,<3.0.0 tensorflow…
I'm trying to build my Docker image, but it's taking forever. Even when I leave it to continue building, it fails after a long time. Here is my Dockerfile: FROM ubuntu:24.04 # Install Python and pip RUN apt-get update &&…
I am trying to install TensorFlow on Ubuntu/VSCode and I get these error message and can't the problem. Here are the error message: (.venv) user:~/Desktop/Code$ python3 -c "import tensorflow as tf; print(tf.config.list_physical_devices('GPU'))" 2024-05-10 15:36:48.869402: I tensorflow/core/util/port.cc:113] oneDNN custom operations are…