Question 103074 in Azure Question posted in
The official documentation to get you started can be found here.

Azure Functions python: BlobTrigger starts when stream is empty

I am trying to implement a pipeline that each step writes a file in a blob container.

Steps:

  • pdf triggers a function that extracts the text and saves it as txt in the container
  • the extracted text triggers a function that polishes the result and write a third file in the container

The second step sometime (most of them) fails because the stream of the txt file generated by the first step looks empty (it’s not).

I don’t have any budget so i can’t use service bus or event hubs in Azure. I think that the triggers starts via polling.

Anyone has an idea on how can i solve this problem or where i should start to look?

Tags:

2

Answers


  1. Chosen as BEST ANSWER
    0

    The problem seems to be the time needed by the Azure function to execute.

    As soon as the function is invoked, the output binding creates the file but just at the end of the execution writes the data (which makes sense).

    On the other side, if the output file of this function triggers another azure function, this second pipeline stages can get an empty file or not, depending on the execution status of the first one. (i hope i could explain myself a bit)

    My solution was not using the output blob binding. If I use the ContainerClient binding I can upload a file all at once when the elaboration of my data is done.


  2. 0

    After reproducing from my end, this was working fine when I followed the below process. I have created 2 Blob Trigger functions where one is to convert pdf to txt file and the other is to read the txt file, do the required manipulations and then saving to another container.

    pdf triggers a function that extracts the text and saves it as txt in the container

    Function1.cs – Reading the pdf file and saving it as text file in a container

    enter image description here

    using System.IO;
using Microsoft.Azure.WebJobs;
using Microsoft.Extensions.Logging;
using iTextSharp.text.pdf;
using iTextSharp.text.pdf.parser;

namespace FunctionApp5
{
    public class Function1
    {
        [FunctionName("Function1")]
        public void Run([BlobTrigger("pdfcontainer/{name}", Connection = "constr")]Stream myBlob, string name,
            [Blob("textcontainer/1.txt", FileAccess.Write, Connection = "constr")] Stream outputBlob,ILogger log)
        {
            log.LogInformation($"C# Blob trigger function Processed blobn Name:{name} n Size: {myBlob.Length} Bytes");
            PdfReader reader = new PdfReader(myBlob);
            int intPageNum = reader.NumberOfPages;
            string[] words;
            string line;
            string text;

            for (int i = 1; i <= intPageNum; i++)
            {
                text = PdfTextExtractor.GetTextFromPage(reader, i, new LocationTextExtractionStrategy());
                using (var writer = new StreamWriter(outputBlob))
                {
                    writer.Write(text);
                }
            }
        }
    }
}

    Results:

    enter image description here

    the extracted text triggers a function that polishes the result and write a third file in the container

    Function2.cs – Reading the uploaded text file and doing some manipulations and saving it to another container

    using System.IO;
using System.Text;
using Microsoft.Azure.WebJobs;
using Microsoft.Extensions.Logging;

namespace FunctionApp5
{
    public class Function2
    {
        [FunctionName("Function2")]
        public void Run([BlobTrigger("textcontainer/{name}", Connection = "constr")] Stream myBlob, string name,
            [Blob("finalcontainer/1.txt", FileAccess.Write, Connection = "constr")] Stream outputBlob, ILogger log)
        {
            log.LogInformation($"C# Blob trigger function Processed blobn Name:{name} n Size: {myBlob.Length} Bytes");

            string finalValue;

            using (var reader = new StreamReader(myBlob, Encoding.UTF8))
            {
                finalValue = reader.ReadLine();
            }

            using (var writer = new StreamWriter(outputBlob))
            {
                writer.Write(finalValue.ToUpper());
            }
        }
    }
}

    Results:

    enter image description here

    enter image description here

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search