Azure Cosmos DB client throws "HttpRequestException: attempt was made to access a socket in a way forbidden by its access permissions" underneath

I use CosmosClient from SDK Microsoft.Azure.Cosmos 3.28.0 in ASP.NET Core 3.1 in Azure Durable Function. This client is getting and sending data from/to my cosmos instance (Core (SQL)) and it works fine but I see that it constantly throws exception in following http request for metadata

GET 169.254.169.254/metadata/instance

System.Net.Http.HttpRequestException: An attempt was made to access a socket in a way forbidden by its access permissions.

I use following configuration:

  private static void RegisterCosmosDbClient(ContainerBuilder builder)
        {
            builder.Register(c => new SocketsHttpHandler()
            {
                PooledConnectionLifetime = TimeSpan.FromMinutes(10), // Customize this value based on desired DNS refresh timer
                MaxConnectionsPerServer = 20, // Customize the maximum number of allowed connections
            }).As<SocketsHttpHandler>().SingleInstance();

            builder.Register(
                    x =>
                    {
                        var cosmosDbOptions = x.Resolve<CosmosDbOptions>();
                        var socketsHttpHandler = x.Resolve<SocketsHttpHandler>();
                        return new CosmosClient(cosmosDbOptions.ConnectionString, new CosmosClientOptions()
                        {
                            ConnectionMode = ConnectionMode.Direct,
                            PortReuseMode = PortReuseMode.PrivatePortPool,
                            IdleTcpConnectionTimeout = new TimeSpan(0, 23, 59, 59),
                            SerializerOptions = new CosmosSerializationOptions()
                            {
                                PropertyNamingPolicy = CosmosPropertyNamingPolicy.CamelCase
                            },
                            HttpClientFactory = () => new HttpClient(socketsHttpHandler, disposeHandler: false)
                        });
                    })
                .AsSelf()
                .SingleInstance();
   }

I also tried approach with passing IHttpClientFactory from this blog but it didn’t help.