I am currently working on building low latency model inference API using fast API, we are using azure redis cache standard version for fetching features and onnx model for fast model inference. I am using aioredis to implement concurrency for…
Goal: Possibility to run asyncio coroutines. Correct celery behavior on exceptions and task retries. Possibility to use aioredis lock. So, how to run async tasks properly to achieve the goal? What is RuntimeError: await wasn't used with future (below), how…
The codes below show how I test the Redis stream functions. And I found that different processes with the same consumer name are competing to consume messages in the same stream. In my understanding, if this performance is normal, Redis…
I created a small class to perform basic operations with redis, using aioredis. class RedisService: def __init__(self, r_url) -> str: self.redis = r_url async def create_connection(self): return await aioredis.create_redis(self.redis) async def _get(self, key) -> str: try: return await self.create_connection().get(key, encoding='utf-8')…