How Does Milvus Schedule Query Tasks

Milvus is an open-source vector database that supports massive-scale data search. It schedules query tasks by dividing the data into multiple data blocks and creating SearchTasks for each block. The tasks are assigned to computing devices based on their estimated completion times, with priority given to devices with shorter times. The results of each task are then merged to form the final search result. To optimize performance, Milvus uses an LRU cache to store frequently accessed data blocks and overlaps data loading and computation stages for better resource usage. It also considers different transmission speeds between GPUs when scheduling tasks. Future work includes exploring query optimization techniques and handling more complex hardware environments.