Infer-Retrieve-Rank, a new program for extreme multi-label classification, based on DSPy. Infer-Retrieve-Rank achieves state-of-the-art results on three benchmarks using one frozen retriever combine with two in-context learning modules.
These ICL-RAG examples show that the future of prompt and pipeline engineering. Modular DSPy programs, once optimized, can serve as highly effective general-purpose solutions.
Arxiv preprint (all rights with authors):
In-Context Learning for Extreme Multi-Label Classification
arxiv.org/pdf/2401.12178.pdf
Github repo:
github.com/KarelDO/xmc.dspy
#newtechnology
#airesearch