Neural Search Pills

Foundational concepts

• What is Neural Search?
• What is Question Answering?

Retrieval

• Sparse retrieval: Bag-of-words, TF-IDF
• Sparse retrieval: BM25
• From sparse representations to Language Models
• Dense Passage Retrieval
• Sentence Transformers for Dense Retrieval
• Retrieve and Re-Rank
• Retrieval Evaluation

Question Answering

• Combining document retrieval and machine comprehension for Question Answering
• Machine Reading Models (= Readers)
• Extractive Question Answering Evaluation
• Retrieval-based Answer Generation

Neural Search Ecosystem

• Vector Search
• Document Stores and Vector Databases
• FAISS
• Neural Search/LLM frameworks

Misc on Neural Search

• Question Answering on Tables
• Question Generation
• GPL: Generative Pseudo Labeling
• CLIP: Contrastive Language-Image Pre-Training

Other

• Natural Language Inference models and Zero-Shot Classification
• Model Distillation