Roadmap for GEN AI

NLP

Text Preprocessing

Tokenization
Stop word removal
Stemming and lemmatization
Lowercasing and punctuation removal

Pos Tagging

Name Entity Recognition

Test vectorization

This the core of GenAI Rag based models

Bag of words
TF-IDF
Word embeddings

LLM

Learn basics of LLM

Prompt engineering

Quantization

Finetuning LLM

Langchain

Helps you to make chat bots and Gen AI applications.