Notwithstanding the nail-biting Open AI leadership musical chairs episode which had us all glued to Twitter / X, the Gen AI community has been churning out bleeding edge developments, non-stop.
It is indeed overwhelming!
- Where do you start?
- Where can you find more information that is credible, to-the-point, usable, and perhaps implementable?
Not to worry!
I put together a curated list of links to excellent educators, articles, blogs, and courseware that you absolutely need to bookmark / follow.Obviously, this is not a comprehensive list and is intended to keep this post short. Please add your favorites in the comments section below to help your followers.
People
A short list of amazing people to follow and learn from:
- Dr. Andrej Karpathy—one of the founding members of Open AI (https://karpathy.ai/)
- Dr. Sabastien Raschka– Lead AI Educator at Lightning AI, (https://sebastianraschka.com/)
- Sanyam Bhutani—a Kaggle Grandmaster and Senior Data Scientist at H2O and someone who generously shares all his learnings (https://sanyambhutani.com/)
- Eugene Yan—Senior Applied Scientist at Amazon one of the best AI/ML bloggers for over a decade (https://eugeneyan.com/)
- Chip Hyuen– co-founder of Claypot AI, a platform for real-time machine learning. (https://huyenchip.com/)
- Bindu Reddy—Her tweets about LLMs are a gold mine. She is also the founder of Abacus.ai (https://abacus.ai/about)
- Barr Moses– Co-Founder and CEO, Monte Carlo https://barrmoses.medium.com
- Dr. Srijan Kumar, Asst. Professor at Georgia Tech—regularly posts on LLMs, LLM safety, and security aspects https://faculty.cc.gatech.edu/~srijan/
- Dr. Ali Arsanjani, Director of AI /ML Partner Engineering at Google Cloud, https://dr-arsanjani.medium.com/
Videos
Some of the best Intro Videos out there for LLMs
- Intro to LLMs by Andrej karpathy, this is an absolutely goldmine: https://www.youtube.com/watch?v=zjkBMFhNj_g
- LLMs for hackers by Jeremy Howard: https://www.youtube.com/watch?v=jkrNMKz9pWU
Technical Articles
A Very Shortlist of Must-Read Technical Papers
- “Attention is All You Need,” https://bit.ly/47MdhT3
- GPT-4 A Technical report: https://arxiv.org/pdf/2303.08774.pdf
- Llama2: https://arxiv.org/pdf/2307.09288.pdf
- FrugalGPT: https://arxiv.org/abs/2305.05176
- Evaluating LLMs– https://arxiv.org/abs/2310.19736
- Constitutional AI: https://arxiv.org/abs/2212.08073
- Chain-of-Thought Prompting: https://arxiv.org/pdf/2201.11903.pdf
Blogs and Tutorials
Evaluating Gen AI / LLM Systems
- https://www.anthropic.com/index/evaluating-ai-systems
- https://www.mosaicml.com/llm-evaluation
- https://www.deepset.ai/blog/generative-llm-evaluation-rag
LangChain
- An excellent library of articles and examples directly from the source: https://python.langchain.com/docs/expression_language/cookbook/
- The LangChain handbook: https://www.pinecone.io/learn/series/langchain/
Vector Databases (RAG, Chunking, etc.)
- A very good 3 part article on Vector Databases: https://thedataquarry.com/posts/vector-db-1/
- Learning chunking strategies for RAG: https://www.pinecone.io/learn/chunking-strategies/
- Building a RAG framework and working with Open Source models: https://bit.ly/3sTOM7K
LLM Security related blogs
Excellent detailed blogs by Matt Felton that nicely summarize security and controls for the Azure Open AI service
- https://journeyofthegeek.com/2023/03/19/infra-security-stuff-in-the-azure-openai-service/
- https://journeyofthegeek.com/2023/10/17/securing-azure-openai-studio/
A webpage about LLM webpages 😊
Courses
Some of the Best Courses on Gen AI Concepts
- The whole set of Gen AI courses from Dr. Andrew Ng’s Deeplearning.ai is here: https://www.deeplearning.ai/short-courses/
For specific topics
- LLM Short Courses from Weights and Biases: https://www.wandb.courses/pages/w-b-courses
- Prompt Engineering: https://www.deeplearning.ai/short-courses/chatgpt-prompt-engineering-for-developers/
- LLM Quality and Safety: https://learn.deeplearning.ai/quality-safety-llm-applications/
Vishnu Nanduri, PHD 