AIM Weekly 09 Sept 2024

Timothy SpannTimothy Spann
4 min read

9-September-2024

Tim Spann @PaaSDev Milvus - Attu - Feder - GPTCache - VectorDB Bench https://linktr.ee/Milvusio

AIM Weekly (Attu - Milvus (Tim-Tam))

https://www.technologyreview.com/2024/08/22/1097224/we-finally-have-a-definition-for-open-source-ai?

image

TL;DR --- But you should #154 - 09-September-2024

πŸ“Ž Mistral Nemo
πŸ€– Evaluating LLM Conversations
πŸ“Š Building with NVIDIA and Milvus
πŸ“± Rag Evaluation using Ragas
πŸ–₯️ AnythingLLM
πŸ“’ RDBMS vs Vector DB
πŸ–₯️ LLMWare
πŸ¦β€πŸ”₯NIM Agent Buildprints

Upcoming

🌧️ Sept 12: Virtual: Voxel51
πŸ—½ Sept 18: NYC: Unstructured Data Meetup NYC
πŸ• Sept 19: NYC: AI Camp NYC
🧠 Sept 19: Virtual RAG Pipelines with Real-Time
πŸš• Oct 23: NYC: Unstructured Data Meetup NYC
πŸ“‘ Oct 27-29: Raleigh, NC: All Things Open
πŸ”₯ Milvus 2.4.10 (RBAC for CDC, Database Access Restrictions, Upsert with Auto ID, Field Partial Load Collection [Beta Preview])

Last Week

πŸ–₯️ Princeton AI
πŸŒƒ Princeton AI Report
πŸŒ† MultiVector Advanced Search

Apps, Demos, Examples, Models, Notebooks and Projects

πŸš€ Partitioning Data for Performance by @ Tim Spann πŸš€ Air Quality Applications & Notebook by @ Tim Spann
πŸ€– Milvus Partitioning by @ Tim Spann
πŸ’° [https://www.youtube.com/watch?v=IiuxKARtDeQ](Fun](https://www.youtube.com/watch?v=IiuxKARtDeQ Friday Discussion) by @ Chris & Tim
πŸ‘½ [https://www.youtube.com/watch?v=4ta842VAyIM](Challenges](https://www.youtube.com/watch?v=4ta842VAyIM in Structured Document Data Extraction at Scale with LLMs)

image

Connect with Us

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://forms.gle/96nwiyt9LWGfAXxs5

This is Issue #154

Join us at the next meetup in September.

Check out the RAGBuilder Github repo: https://github.com/KruxAI/ragbuilder

Webinar Coming

Sept 12 https://voxel51.com/computer-vision-events/ai-machine-learning-computer-vision-meetup-sept-12-2024/

Sept 19 https://zilliz.com/event/rag-pipelines-with-real-time-data

New Zilliz Cloud

https://docs.zilliz.com/docs/release-notes-2100

VectorDB Basics:

What are Vector Databases, and How Do They Work?

Vector Databases vs. Relational Database

Vector Database vs Graph Database

Compare Vector Databases, Vector Search Libraries, and Plugins

What Are Vector Embeddings?

Introduction to Vector Similarity Search

How to evaluate a vector database?

Benchmark Vector Database Performance: Techniques & Insights

Vector Database Benchmark tools:

VectorDBBench: Open-Source Vector Database Benchmark Tool

ANN Benchmarks

Everything you want to know about RAG

What is RAG?

OpenAI RAG vs. Your Customized RAG: Which One Is Better?

Will RAG Be Killed by Long-Context LLMs?

Optimizing RAG Applications: A Guide to Methodologies, Metrics, and Evaluation Tools for Enhanced Reliability

How to Evaluate RAG Applications

Vector Databases Are the Base of RAG Retrieval

RAG Enhancement techniques and tools:

Enhancing RAG with Knowledge Graphs

Optimizing RAG with Rerankers: The Role and Trade-offs

What is GraphRAG? Enhancing RAG with Knowledge Graphs

Building On-Prem RAG for Data Security

Crafting Highly Efficient RAG with DSPy

Build a RAG agent with an extended LLM context window using MemGPT

RAG tutorials

Local RAG Setup with Llama 3, Ollama, Milvus & LangChain

Build a Multimodal RAG with Gemini, BGE-M3, Milvus and LangChain

Building Intelligent RAG Applications with LangServe, LangGraph, and Milvus

Local Agentic RAG with LangGraph and Llama 3

A Guide to Chunking Strategies for Retrieval Augmented Generation (RAG)

Building RAG with Milvus, vLLM, and Meta’s Llama 3.1

Embedding, ML, and AI

Top Performing AI Models for Your GenAI Apps | Zilliz

How to Choose the Right Embedding Model for Your Data

Evaluating Your Embedding Model

Training Your Own Text Embedding Model - Zilliz blog

Generative AI Resource Hub | Zilliz

Articles

Partitioning Collections by Name https://medium.com/@tspann/partitioning-collections-by-name-395eb48a2238

Report: Building the Future of Startups - Enhanced with Vector Databases and AI https://medium.com/@tspann/report-building-the-future-of-startups-enhanced-with-vector-databases-and-ai-aa3bf6d06bdc

Multiple Vectors and Advanced Search Data Model Design https://dzone.com/articles/multiple-vectors-and-advanced-search-data-model-design

Multi-Vector Search https://medium.com/@tspann/utilizing-multiple-vectors-and-advanced-search-data-model-design-for-city-data-705d68d8daf2

What's in the Air Tonight, Mr. Milvus. (Air Quality + Vector Database + RAG) https://medium.com/@tspann/whats-in-the-air-tonight-mr-milvus-fbd42f06e482

Build a Rag App with NVIDIA NIM and Milvus https://thenewstack.io/build-a-rag-app-with-nvidia-nim-apis-and-a-vector-database/?

Videos

.NET Conf with AI and Milvus https://www.youtube.com/live/3x9ynkurJoI

AI Camp Videos - Pose Estimation https://www.youtube.com/watch?v=R6UXk_iDY-w https://youtu.be/dydqDmo4LoM https://youtu.be/uwM5Dlnk6Jk

Slides

https://www.slideshare.net/slideshow/08-15-2024-ai-camp-meetup-human-pose-estimation-in-real-time-utilizing-edge-ai-accelerated-hardware/271017430

https://www.slideshare.net/slideshow/08-13-2024-nyc-meetup-unstructured-data-processing-from-cloud-to-edge-milvus/270956288

Events

September 3, 2024: StartupGrind Princeton: Building the Future AI & Startups in Action https://www.startupgrind.com/events/details/startup-grind-princeton-presents-building-the-future-ai-amp-startups-in-action/cohost-princeton

September 12, 2024: Voxel 51 webinar https://www.linkedin.com/feed/update/urn:li:activity:7232506837336473601/

September 18, 2024: Unstructured Data Meetup NYC https://lu.ma/9o3la3gf

https://allevents.in/manhattan/unstructured-data-meetup-new-york/80001083991651?ref=smdl

September 19, 2024: AI Camp NYC https://www.aicamp.ai/event/eventdetails/W2024091915

September 26, 2024: Conf42 Kube Native https://www.conf42.com/Kube_Native_2024_Tim_Spann_cloud_native_open_source_vector_databases

September 26, 2024: Streamnative Partner Webinar

October 23, 2024: Unstructured Data Meetup NYC https://lu.ma/naqu6xrd

October 27 - 29, Raleigh, NC - All Things Open https://2024.allthingsopen.org/speakers/timothy-spann https://2024.allthingsopen.org/sessions/advanced-retrieval-augmented-generation-rag-techniques

image

October 31 - Live stream from my Halloween decorations with three 12 foot skeletons

November 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

November 15, 2024: Build Stuff. Online. Adding Generative AI to Real-Time Streaming Pipelines https://www.developerweek.com/cloudx/speakers/

November 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

November 21, 2024: Big Data Conference 2024 EU

image

https://events.pinetool.ai/3254/#sessions/108389?referrer%5Bpathname%5D=%2Fsessions&referrer%5Bsearch%5D=&referrer%5Btitle%5D=Sessions

November 21, 2024: Unstructured Data Meetup NYC https://lu.ma/cqxuproe

December 4, 2024: Grace Hopper Celebration - Open Source - Milvus https://ghc.anitab.org/open-source/

December 10, 2024: Unstructured Data Meetup NYC https://lu.ma/u2ijucyv

Code

Models

Tools

Β© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack


πŸ–₯️ Videos: https://www.youtube.com/@MilvusVectorDatabase/videos

X Twitter -   / milvusio  https://x.com/milvusio

πŸ”— Linkedin:  / zilliz  https://www.linkedin.com/company/zilliz/

😺 GitHub: https://github.com/milvus-io/milvus

🦾 Invitation to join discord:   / discord  https://discord.com/invite/FjCMmaJng6

https://discord.gg/9jdMRPJb?event=1273364262710022209
0
Subscribe to my newsletter

Read articles from Timothy Spann directly inside your inbox. Subscribe to the newsletter, and don't miss out.

Written by

Timothy Spann
Timothy Spann