Tracing AI apps

Monitoring AI applications - Storing logs

• Loki - collects the logs of the application

• prometeus - CPU and memory utilizations

• Graphana - injest prometeus data into graphana and create dashboard out of it

• Dynatrace - monitoring tool

These tools are not available for AI tools as they are complex

---

Langsmith Monitoring tool for AI applications

• Closed source

https://docs.smith.langchain.com/

• LangHub - to pull prompts from

---

Langfuse

Cloud Version :

• 

  Called weather agent then langfuse created a trace out of it

Self-hosted : using docker

• https://langfuse.com/self-hosting/docker-compose

• langfuse uses clickhouse - high thorughput db, minio - to store images (alternative for S3), postgress to store application data and redis for caching

---

• Create AI project and post it on x.com

• Solve real world problems using AI

  • e.g. AI code reviewer like Code Rabbit with Chrome and VS code extension | Chat agent on postgress DB - give me schema QueryGPT (fetch postgress schema this is schema) | AI DevOps engineer AI will call tools using terraform to create ec2 etc

  • 

• Use your mind to solve real world problem