尊敬的 微信汇率:1円 ≈ 0.046166 元 支付宝汇率:1円 ≈ 0.046257元 [退出登录]
SlideShare a Scribd company logo
FRAMEWORK
LANGCHAIN
“CHAIN” TOGETHER DIFFERENT COMPONENTS TO CREATE
MORE ADVANCED USE CASES AROUND LLMS
OZGUR OZKAN
MANAGING EXPECTATIONS
Who am I?
Startup Background
Educational Background
NEO AI
Conversationalist
Software Engineer Contractor @ Pollinate
Founder @ Keymate.AI
CTO in several tech startups one AI startup
Reminis and one generative AI product in 2016
Masters in AI (Facial Recognition / Similarity Search)
Bsc in CS
My twitter bio set in 2019: I may continue to tweet
even after I die thanks to future AI version of
myself. Not dead, yet.
ChatGPT rated this keynote 7/10
LANGCHAIN
PHILOSOPHY
1.Connect a language model to other sources of data
2.Allow a language model to interact with its
environment
CLIK HERE
NumPy and Pandas for LLMs, greatly increasing their
usability and functionality
Examples that leverages Langchain:
AgentGPT, babyAGI
Minecraft playing GPT4 (Voyager)***
LANGCHAIN
COMPONENTS
Schema: Text structure
Model:OpenAI completion, text-in text-out or embedded
Prompt templates
Indexes and Document Loaders
Memory: Long term and short term
Chains: LLMChain
Agents: which tools should be called or used
Components
Chains may consist of multiple components from
several modules
Minecraft playing GPT-4 (Voyager)
ReAct : REASONING AND ACTING IN
LANGUAGE MODELS
Plan-and-solve
Chain-of-thought reasoning
Had to develop my own langchain in iOS, tool using agent, chat history,
decision prioritisation, message type handler
ELEMENTS
Focus on things on
top
Research Papers
about prompting
methods
Langchain:LLM interaction framework but easy to
adapt to another Programming Language and System
REIMPLEMENTING
LANGCHAIN
What if you have to use another PL
(Not Python or TypeScript)
ORCHESTRATOR
EXAMPLE
User:
LLM:
LLM:
LLM:
Tool result
LLM
Langchain developer
Loop
TEMPLATE
Can we run ReAct
(Reason + Act) on
ChatGPT Plus?
It seems YES! we just need to find a way to inform LLM about thought patterns.
Human structured/abstracted execution may not be the best option. (langchain)
You as a human is just a tool for LLM. Langchain is already baked in ChatGPT.
REACT ON CHATGPT
PLUS
Utilize the "internetSearch" plugin and search for
the Reasoning and Acting Chain of Thought
framework. Generate reasoning traces and actions,
then apply the ReAct Framework that you'll learn
from the initial search.
Subsequently, look up the latest research on the
impact of climate change on biodiversity, and
summarize the key findings.
Too long, Didn't scan and read:
Select the Keymate.AI search plugin and prompt in the
following manner:
1.
2.
Magic keyword is continue. Continues the loop.
internetSearch Plugin (Keymate.AI) + 2 Extra
tools of your choice
COMPONENTS CONT.
LLMs (GPT4 , Hugging Face etc)
In LLMs we trust all others manage time, resources, limits, autonomy
Chat Models (Many built on top of GPT3)
Embeddings (To store and search/retrieve big data)
Toolkits (specialized agent for particular use case)
Tools (agents can use to achieve certain tasks)
Tokenizers (To count text size before passing to LLM)
Document Loaders (Text document processing)
Vectorstores (To store and index information to pass to agent)
Agent Strategy (Prompt engineering / Research Papers )
The more general an agent is the less powerful in terms of task handling
unless it has a very clever LLM.
Good plugins can still work really well with ChatGPT.
Interesting ideas:
Add user based memory to your plugin. (auth and good vectorstore is
needed)
Add smart GPT4 based chains to your plugin ( time limit :( )
TOKEN LIMITS
VECTORSTORES AND SIMILARITY
TAKEAWAYS
Can you observe the the thought reactions?
When it awaits for input it wants to use you as a tool.
Force trigger tools
Using continue keyword
Chain is derived from a dynamic state machine and it's endless
You were part of the chain in ChatGPT and starting prompt
Langchain is limited to two programming languages and limited platforms
Build your own langchain. Good to grasp the concept.
Amazing applications on top of langchain.
Your language model can run structured or unstructured other models so
that when right tools provided it can achieve anything.
Personal opinion: Customised prompt templates and chains is better than
using a framework, performance is limited with 30 seconds on the internet
as sockets are short lived but LLM needs more chaining and time to
execute sometimes.
Using 10 tools at the same time is possible but not over the Web.
Unstructured models should become structured and time-framed.
TAKEAWAYS
Point 1: It's important to leverage human tool correctly. Users should be
aware of using keywords and triggering specific tools when needed.
ChatGPT is actually half-GPT, when you increase human UX and usability
and prompt knowledge ChatGPT performs better.
Human Tool can be enhanced to pass beyond the limits of chatgpt :
Zero-shot, one-shot, few-shots learning concepts
Tool triggering
Usage of human memory to pass the context from one chat to another
Transfer Learning
Usage of Vector Databases for local memory, manual usage of vector
databases to enhance human input.
Naming entities and giving example to concepts.
Forcing ChatGPT to review and rate itself. Although it sounds harsh to a
human it makes chatGPT go beyond it's initial reasoning and pushes
forward.
User should know more about underlying agents: should I use the one that
does constant self-critique or should I use the one that hallucinates a bit
more.
Time limits are the bottleneck of AI systems
You need constant smart summarisation, divide n conquer techniques to
overcome the issues.
TAKEAWAYS
Specialized custom solutions work best; I suggest going bottom-up on
expert systems, but structuring and abstracting things may not be
beneficial.
Langchain is abstraction and it leaks a lot; leakages cause time and money
limits to hit early, and tasks usually either fail or require many iterations.
You don't have to overoptimize on prompt engineering if LLM is clever.
GPT4 learned how to apply ReAct framework with just a google search
plugin.
We need more clever LLMs.
Good applications are very rare.
CONTACT ME
Ozgur Ozkan
ozgur.ozkan@keymate.ai
EMAIL ADDRESS
+447919236753
PHONE NUMBER WEBSITE
keymate.ai
LinkedIn
THANK YOU!!

More Related Content

What's hot

How will development change with LLMs
How will development change with LLMsHow will development change with LLMs
How will development change with LLMs
Microsoft, InfuseAI, Appier, IBM, KaiOS
 
Use Case Patterns for LLM Applications (1).pdf
Use Case Patterns for LLM Applications (1).pdfUse Case Patterns for LLM Applications (1).pdf
Use Case Patterns for LLM Applications (1).pdf
M Waleed Kadous
 
Large Language Models, No-Code, and Responsible AI - Trends in Applied NLP in...
Large Language Models, No-Code, and Responsible AI - Trends in Applied NLP in...Large Language Models, No-Code, and Responsible AI - Trends in Applied NLP in...
Large Language Models, No-Code, and Responsible AI - Trends in Applied NLP in...
David Talby
 
The Rise of the LLMs - How I Learned to Stop Worrying & Love the GPT!
The Rise of the LLMs - How I Learned to Stop Worrying & Love the GPT!The Rise of the LLMs - How I Learned to Stop Worrying & Love the GPT!
The Rise of the LLMs - How I Learned to Stop Worrying & Love the GPT!
taozen
 
Retrieval Augmented Generation in Practice: Scalable GenAI platforms with k8s...
Retrieval Augmented Generation in Practice: Scalable GenAI platforms with k8s...Retrieval Augmented Generation in Practice: Scalable GenAI platforms with k8s...
Retrieval Augmented Generation in Practice: Scalable GenAI platforms with k8s...
Mihai Criveti
 
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
How Does Generative AI Actually Work? (a quick semi-technical introduction to...How Does Generative AI Actually Work? (a quick semi-technical introduction to...
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
ssuser4edc93
 
Fine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsFine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP models
OVHcloud
 
ChatGPT_ppf.pdf
ChatGPT_ppf.pdfChatGPT_ppf.pdf
ChatGPT_ppf.pdf
ssuser693b9a
 
Large Language Models - Chat AI.pdf
Large Language Models - Chat AI.pdfLarge Language Models - Chat AI.pdf
Large Language Models - Chat AI.pdf
David Rostcheck
 
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
Sri Ambati
 
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdfRetrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Po-Chuan Chen
 
Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)
VenkateshMurugadas
 
How do OpenAI GPT Models Work - Misconceptions and Tips for Developers
How do OpenAI GPT Models Work - Misconceptions and Tips for DevelopersHow do OpenAI GPT Models Work - Misconceptions and Tips for Developers
How do OpenAI GPT Models Work - Misconceptions and Tips for Developers
Ivo Andreev
 
Intro to nlp
Intro to nlpIntro to nlp
Intro to nlp
ankit_ppt
 
A comprehensive guide to prompt engineering.pdf
A comprehensive guide to prompt engineering.pdfA comprehensive guide to prompt engineering.pdf
A comprehensive guide to prompt engineering.pdf
AnastasiaSteele10
 
OpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptxOpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptx
Udaiappa Ramachandran
 
presentation.pdf
presentation.pdfpresentation.pdf
presentation.pdf
caa28steve
 
Unlocking the Power of Generative AI An Executive's Guide.pdf
Unlocking the Power of Generative AI An Executive's Guide.pdfUnlocking the Power of Generative AI An Executive's Guide.pdf
Unlocking the Power of Generative AI An Executive's Guide.pdf
PremNaraindas1
 
Intro to LLMs
Intro to LLMsIntro to LLMs
Intro to LLMs
Loic Merckel
 
PyBay23: Understanding LangChain Agents and Tools with Twilio (or with SMS)....
PyBay23:  Understanding LangChain Agents and Tools with Twilio (or with SMS)....PyBay23:  Understanding LangChain Agents and Tools with Twilio (or with SMS)....
PyBay23: Understanding LangChain Agents and Tools with Twilio (or with SMS)....
Elizabeth (Lizzie) Siegle
 

What's hot (20)

How will development change with LLMs
How will development change with LLMsHow will development change with LLMs
How will development change with LLMs
 
Use Case Patterns for LLM Applications (1).pdf
Use Case Patterns for LLM Applications (1).pdfUse Case Patterns for LLM Applications (1).pdf
Use Case Patterns for LLM Applications (1).pdf
 
Large Language Models, No-Code, and Responsible AI - Trends in Applied NLP in...
Large Language Models, No-Code, and Responsible AI - Trends in Applied NLP in...Large Language Models, No-Code, and Responsible AI - Trends in Applied NLP in...
Large Language Models, No-Code, and Responsible AI - Trends in Applied NLP in...
 
The Rise of the LLMs - How I Learned to Stop Worrying & Love the GPT!
The Rise of the LLMs - How I Learned to Stop Worrying & Love the GPT!The Rise of the LLMs - How I Learned to Stop Worrying & Love the GPT!
The Rise of the LLMs - How I Learned to Stop Worrying & Love the GPT!
 
Retrieval Augmented Generation in Practice: Scalable GenAI platforms with k8s...
Retrieval Augmented Generation in Practice: Scalable GenAI platforms with k8s...Retrieval Augmented Generation in Practice: Scalable GenAI platforms with k8s...
Retrieval Augmented Generation in Practice: Scalable GenAI platforms with k8s...
 
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
How Does Generative AI Actually Work? (a quick semi-technical introduction to...How Does Generative AI Actually Work? (a quick semi-technical introduction to...
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
 
Fine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsFine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP models
 
ChatGPT_ppf.pdf
ChatGPT_ppf.pdfChatGPT_ppf.pdf
ChatGPT_ppf.pdf
 
Large Language Models - Chat AI.pdf
Large Language Models - Chat AI.pdfLarge Language Models - Chat AI.pdf
Large Language Models - Chat AI.pdf
 
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
Open Source h2oGPT with Retrieval Augmented Generation (RAG), Web Search, and...
 
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdfRetrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.pdf
 
Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)
 
How do OpenAI GPT Models Work - Misconceptions and Tips for Developers
How do OpenAI GPT Models Work - Misconceptions and Tips for DevelopersHow do OpenAI GPT Models Work - Misconceptions and Tips for Developers
How do OpenAI GPT Models Work - Misconceptions and Tips for Developers
 
Intro to nlp
Intro to nlpIntro to nlp
Intro to nlp
 
A comprehensive guide to prompt engineering.pdf
A comprehensive guide to prompt engineering.pdfA comprehensive guide to prompt engineering.pdf
A comprehensive guide to prompt engineering.pdf
 
OpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptxOpenAI-Copilot-ChatGPT.pptx
OpenAI-Copilot-ChatGPT.pptx
 
presentation.pdf
presentation.pdfpresentation.pdf
presentation.pdf
 
Unlocking the Power of Generative AI An Executive's Guide.pdf
Unlocking the Power of Generative AI An Executive's Guide.pdfUnlocking the Power of Generative AI An Executive's Guide.pdf
Unlocking the Power of Generative AI An Executive's Guide.pdf
 
Intro to LLMs
Intro to LLMsIntro to LLMs
Intro to LLMs
 
PyBay23: Understanding LangChain Agents and Tools with Twilio (or with SMS)....
PyBay23:  Understanding LangChain Agents and Tools with Twilio (or with SMS)....PyBay23:  Understanding LangChain Agents and Tools with Twilio (or with SMS)....
PyBay23: Understanding LangChain Agents and Tools with Twilio (or with SMS)....
 

Similar to LangChain Intro by KeyMate.AI

How to Build an App with ChatGPT.pdf
How to Build an App with ChatGPT.pdfHow to Build an App with ChatGPT.pdf
How to Build an App with ChatGPT.pdf
StephenAmell4
 
Generative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of contentGenerative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of content
Hitesh Mohapatra
 
How to Build an App with ChatGPT.pdf
How to Build an App with ChatGPT.pdfHow to Build an App with ChatGPT.pdf
How to Build an App with ChatGPT.pdf
MatthewHaws4
 
chatgpt seminar ppt.pptx
chatgpt seminar ppt.pptxchatgpt seminar ppt.pptx
chatgpt seminar ppt.pptx
AltafSMT
 
chatgpt seminar ppt.pptx
chatgpt seminar ppt.pptxchatgpt seminar ppt.pptx
chatgpt seminar ppt.pptx
AltafSMT
 
ChatGPT Shaping Tomorrow's Conversations
ChatGPT Shaping Tomorrow's ConversationsChatGPT Shaping Tomorrow's Conversations
ChatGPT Shaping Tomorrow's Conversations
FahadZafar39
 
ChatGPT and Mulesoft.pptx
ChatGPT and Mulesoft.pptxChatGPT and Mulesoft.pptx
ChatGPT and Mulesoft.pptx
shiva310211
 
ChatGPT Usage In Software Development – Curse or Boon.pdf
ChatGPT Usage In Software Development – Curse or Boon.pdfChatGPT Usage In Software Development – Curse or Boon.pdf
ChatGPT Usage In Software Development – Curse or Boon.pdf
Laura Miller
 
ChatGPT usage in software development - curse or boon.pdf
ChatGPT usage in software development - curse or boon.pdfChatGPT usage in software development - curse or boon.pdf
ChatGPT usage in software development - curse or boon.pdf
Laura Miller
 
What is Chatgpt Complete Guide
What is Chatgpt Complete GuideWhat is Chatgpt Complete Guide
What is Chatgpt Complete Guide
Ravendra Singh
 

Similar to LangChain Intro by KeyMate.AI (10)

How to Build an App with ChatGPT.pdf
How to Build an App with ChatGPT.pdfHow to Build an App with ChatGPT.pdf
How to Build an App with ChatGPT.pdf
 
Generative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of contentGenerative AI leverages algorithms to create various forms of content
Generative AI leverages algorithms to create various forms of content
 
How to Build an App with ChatGPT.pdf
How to Build an App with ChatGPT.pdfHow to Build an App with ChatGPT.pdf
How to Build an App with ChatGPT.pdf
 
chatgpt seminar ppt.pptx
chatgpt seminar ppt.pptxchatgpt seminar ppt.pptx
chatgpt seminar ppt.pptx
 
chatgpt seminar ppt.pptx
chatgpt seminar ppt.pptxchatgpt seminar ppt.pptx
chatgpt seminar ppt.pptx
 
ChatGPT Shaping Tomorrow's Conversations
ChatGPT Shaping Tomorrow's ConversationsChatGPT Shaping Tomorrow's Conversations
ChatGPT Shaping Tomorrow's Conversations
 
ChatGPT and Mulesoft.pptx
ChatGPT and Mulesoft.pptxChatGPT and Mulesoft.pptx
ChatGPT and Mulesoft.pptx
 
ChatGPT Usage In Software Development – Curse or Boon.pdf
ChatGPT Usage In Software Development – Curse or Boon.pdfChatGPT Usage In Software Development – Curse or Boon.pdf
ChatGPT Usage In Software Development – Curse or Boon.pdf
 
ChatGPT usage in software development - curse or boon.pdf
ChatGPT usage in software development - curse or boon.pdfChatGPT usage in software development - curse or boon.pdf
ChatGPT usage in software development - curse or boon.pdf
 
What is Chatgpt Complete Guide
What is Chatgpt Complete GuideWhat is Chatgpt Complete Guide
What is Chatgpt Complete Guide
 

Recently uploaded

LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
DanBrown980551
 
Discover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched ContentDiscover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched Content
ScyllaDB
 
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
AlexanderRichford
 
Automation Student Developers Session 3: Introduction to UI Automation
Automation Student Developers Session 3: Introduction to UI AutomationAutomation Student Developers Session 3: Introduction to UI Automation
Automation Student Developers Session 3: Introduction to UI Automation
UiPathCommunity
 
Cyber Recovery Wargame
Cyber Recovery WargameCyber Recovery Wargame
Cyber Recovery Wargame
Databarracks
 
CTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database MigrationCTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database Migration
ScyllaDB
 
Multivendor cloud production with VSF TR-11 - there and back again
Multivendor cloud production with VSF TR-11 - there and back againMultivendor cloud production with VSF TR-11 - there and back again
Multivendor cloud production with VSF TR-11 - there and back again
Kieran Kunhya
 
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
anilsa9823
 
Communications Mining Series - Zero to Hero - Session 2
Communications Mining Series - Zero to Hero - Session 2Communications Mining Series - Zero to Hero - Session 2
Communications Mining Series - Zero to Hero - Session 2
DianaGray10
 
From NCSA to the National Research Platform
From NCSA to the National Research PlatformFrom NCSA to the National Research Platform
From NCSA to the National Research Platform
Larry Smarr
 
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance PanelsNorthern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving
 
Building a Semantic Layer of your Data Platform
Building a Semantic Layer of your Data PlatformBuilding a Semantic Layer of your Data Platform
Building a Semantic Layer of your Data Platform
Enterprise Knowledge
 
Containers & AI - Beauty and the Beast!?!
Containers & AI - Beauty and the Beast!?!Containers & AI - Beauty and the Beast!?!
Containers & AI - Beauty and the Beast!?!
Tobias Schneck
 
MongoDB to ScyllaDB: Technical Comparison and the Path to Success
MongoDB to ScyllaDB: Technical Comparison and the Path to SuccessMongoDB to ScyllaDB: Technical Comparison and the Path to Success
MongoDB to ScyllaDB: Technical Comparison and the Path to Success
ScyllaDB
 
Real-Time Persisted Events at Supercell
Real-Time Persisted Events at  SupercellReal-Time Persisted Events at  Supercell
Real-Time Persisted Events at Supercell
ScyllaDB
 
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - MydbopsMySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
Mydbops
 
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My IdentityCNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
Cynthia Thomas
 
ScyllaDB Real-Time Event Processing with CDC
ScyllaDB Real-Time Event Processing with CDCScyllaDB Real-Time Event Processing with CDC
ScyllaDB Real-Time Event Processing with CDC
ScyllaDB
 
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdfSession 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
UiPathCommunity
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 

Recently uploaded (20)

LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
LF Energy Webinar: Carbon Data Specifications: Mechanisms to Improve Data Acc...
 
Discover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched ContentDiscover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched Content
 
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
 
Automation Student Developers Session 3: Introduction to UI Automation
Automation Student Developers Session 3: Introduction to UI AutomationAutomation Student Developers Session 3: Introduction to UI Automation
Automation Student Developers Session 3: Introduction to UI Automation
 
Cyber Recovery Wargame
Cyber Recovery WargameCyber Recovery Wargame
Cyber Recovery Wargame
 
CTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database MigrationCTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database Migration
 
Multivendor cloud production with VSF TR-11 - there and back again
Multivendor cloud production with VSF TR-11 - there and back againMultivendor cloud production with VSF TR-11 - there and back again
Multivendor cloud production with VSF TR-11 - there and back again
 
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
 
Communications Mining Series - Zero to Hero - Session 2
Communications Mining Series - Zero to Hero - Session 2Communications Mining Series - Zero to Hero - Session 2
Communications Mining Series - Zero to Hero - Session 2
 
From NCSA to the National Research Platform
From NCSA to the National Research PlatformFrom NCSA to the National Research Platform
From NCSA to the National Research Platform
 
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance PanelsNorthern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
 
Building a Semantic Layer of your Data Platform
Building a Semantic Layer of your Data PlatformBuilding a Semantic Layer of your Data Platform
Building a Semantic Layer of your Data Platform
 
Containers & AI - Beauty and the Beast!?!
Containers & AI - Beauty and the Beast!?!Containers & AI - Beauty and the Beast!?!
Containers & AI - Beauty and the Beast!?!
 
MongoDB to ScyllaDB: Technical Comparison and the Path to Success
MongoDB to ScyllaDB: Technical Comparison and the Path to SuccessMongoDB to ScyllaDB: Technical Comparison and the Path to Success
MongoDB to ScyllaDB: Technical Comparison and the Path to Success
 
Real-Time Persisted Events at Supercell
Real-Time Persisted Events at  SupercellReal-Time Persisted Events at  Supercell
Real-Time Persisted Events at Supercell
 
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - MydbopsMySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
 
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My IdentityCNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
 
ScyllaDB Real-Time Event Processing with CDC
ScyllaDB Real-Time Event Processing with CDCScyllaDB Real-Time Event Processing with CDC
ScyllaDB Real-Time Event Processing with CDC
 
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdfSession 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 

LangChain Intro by KeyMate.AI

  • 1. FRAMEWORK LANGCHAIN “CHAIN” TOGETHER DIFFERENT COMPONENTS TO CREATE MORE ADVANCED USE CASES AROUND LLMS OZGUR OZKAN
  • 2. MANAGING EXPECTATIONS Who am I? Startup Background Educational Background NEO AI Conversationalist Software Engineer Contractor @ Pollinate Founder @ Keymate.AI CTO in several tech startups one AI startup Reminis and one generative AI product in 2016 Masters in AI (Facial Recognition / Similarity Search) Bsc in CS My twitter bio set in 2019: I may continue to tweet even after I die thanks to future AI version of myself. Not dead, yet. ChatGPT rated this keynote 7/10
  • 3. LANGCHAIN PHILOSOPHY 1.Connect a language model to other sources of data 2.Allow a language model to interact with its environment CLIK HERE NumPy and Pandas for LLMs, greatly increasing their usability and functionality Examples that leverages Langchain: AgentGPT, babyAGI Minecraft playing GPT4 (Voyager)***
  • 4. LANGCHAIN COMPONENTS Schema: Text structure Model:OpenAI completion, text-in text-out or embedded Prompt templates Indexes and Document Loaders Memory: Long term and short term Chains: LLMChain Agents: which tools should be called or used Components Chains may consist of multiple components from several modules
  • 5. Minecraft playing GPT-4 (Voyager) ReAct : REASONING AND ACTING IN LANGUAGE MODELS Plan-and-solve Chain-of-thought reasoning Had to develop my own langchain in iOS, tool using agent, chat history, decision prioritisation, message type handler ELEMENTS Focus on things on top Research Papers about prompting methods Langchain:LLM interaction framework but easy to adapt to another Programming Language and System
  • 6. REIMPLEMENTING LANGCHAIN What if you have to use another PL (Not Python or TypeScript) ORCHESTRATOR
  • 9. Can we run ReAct (Reason + Act) on ChatGPT Plus? It seems YES! we just need to find a way to inform LLM about thought patterns. Human structured/abstracted execution may not be the best option. (langchain) You as a human is just a tool for LLM. Langchain is already baked in ChatGPT.
  • 10.
  • 11. REACT ON CHATGPT PLUS Utilize the "internetSearch" plugin and search for the Reasoning and Acting Chain of Thought framework. Generate reasoning traces and actions, then apply the ReAct Framework that you'll learn from the initial search. Subsequently, look up the latest research on the impact of climate change on biodiversity, and summarize the key findings. Too long, Didn't scan and read: Select the Keymate.AI search plugin and prompt in the following manner: 1. 2. Magic keyword is continue. Continues the loop. internetSearch Plugin (Keymate.AI) + 2 Extra tools of your choice
  • 12. COMPONENTS CONT. LLMs (GPT4 , Hugging Face etc) In LLMs we trust all others manage time, resources, limits, autonomy Chat Models (Many built on top of GPT3) Embeddings (To store and search/retrieve big data) Toolkits (specialized agent for particular use case) Tools (agents can use to achieve certain tasks) Tokenizers (To count text size before passing to LLM) Document Loaders (Text document processing) Vectorstores (To store and index information to pass to agent) Agent Strategy (Prompt engineering / Research Papers ) The more general an agent is the less powerful in terms of task handling unless it has a very clever LLM. Good plugins can still work really well with ChatGPT. Interesting ideas: Add user based memory to your plugin. (auth and good vectorstore is needed) Add smart GPT4 based chains to your plugin ( time limit :( )
  • 15. TAKEAWAYS Can you observe the the thought reactions? When it awaits for input it wants to use you as a tool. Force trigger tools Using continue keyword Chain is derived from a dynamic state machine and it's endless You were part of the chain in ChatGPT and starting prompt Langchain is limited to two programming languages and limited platforms Build your own langchain. Good to grasp the concept. Amazing applications on top of langchain. Your language model can run structured or unstructured other models so that when right tools provided it can achieve anything. Personal opinion: Customised prompt templates and chains is better than using a framework, performance is limited with 30 seconds on the internet as sockets are short lived but LLM needs more chaining and time to execute sometimes. Using 10 tools at the same time is possible but not over the Web. Unstructured models should become structured and time-framed.
  • 16. TAKEAWAYS Point 1: It's important to leverage human tool correctly. Users should be aware of using keywords and triggering specific tools when needed. ChatGPT is actually half-GPT, when you increase human UX and usability and prompt knowledge ChatGPT performs better. Human Tool can be enhanced to pass beyond the limits of chatgpt : Zero-shot, one-shot, few-shots learning concepts Tool triggering Usage of human memory to pass the context from one chat to another Transfer Learning Usage of Vector Databases for local memory, manual usage of vector databases to enhance human input. Naming entities and giving example to concepts. Forcing ChatGPT to review and rate itself. Although it sounds harsh to a human it makes chatGPT go beyond it's initial reasoning and pushes forward. User should know more about underlying agents: should I use the one that does constant self-critique or should I use the one that hallucinates a bit more. Time limits are the bottleneck of AI systems You need constant smart summarisation, divide n conquer techniques to overcome the issues.
  • 17. TAKEAWAYS Specialized custom solutions work best; I suggest going bottom-up on expert systems, but structuring and abstracting things may not be beneficial. Langchain is abstraction and it leaks a lot; leakages cause time and money limits to hit early, and tasks usually either fail or require many iterations. You don't have to overoptimize on prompt engineering if LLM is clever. GPT4 learned how to apply ReAct framework with just a google search plugin. We need more clever LLMs. Good applications are very rare.
  • 18. CONTACT ME Ozgur Ozkan ozgur.ozkan@keymate.ai EMAIL ADDRESS +447919236753 PHONE NUMBER WEBSITE keymate.ai LinkedIn
  翻译: