่ทณ่‡ณไธป่ฆๅ…งๅฎน

Embedchain

Embedchain ๆ˜ฏไธ€ๅ€‹ RAG ๆก†ๆžถ๏ผŒ็”จๆ–ผๅปบ็ซ‹่ณ‡ๆ–™็ฎก็ทšใ€‚ๅฎƒ่ผ‰ๅ…ฅใ€็ดขๅผ•ใ€ๆชข็ดขๅ’ŒๅŒๆญฅๆ‰€ๆœ‰่ณ‡ๆ–™ใ€‚

ๅฎƒไปฅ้–‹ๆบๅฅ—ไปถๅ’Œ ่จ—็ฎกๅนณๅฐ่งฃๆฑบๆ–นๆกˆ็š„ๅฝขๅผๆไพ›ใ€‚

ๆญค็ญ†่จ˜ๆœฌๅฑ•็คบไบ†ๅฆ‚ไฝ•ไฝฟ็”จไฝฟ็”จ Embedchain ็š„ๆชข็ดขๅ™จใ€‚

ๅฎ‰่ฃ (Installation)

้ฆ–ๅ…ˆ๏ผŒๆ‚จ้œ€่ฆๅฎ‰่ฃ embedchain ๅฅ—ไปถใ€‚

ๆ‚จๅฏไปฅ้€้ŽๅŸท่กŒไปฅไธ‹ๅ‘ฝไปคไพ†ๅฎ‰่ฃ่ฉฒๅฅ—ไปถ๏ผš

%pip install --upgrade --quiet  embedchain

ๅปบ็ซ‹ๆ–ฐ็š„ๆชข็ดขๅ™จ (Create New Retriever)

EmbedchainRetriever ๅ…ทๆœ‰ไธ€ๅ€‹้œๆ…‹ .create() ๅทฅๅป ๆ–นๆณ•๏ผŒๅฎƒๆŽฅๅ—ไปฅไธ‹ๅƒๆ•ธ๏ผš

  • yaml_path: string (้ธ็”จ) -- YAML ้…็ฝฎๆ–‡ไปถ็š„่ทฏๅพ‘ใ€‚ๅฆ‚ๆžœๆœชๆไพ›๏ผŒๅ‰‡ไฝฟ็”จ้ ่จญ้…็ฝฎใ€‚ๆ‚จๅฏไปฅ็€่ฆฝๆ–‡ไปถไปฅๆŽข็ดขๅ„็จฎ่‡ช่จ‚้ธ้ …ใ€‚
# Setup API Key

import os
from getpass import getpass

if "OPENAI_API_KEY" not in os.environ:
    os.environ["OPENAI_API_KEY"] = getpass()
 ยทยทยทยทยทยทยทยท
from langchain_community.retrievers import EmbedchainRetriever

# create a retriever with default options
retriever = EmbedchainRetriever.create()

# or if you want to customize, pass the yaml config path
# retriever = EmbedchainRetiever.create(yaml_path="config.yaml")
API ๅƒ่€ƒ่ณ‡ๆ–™๏ผšEmbedchainRetriever

ๆ–ฐๅขž่ณ‡ๆ–™ (Add Data)

ๅœจ embedchain ไธญ๏ผŒๆ‚จๅฏไปฅๆทปๅŠ ไปปๆ„ๅคš็จฎๆ”ฏๆด็š„่ณ‡ๆ–™้กžๅž‹ใ€‚ๆ‚จๅฏไปฅ็€่ฆฝๆˆ‘ๅ€‘็š„ ๆ–‡ไปถไปฅๆŸฅ็œ‹ๆ”ฏๆด็š„่ณ‡ๆ–™้กžๅž‹ใ€‚

Embedchain ๆœƒ่‡ชๅ‹•ๆŽจๆ–ท่ณ‡ๆ–™็š„้กžๅž‹ใ€‚ๅ› ๆญค๏ผŒๆ‚จๅฏไปฅๆทปๅŠ ๅญ—ไธฒใ€URL ๆˆ–ๆœฌๆฉŸๆช”ๆกˆ่ทฏๅพ‘ใ€‚

retriever.add_texts(
    [
        "https://en.wikipedia.org/wiki/Elon_Musk",
        "https://www.forbes.com/profile/elon-musk",
        "https://www.youtube.com/watch?v=RcYjXbSJBN8",
    ]
)
Inserting batches in chromadb: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 4/4 [00:08<00:00,  2.22s/it]
``````output
Successfully saved https://en.wikipedia.org/wiki/Elon_Musk (DataType.WEB_PAGE). New chunks count: 378
``````output
Inserting batches in chromadb: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 1/1 [00:01<00:00,  1.17s/it]
``````output
Successfully saved https://www.forbes.com/profile/elon-musk (DataType.WEB_PAGE). New chunks count: 13
``````output
Inserting batches in chromadb: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 1/1 [00:02<00:00,  2.25s/it]
``````output
Successfully saved https://www.youtube.com/watch?v=RcYjXbSJBN8 (DataType.YOUTUBE_VIDEO). New chunks count: 53
['1eab8dd1ffa92906f7fc839862871ca5',
 '8cf46026cabf9b05394a2658bd1fe890',
 'da3227cdbcedb018e05c47b774d625f6']

ไฝฟ็”จๆชข็ดขๅ™จ (Use Retriever)

ๆ‚จ็พๅœจๅฏไปฅไฝฟ็”จๆชข็ดขๅ™จไพ†ๅฐ‹ๆ‰พ็ตฆๅฎšๆŸฅ่ฉข็š„็›ธ้—œๆ–‡ไปถ

result = retriever.invoke("How many companies does Elon Musk run and name those?")
result
[Document(page_content='Views Filmography Companies Zip2 X.com PayPal SpaceX Starlink Tesla, Inc. Energycriticismlitigation OpenAI Neuralink The Boring Company Thud X Corp. Twitteracquisitiontenure as CEO xAI In popular culture Elon Musk (Isaacson) Elon Musk (Vance) Ludicrous Power Play "Members Only" "The Platonic Permutation" "The Musk Who Fell to Earth" "One Crew over the Crewcoo\'s Morty" Elon Musk\'s Crash Course Related Boring Test Tunnel Hyperloop Musk family Musk vs. Zuckerberg SolarCity Tesla Roadster in space', metadata={'source': 'https://en.wikipedia.org/wiki/Elon_Musk', 'document_id': 'c33c05d0-5028-498b-b5e3-c43a4f9e8bf8--3342161a0fbc19e91f6bf387204aa30fbb2cea05abc81882502476bde37b9392'}),
 Document(page_content='Elon Musk PROFILEElon MuskCEO, Tesla$241.2B$508M (0.21%)Real Time Net Worthas of 11/18/23Reflects change since 5 pm ET of prior trading day. 1 in the world todayPhoto by Martin Schoeller for ForbesAbout Elon MuskElon Musk cofounded six companies, including electric car maker Tesla, rocket producer SpaceX and tunneling startup Boring Company.He owns about 21% of Tesla between stock and options, but has pledged more than half his shares as collateral for personal loans of up to $3.5', metadata={'source': 'https://www.forbes.com/profile/elon-musk', 'document_id': 'c33c05d0-5028-498b-b5e3-c43a4f9e8bf8--3c8573134c575fafc025e9211413723e1f7a725b5936e8ee297fb7fb63bdd01a'}),
 Document(page_content='to form PayPal. In October 2002, eBay acquired PayPal for $1.5 billion, and that same year, with $100 million of the money he made, Musk founded SpaceX, a spaceflight services company. In 2004, he became an early investor in electric vehicle manufacturer Tesla Motors, Inc. (now Tesla, Inc.). He became its chairman and product architect, assuming the position of CEO in 2008. In 2006, Musk helped create SolarCity, a solar-energy company that was acquired by Tesla in 2016 and became Tesla Energy.', metadata={'source': 'https://en.wikipedia.org/wiki/Elon_Musk', 'document_id': 'c33c05d0-5028-498b-b5e3-c43a4f9e8bf8--3342161a0fbc19e91f6bf387204aa30fbb2cea05abc81882502476bde37b9392'})]

ๆญค้ ้ขๆ˜ฏๅฆๆœ‰ๅนซๅŠฉ๏ผŸ