่ทณๅˆฐไธป่ฆๅ…งๅฎน
Open In ColabOpen on GitHub

Embedchain

Embedchain ๆ˜ฏไธ€ๅ€‹ RAG ๆก†ๆžถ๏ผŒ็”จๆ–ผๅปบ็ซ‹ๆ•ธๆ“š็ฎก้“ใ€‚ๅฎƒๅฏไปฅ่ผ‰ๅ…ฅใ€็ดขๅผ•ใ€ๆชข็ดขๅ’ŒๅŒๆญฅๆ‰€ๆœ‰ๆ•ธๆ“šใ€‚

ๅฎƒไปฅ้–‹ๆบๅฅ—ไปถๅ’Œ่จ—็ฎกๅนณๅฐ่งฃๆฑบๆ–นๆกˆ็š„ๅฝขๅผๆไพ›ใ€‚

ๆœฌ็ญ†่จ˜ๆœฌๅฑ•็คบๅฆ‚ไฝ•ไฝฟ็”จ Embedchain ็š„ๆชข็ดขๅ™จใ€‚

ๅฎ‰่ฃ

้ฆ–ๅ…ˆๆ‚จ้œ€่ฆๅฎ‰่ฃ `embedchain` ๅฅ—ไปถใ€‚

ๆ‚จๅฏไปฅ้€้ŽๅŸท่กŒไปฅไธ‹ๅ‘ฝไปคไพ†ๅฎ‰่ฃๅฅ—ไปถ

%pip install --upgrade --quiet  embedchain

ๅปบ็ซ‹ๆ–ฐ็š„ๆชข็ดขๅ™จ

EmbedchainRetriever ๆœ‰ไธ€ๅ€‹้œๆ…‹็š„ .create() ๅทฅๅป ๆ–นๆณ•๏ผŒๅฎƒๆŽฅๅ—ไปฅไธ‹ๅƒๆ•ธ

  • yaml_path: string ๅฏ้ธ -- YAML ้…็ฝฎๆ–‡ไปถ็š„่ทฏๅพ‘ใ€‚ๅฆ‚ๆžœๆœชๆไพ›๏ผŒๅ‰‡ไฝฟ็”จ้ ่จญ้…็ฝฎใ€‚ๆ‚จๅฏไปฅ็€่ฆฝๆ–‡ๆช”ไปฅๆŽข็ดขๅ„็จฎ่‡ช่จ‚้ธ้ …ใ€‚
# Setup API Key

import os
from getpass import getpass

if "OPENAI_API_KEY" not in os.environ:
    os.environ["OPENAI_API_KEY"] = getpass()
 ยทยทยทยทยทยทยทยท
from langchain_community.retrievers import EmbedchainRetriever

# create a retriever with default options
retriever = EmbedchainRetriever.create()

# or if you want to customize, pass the yaml config path
# retriever = EmbedchainRetiever.create(yaml_path="config.yaml")
API ๅƒ่€ƒๆ–‡ๆช”๏ผšEmbedchainRetriever

ๆ–ฐๅขž่ณ‡ๆ–™

ๅœจ Embedchain ไธญ๏ผŒๆ‚จๅฏไปฅๆ–ฐๅขž่จฑๅคšๆ”ฏๆด็š„่ณ‡ๆ–™้กžๅž‹ใ€‚ๆ‚จๅฏไปฅ็€่ฆฝๆˆ‘ๅ€‘็š„ๆ–‡ๆช”ไปฅๆŸฅ็œ‹ๆ”ฏๆด็š„่ณ‡ๆ–™้กžๅž‹ใ€‚

Embedchain ๆœƒ่‡ชๅ‹•ๆŽจๆ–ท่ณ‡ๆ–™็š„้กžๅž‹ใ€‚ๅ› ๆญค๏ผŒๆ‚จๅฏไปฅๆ–ฐๅขžๅญ—ไธฒใ€URL ๆˆ–ๆœฌๆฉŸๆช”ๆกˆ่ทฏๅพ‘ใ€‚

retriever.add_texts(
    [
        "https://en.wikipedia.org/wiki/Elon_Musk",
        "https://www.forbes.com/profile/elon-musk",
        "https://www.youtube.com/watch?v=RcYjXbSJBN8",
    ]
)
Inserting batches in chromadb: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 4/4 [00:08<00:00,  2.22s/it]
``````output
Successfully saved https://en.wikipedia.org/wiki/Elon_Musk (DataType.WEB_PAGE). New chunks count: 378
``````output
Inserting batches in chromadb: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 1/1 [00:01<00:00,  1.17s/it]
``````output
Successfully saved https://www.forbes.com/profile/elon-musk (DataType.WEB_PAGE). New chunks count: 13
``````output
Inserting batches in chromadb: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 1/1 [00:02<00:00,  2.25s/it]
``````output
Successfully saved https://www.youtube.com/watch?v=RcYjXbSJBN8 (DataType.YOUTUBE_VIDEO). New chunks count: 53
['1eab8dd1ffa92906f7fc839862871ca5',
 '8cf46026cabf9b05394a2658bd1fe890',
 'da3227cdbcedb018e05c47b774d625f6']

ไฝฟ็”จๆชข็ดขๅ™จ

ๆ‚จ็พๅœจๅฏไปฅไฝฟ็”จๆชข็ดขๅ™จไพ†ๆŸฅๆ‰พ็ตฆๅฎšๆŸฅ่ฉข็š„็›ธ้—œๆ–‡ๆช”

result = retriever.invoke("How many companies does Elon Musk run and name those?")
result
[Document(page_content='Views Filmography Companies Zip2 X.com PayPal SpaceX Starlink Tesla, Inc. Energycriticismlitigation OpenAI Neuralink The Boring Company Thud X Corp. Twitteracquisitiontenure as CEO xAI In popular culture Elon Musk (Isaacson) Elon Musk (Vance) Ludicrous Power Play "Members Only" "The Platonic Permutation" "The Musk Who Fell to Earth" "One Crew over the Crewcoo\'s Morty" Elon Musk\'s Crash Course Related Boring Test Tunnel Hyperloop Musk family Musk vs. Zuckerberg SolarCity Tesla Roadster in space', metadata={'source': 'https://en.wikipedia.org/wiki/Elon_Musk', 'document_id': 'c33c05d0-5028-498b-b5e3-c43a4f9e8bf8--3342161a0fbc19e91f6bf387204aa30fbb2cea05abc81882502476bde37b9392'}),
 Document(page_content='Elon Musk PROFILEElon MuskCEO, Tesla$241.2B$508M (0.21%)Real Time Net Worthas of 11/18/23Reflects change since 5 pm ET of prior trading day. 1 in the world todayPhoto by Martin Schoeller for ForbesAbout Elon MuskElon Musk cofounded six companies, including electric car maker Tesla, rocket producer SpaceX and tunneling startup Boring Company.He owns about 21% of Tesla between stock and options, but has pledged more than half his shares as collateral for personal loans of up to $3.5', metadata={'source': 'https://www.forbes.com/profile/elon-musk', 'document_id': 'c33c05d0-5028-498b-b5e3-c43a4f9e8bf8--3c8573134c575fafc025e9211413723e1f7a725b5936e8ee297fb7fb63bdd01a'}),
 Document(page_content='to form PayPal. In October 2002, eBay acquired PayPal for $1.5 billion, and that same year, with $100 million of the money he made, Musk founded SpaceX, a spaceflight services company. In 2004, he became an early investor in electric vehicle manufacturer Tesla Motors, Inc. (now Tesla, Inc.). He became its chairman and product architect, assuming the position of CEO in 2008. In 2006, Musk helped create SolarCity, a solar-energy company that was acquired by Tesla in 2016 and became Tesla Energy.', metadata={'source': 'https://en.wikipedia.org/wiki/Elon_Musk', 'document_id': 'c33c05d0-5028-498b-b5e3-c43a4f9e8bf8--3342161a0fbc19e91f6bf387204aa30fbb2cea05abc81882502476bde37b9392'})]

ๆญค้ ้ขๆ˜ฏๅฆๅฐๆ‚จๆœ‰ๅนซๅŠฉ๏ผŸ