維基百科
維基百科是一部多語種的自由線上百科全書，由一群志願者（稱為維基人）透過開放協作並使用名為 MediaWiki 的 wiki 編輯系統編寫和維護。
Wikipedia是歷史上最大和閱讀量最高的參考著作。
這個筆記本展示了如何從 wikipedia.org 將 wiki 頁面加載到我們下游使用的 Document 格式中。
安裝
首先，您需要安裝 langchain_community 和 wikipedia 套件。
%pip install -qU langchain_community wikipedia
參數
WikipediaLoader 具有以下參數
query：用於在維基百科中尋找文件的自由文字lang（可選）：預設值為 "en"。使用它在維基百科的特定語言部分進行搜尋load_max_docs（可選）：預設值為 100。使用它來限制下載文件的數量。下載所有 100 個文件需要時間，因此請使用較小的數字進行實驗。 目前有一個 300 的硬性限制。load_all_available_meta（可選）：預設值為 False。預設情況下，僅下載最重要的欄位：title和summary。如果為True，則將下載所有可用欄位。doc_content_chars_max（可選）：預設值為 4000。文件內容的最大字元數。
範例
from langchain_community.document_loaders import WikipediaLoader
API 參考：WikipediaLoader
docs = WikipediaLoader(query="HUNTER X HUNTER", load_max_docs=2).load()
len(docs)
2
docs[0].metadata # metadata of the first document
{'title': 'Hunter × Hunter',
'summary': 'Hunter × Hunter (pronounced "hunter hunter") is a Japanese manga series written and illustrated by Yoshihiro Togashi. It has been serialized in Shueisha\'s shōnen manga magazine Weekly Shōnen Jump since March 1998, although the manga has frequently gone on extended hiatuses since 2006. Its chapters have been collected in 37 tankōbon volumes as of November 2022. The story focuses on a young boy named Gon Freecss who discovers that his father, who left him at a young age, is actually a world-renowned Hunter, a licensed professional who specializes in fantastical pursuits such as locating rare or unidentified animal species, treasure hunting, surveying unexplored enclaves, or hunting down lawless individuals. Gon departs on a journey to become a Hunter and eventually find his father. Along the way, Gon meets various other Hunters and encounters the paranormal.\nHunter × Hunter was adapted into a 62-episode anime television series by Nippon Animation and directed by Kazuhiro Furuhashi, which ran on Fuji Television from October 1999 to March 2001. Three separate original video animations (OVAs) totaling 30 episodes were subsequently produced by Nippon Animation and released in Japan from 2002 to 2004. A second anime television series by Madhouse aired on Nippon Television from October 2011 to September 2014, totaling 148 episodes, with two animated theatrical films released in 2013. There are also numerous audio albums, video games, musicals, and other media based on Hunter × Hunter.\nThe manga has been licensed for English release in North America by Viz Media since April 2005. Both television series have been also licensed by Viz Media, with the first series having aired on the Funimation Channel in 2009 and the second series broadcast on Adult Swim\'s Toonami programming block from April 2016 to June 2019.\nHunter × Hunter has been a huge critical and financial success and has become one of the best-selling manga series of all time, having over 84 million copies in circulation by July 2022.',
'source': 'https://en.wikipedia.org/wiki/Hunter_%C3%97_Hunter'}
docs[0].page_content[:400] # a part of the page content
'Hunter × Hunter (pronounced "hunter hunter") is a Japanese manga series written and illustrated by Yoshihiro Togashi. It has been serialized in Shueisha\'s shōnen manga magazine Weekly Shōnen Jump since March 1998, although the manga has frequently gone on extended hiatuses since 2006. Its chapters have been collected in 37 tankōbon volumes as of November 2022. The story focuses on a young boy name'