langchain_community.document_loaders.open_city_data.OpenCityDataLoader¶
- class langchain_community.document_loaders.open_city_data.OpenCityDataLoader(city_id: str, dataset_id: str, limit: int)[source]¶
Load from Open City.
Initialize with dataset_id. Example: https://dev.socrata.com/foundry/data.sfgov.org/vw6y-z8j6 e.g., city_id = data.sfgov.org e.g., dataset_id = vw6y-z8j6
- Parameters
city_id (str) – The Open City city identifier.
dataset_id (str) – The Open City dataset identifier.
limit (int) – The maximum number of documents to load.
Methods
__init__(city_id, dataset_id, limit)Initialize with dataset_id.
A lazy loader for Documents.
aload()Load data into Document objects.
Lazy load records.
load()Load data into Document objects.
load_and_split([text_splitter])Load Documents and split into chunks.
- __init__(city_id: str, dataset_id: str, limit: int)[source]¶
Initialize with dataset_id. Example: https://dev.socrata.com/foundry/data.sfgov.org/vw6y-z8j6 e.g., city_id = data.sfgov.org e.g., dataset_id = vw6y-z8j6
- Parameters
city_id (str) – The Open City city identifier.
dataset_id (str) – The Open City dataset identifier.
limit (int) – The maximum number of documents to load.
- async alazy_load() AsyncIterator[Document]¶
A lazy loader for Documents.
- Return type
AsyncIterator[Document]
- load_and_split(text_splitter: Optional[TextSplitter] = None) List[Document]¶
Load Documents and split into chunks. Chunks are returned as Documents.
Do not override this method. It should be considered to be deprecated!
- Parameters
text_splitter (Optional[TextSplitter]) – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.
- Returns
List of Documents.
- Return type
List[Document]