langchain.document_loaders.open_city_data.OpenCityDataLoader

class langchain.document_loaders.open_city_data.OpenCityDataLoader(city_id: str, dataset_id: str, limit: int)[source]

Load from Open City.

Initialize with dataset_id. Example: https://dev.socrata.com/foundry/data.sfgov.org/vw6y-z8j6 e.g., city_id = data.sfgov.org e.g., dataset_id = vw6y-z8j6

Parameters
  • city_id – The Open City city identifier.

  • dataset_id – The Open City dataset identifier.

  • limit – The maximum number of documents to load.

Methods

__init__(city_id, dataset_id, limit)

Initialize with dataset_id.

lazy_load()

Lazy load records.

load()

Load records.

load_and_split([text_splitter])

Load Documents and split into chunks.

__init__(city_id: str, dataset_id: str, limit: int)[source]

Initialize with dataset_id. Example: https://dev.socrata.com/foundry/data.sfgov.org/vw6y-z8j6 e.g., city_id = data.sfgov.org e.g., dataset_id = vw6y-z8j6

Parameters
  • city_id – The Open City city identifier.

  • dataset_id – The Open City dataset identifier.

  • limit – The maximum number of documents to load.

lazy_load() Iterator[Document][source]

Lazy load records.

load() List[Document][source]

Load records.

load_and_split(text_splitter: Optional[TextSplitter] = None) List[Document]

Load Documents and split into chunks. Chunks are returned as Documents.

Parameters

text_splitter – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.

Returns

List of Documents.

Examples using OpenCityDataLoader