langchain_community.document_loaders.parsers.html.bs4.BS4HTMLParser¶

class langchain_community.document_loaders.parsers.html.bs4.BS4HTMLParser(*, features: str = 'lxml', get_text_separator: str = '', **kwargs: Any)[source]¶

Parse HTML files using Beautiful Soup.

Initialize a bs4 based HTML parser.

Methods

__init__(*[, features, get_text_separator])

Initialize a bs4 based HTML parser.

lazy_parse(blob)

Load HTML document into document objects.

parse(blob)

Eagerly parse the blob into a document or documents.
Parameters

  • features (str) –

  • get_text_separator (str) –

  • kwargs (Any) –

__init__(*, features: str = 'lxml', get_text_separator: str = '', **kwargs: Any) → None[source]¶

Initialize a bs4 based HTML parser.

Parameters

  • features (str) –

  • get_text_separator (str) –

  • kwargs (Any) –

Return type

None

lazy_parse(blob: Blob) → Iterator[Document][source]¶

Load HTML document into document objects.

Parameters

blob (Blob) –

Return type

Iterator[Document]

parse(blob: Blob) → List[Document]¶

Eagerly parse the blob into a document or documents.

This is a convenience method for interactive development environment.

Production applications should favor the lazy_parse method instead.

Subclasses should generally not over-ride this parse method.

Parameters

blob (Blob) – Blob instance

Returns

List of documents

Return type

List[Document]

Examples using BS4HTMLParser¶