Skip to content

Llm generate scraper#72

Open
azhong-git wants to merge 4 commits intomainfrom
llm-generate-scraper
Open

Llm generate scraper#72
azhong-git wants to merge 4 commits intomainfrom
llm-generate-scraper

Conversation

@azhong-git
Copy link
Copy Markdown
Contributor

No description provided.

- Introduced `ScrapeOptions` interface for generating reusable scraping code from HTML.
- Added `ScrapeResult` interface to encapsulate the output of the scrape function.
- Updated README to document the new scrape mode, including usage examples and explanations.
- Refactored HTML to Markdown conversion functions to support new scraping capabilities.
- Added new Turndown rule options for improved HTML processing.
- Introduced a rule to the Turndown service that filters out elements marked with the aria-hidden attribute set to true.
- This enhancement improves the HTML to Markdown conversion by ensuring accessibility-related attributes are handled appropriately.
@azhong-git azhong-git deployed to integration-tests April 8, 2026 04:41 — with GitHub Actions Active
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant