run-llama/LlamaIndexTS
What's the best practise to fetch summary from a long HTML string or file?
Open
#880 opened on May 24, 2024
good first issuehelp wanted
Repository metrics
- Stars
- (3,078 stars)
- PR merge metrics
- (PR metrics pending)
Description
I am currently working with LlamaIndex TS to summarize large HTML files or strings. Below is the code I am using:
const serviceContext = serviceContextFromDefaults({
nodeParser: new SimpleNodeParser({
chunkSize: 800,
chunkOverlap: 400,
splitLongSentences: true,
}),
embedModel,
llm: llmModel,
});
const index = await VectorStoreIndex.fromDocuments([document], {
serviceContext,
});
const retriever = index.asRetriever();
const queryEngine = index.asQueryEngine({
retriever,
});
const queryResponse = await queryEngine.query({
query: embeddingPrompt,
});
Issues Encountered 1, Incomplete Summarization: The summarization output seems to be incomplete. At times, I don't get any content at all. 2. Handling Large HTML Files: My HTML files are quite large, exceeding the maximum token limit of 8192. Despite using SimpleNodeParser with chunking, it appears to only process the first 800 tokens of the document. Questions
- What are the best practices for summarizing large HTML files or strings using LlamaIndex TS?
- How can I ensure that the summarization captures the entire content of the document, given the token limitations?
- Are there any specific settings or configurations in SimpleNodeParser or other components that I should adjust to improve the summarization results? Thank you for your assistance!