IngestRSS/todo.md

Testing🧪

• Testing from 3rd party aws account. [ Today ]
• Test Large Amounts of Feeds ( Decrease the cadence of ingesting. ) [ Today ]
• Test out Vector Databases at Small Scale
• Test out Vector Databases at Scale.
• Test out LLM Summarizaiton At Small Scale
• Test out LLM Summarization At Scall

Application Modules

• Vector Storage
• Vector Analysis
• LLM Summarization
• Semantic Understanding & Reasoning
• AWS Budget, Pinecone Budget, & LLM Budget
• Integration with bumblebee
• Visualization System ( Ingesting, Clustering, etc...)

Misc

• Duplicate Article Check Module.
• Github Issues & Github Actions.

Future Modules

• Other Add-on's with text classification of articles ( Sentiment Analysis, political polarity, etc... )
• Article Clustering Module
• API Module ( Semantic Search, Retrieval )
• Architecture Diagram

Possible Use Cases/Examples

• Betting Market Prediction
• Financial Market Predicitions
• News Aggregation
• News Letter Tooling

Over-caffeineted Ideas ☕

• Make it solarpunk themed.
• Write a serverless manifesto for personal projects and where you would like to see the serverless world go.