mirror of
https://github.com/aljazceru/IngestRSS.git
synced 2026-02-23 07:04:32 +01:00
updating readme.
This commit is contained in:
33
README.md
33
README.md
@@ -62,7 +62,8 @@ The Lambda function logs its activities to CloudWatch Logs. You can monitor the
|
||||
|
||||
## 🤝 Contributing
|
||||
|
||||
We welcome contributions! Please feel free to submit a Pull Request.
|
||||
Contributions are welcome, feel free to see open issues to get started.
|
||||
|
||||
|
||||
## 📄 License
|
||||
|
||||
@@ -70,33 +71,3 @@ We welcome contributions! Please feel free to submit a Pull Request.
|
||||
|
||||
This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
|
||||
|
||||
## 📁 Project Structure
|
||||
|
||||
```
|
||||
CHANGELOG.md
|
||||
├── CONTRIBUTING.md
|
||||
├── README.md
|
||||
├── launch.py
|
||||
├── requirements.txt
|
||||
├── rss_feeds.json
|
||||
├── src
|
||||
│ ├── article_storage
|
||||
│ ├── feed_management
|
||||
│ ├── infra
|
||||
│ │ ├── cloudformation
|
||||
│ │ ├── lambdas
|
||||
│ │ │ ├── RSSFeedProcessorLambda
|
||||
│ │ │ ├── RSSQueueFiller
|
||||
│ │ │ └── lambda_utils
|
||||
│ ├── launch
|
||||
│ └── utils
|
||||
├── template.env
|
||||
├── tmp
|
||||
├── todo.md
|
||||
├── tree.md
|
||||
└── wallpaper.png
|
||||
```
|
||||
|
||||
## 🙏 Acknowledgements
|
||||
|
||||
This project is made possible thanks to the contributions of researchers and developers committed to advancing the field of media studies and social science research.
|
||||
|
||||
10
todo.md
10
todo.md
@@ -1,14 +1,10 @@
|
||||
# Before Public Launch
|
||||
* API Tool - to Pull data that you have down.
|
||||
[x] Faster Batch Responses ( Parrallelization of requests. )
|
||||
[x] Query API ( Technical Feasability / is S3 even good for this. )
|
||||
|
||||
* Text Processings & Text Cleaning of Content during ingestion step Research [ Done ]
|
||||
* Do this inside of the lambda code. [ Today ]
|
||||
|
||||
* Test out Vector Databases at Small Scale.
|
||||
* Test out Vector Databases at Small Scale.
|
||||
* Test out Vector Databases at Scale.
|
||||
|
||||
* check in to ensure text cleaning processes are working. [ ]
|
||||
|
||||
* Fix up ReadMe
|
||||
* Publish RoadMap.
|
||||
* Tips on where to gather RSS Feeds.
|
||||
|
||||
Reference in New Issue
Block a user