Commit Graph

84 Commits

Author SHA1 Message Date
d8915d7241 Replace Pinecone/OpenAI with Qdrant/Ollama 2025-06-02 14:16:15 +02:00
3fbf675fba Merge pull request #9 from aljazceru/codex/add-docker-infrastructure-files
Add docker infrastructure
2025-06-02 14:06:09 +02:00
5cdb5eccba Merge branch 'main' into codex/add-docker-infrastructure-files 2025-06-02 14:06:01 +02:00
06d27b193d Merge pull request #8 from aljazceru/codex/convert-lambda-workers-to-local-services
Add local worker for RSS processing
2025-06-02 14:05:08 +02:00
1e3b08261f Merge pull request #7 from aljazceru/codex/add-local-deployment-option-to-launch.py
Add local launch option and env template
2025-06-02 14:04:44 +02:00
59c0469e40 Merge pull request #6 from aljazceru/codex/create-local-scheduler-service-with-cron-like-functionality
Implement local scheduler service
2025-06-02 14:04:28 +02:00
b40bd4b44b Add Docker infrastructure for local services 2025-06-02 14:04:18 +02:00
965b695f4a Add local worker to run RSS processor continuously 2025-06-02 14:04:12 +02:00
2aaa48ec05 Add local mode support 2025-06-02 14:04:09 +02:00
eba1169d52 Add local scheduler service 2025-06-02 14:04:01 +02:00
6f5366e040 Merge pull request #4 from aljazceru/codex/replace-cloudwatch-with-prometheus
Switch metrics to Prometheus
2025-06-02 13:52:01 +02:00
94268ee94d Merge branch 'main' into codex/replace-cloudwatch-with-prometheus 2025-06-02 13:51:55 +02:00
d3291cd651 Merge pull request #3 from aljazceru/codex/migrate-rss-feed-storage-to-mongodb
Switch feed storage to MongoDB
2025-06-02 13:51:28 +02:00
0dc80d93fb Merge branch 'main' into codex/migrate-rss-feed-storage-to-mongodb 2025-06-02 13:51:22 +02:00
0b506dd627 Merge pull request #2 from aljazceru/codex/integrate-redis-py-and-refactor-queue-processing
Replace SQS/Dynamo with Redis queue
2025-06-02 13:48:37 +02:00
b2b585c605 Merge branch 'main' into codex/integrate-redis-py-and-refactor-queue-processing 2025-06-02 13:48:31 +02:00
056a8c9316 Merge pull request #1 from aljazceru/codex/migrate-s3-client-to-minio
Switch S3 usage to MinIO
2025-06-02 13:46:37 +02:00
8e11a0153c Switch metrics to Prometheus 2025-06-02 13:46:09 +02:00
933971c2e0 Switch RSS feed storage to MongoDB 2025-06-02 13:46:05 +02:00
38f5b1f439 Switch to Redis queue 2025-06-02 13:46:01 +02:00
7503a452dc Switch to MinIO 2025-06-02 13:45:51 +02:00
Charles-Gormley
8ad98c4cb4 some db changes 2024-12-21 21:38:49 -05:00
Charles-Gormley
0e8c701ae5 Added logging for pinecone. 2024-12-15 11:47:26 -05:00
Charles-Gormley
b3c9832fdb vector databases are launched 2024-12-01 00:59:15 -05:00
Charles-Gormley
9dda7ff55a update 2024-11-30 23:26:17 -05:00
Charles-Gormley
28e964fa10 updating env var for lambdas due to invalid env vars. 2024-11-30 16:30:41 -05:00
Charles-Gormley
72e75d4d7d Update 2024-11-30 16:14:33 -05:00
Charles-Gormley
111e985afc updating readme. 2024-11-23 20:26:31 -05:00
Charles-Gormley
71be98e993 added in text cleaning operations. 2024-11-23 20:16:40 -05:00
Charles-Gormley
28148f1181 sped up batch ingestion of articles. 2024-11-20 18:31:11 -05:00
Charles-Gormley
f400c8bda5 Fixing metadata for s3 2024-11-13 18:45:05 -05:00
Charles-Gormley
3ef61aef06 fixed partitioning strategy 2024-11-13 18:38:43 -05:00
Charles-Gormley
4841eebda4 changing visibility timeout default and eventbridge default. 2024-11-11 20:38:59 -05:00
Charles-Gormley
d6117c8676 FIXED pillow python version issue. 2024-11-11 20:13:59 -05:00
Charles-Gormley
758c2ccdde batch update 2024-11-10 21:18:48 -05:00
Charles E. Gormley
e798dce237 logger formatting fix. 2024-10-13 20:15:34 -04:00
Charles E. Gormley
8928f05144 Sunday Error Patching 2024-10-13 20:12:30 -04:00
Charles E. Gormley
cdf232b547 todo list item 2024-10-12 15:50:48 -04:00
Charles E. Gormley
a3c21baba6 vector database issue resolution. 2024-10-12 15:34:53 -04:00
Charles E. Gormley
65fb2b1837 fixing issue with embedding model initialization. 2024-10-12 13:43:29 -04:00
Charles E. Gormley
891740723c updating layer version. 2024-09-28 14:47:46 -04:00
Charles E. Gormley
2a8ab788a1 new vectors for .env 2024-09-28 14:46:09 -04:00
Charles E. Gormley
bfb9ecdf32 env vars and no more dotenv variable 2024-09-28 14:35:21 -04:00
Charles E. Gormley
c98cfc51aa design. 2024-09-28 13:50:56 -04:00
Charles E. Gormley
f88d9a61a2 semantic design. 2024-09-28 13:50:05 -04:00
Charles E. Gormley
ed9d8ab24c alright that should d0 it. 2024-09-28 13:49:15 -04:00
Charles E. Gormley
0d39b5676d huh? 2024-09-28 13:48:16 -04:00
Charles E. Gormley
db916984bd more dramatic effect. 2024-09-28 13:47:12 -04:00
Charles E. Gormley
fa74a9f3a6 emphasis 2024-09-28 13:46:36 -04:00
Charles E. Gormley
07ee448163 dramatic and comedic effect. 2024-09-28 13:45:59 -04:00