Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• 44127f7724 Add archivebot_automated_cdx_processor.py main datechnoman 2024-06-06 11:00:08 +0000
• daecaeac69 revert d36d5ca79e datechnoman 2024-03-14 03:57:26 +0000
• caeec000c3 Roll back to prechange datechnoman 2024-03-14 03:51:14 +0000
• 9e94e1e108 Added in removed cdxcount and cdxsummary datechnoman 2024-03-13 04:34:48 +0000
• 9793f0e9db Updated to change JSON output for tophosts file datechnoman 2024-03-13 04:29:55 +0000
• c1c0be47cf Revert: f0a70605da datechnoman 2024-03-12 10:58:55 +0000
• d36d5ca79e Update comment with correct directory datechnoman 2024-03-12 04:22:07 +0000
• 27a2b56936 Update due to bug in folder location datechnoman 2024-03-12 04:19:43 +0000
• 7b4651b07e Updated to delete older tophost json files datechnoman 2024-03-12 04:08:42 +0000
• 3fb177fb70 Updated to move tophost json file datechnoman 2024-03-12 02:38:05 +0000
• eaa8278db2 Update urls_automated_cdx_processor.py datechnoman 2024-03-11 23:47:50 +0000
• 7106415581 Add urls_automated_cdx_processor.py datechnoman 2024-03-11 23:32:19 +0000
• 9cb12880cc Updated to 72 hour retention datechnoman 2024-02-17 12:59:49 +0000
• f0a70605da Update telegram_automated_cdx_processor.py datechnoman 2024-02-05 08:44:50 +0000
• a82c328401 Add telegram_automated_cdx_processor.py datechnoman 2024-02-05 08:40:29 +0000
• badcd7d432 Add blogger_automated_cdx_processor.py datechnoman 2024-01-18 23:39:28 +0000
• 10b7b6f65a Add youtube_automated_cdx_processor.py datechnoman 2024-01-13 01:24:29 +0000
• d6d8721c1b Update imgur_automated_cdx_processor.py datechnoman 2024-01-10 00:44:41 +0000
• 05fd72705e Update pastebin_automated_cdx_processor.py datechnoman 2024-01-10 00:44:01 +0000
• 261fcfafda Update imgur_automated_cdx_processor.py datechnoman 2024-01-10 00:43:16 +0000
• 81bd092284 Update pastebin_automated_cdx_processor.py datechnoman 2024-01-10 00:42:57 +0000
• 0c062e7326 Update mediafire_automated_cdx_processor.py datechnoman 2024-01-10 00:31:54 +0000
• d3d110789a Updated bug in code for previous change datechnoman 2024-01-09 22:48:26 +0000
• 43d55a27fd Set ia path variable for cron execution datechnoman 2024-01-09 21:35:25 +0000
• 6c16ee45bd Updated cdx file retention to 2 days datechnoman 2024-01-09 21:15:18 +0000
• 1e44917569 Updated cdx file retention to 2 days datechnoman 2024-01-09 21:14:23 +0000
• 8e1912cb9b Updated cdx file retention to 2 days datechnoman 2024-01-09 21:13:48 +0000
• 4d4dc9c81c Add imgur_automated_cdx_processor.py datechnoman 2024-01-09 05:51:41 +0000
• 08dc0c0bf6 Removing the tar process and now deleting cdx.json files older than 24 hours datechnoman 2024-01-09 05:49:56 +0000
• 51c127601a Removing the tar process and now deleting cdx.json files older than 24 hours datechnoman 2024-01-09 05:45:25 +0000
• 49a9bc4710 Add pastebin_automated_cdx_processor.py datechnoman 2024-01-09 05:15:31 +0000
• 457f32ed61 Added tar support for files older than 24 hours to keep cdx file count low datechnoman 2024-01-09 00:19:22 +0000
• f5928594a5 Changed time delta to 1 day to minimize cdx file count datechnoman 2024-01-08 23:50:17 +0000
• 85319ba390 Updated code to move files to /opt/cdxfiles/mediafire datechnoman 2024-01-08 11:09:35 +0000
• 42be737ee6 Code fix datechnoman 2024-01-08 11:05:07 +0000
• 2bf2e02275 Update mediafire_automated_cdx_processor.py datechnoman 2024-01-08 10:44:33 +0000
• d56d7bb81f Added in support to compare already existing files to skip them being reprocessed datechnoman 2024-01-08 10:37:24 +0000
• 61f5a4ddbf Update concurrency of downloads datechnoman 2024-01-08 08:27:15 +0000
• 2e938624f9 Add mediafire_automated_cdx_processor.py datechnoman 2024-01-08 08:23:28 +0000
• b2a9c44c9e Added in a cdx filesize count statistic for the Grafana Dashboard to report on sizing datechnoman 2023-12-27 08:58:44 +0000
• 2dddda28bf Add into a "cdxcount": 1, count for metric reporting of processed CDX files datechnoman 2023-12-27 08:52:23 +0000
• 182c58f1ce Implemented subprocess for running multiple json extractions at once datechnoman 2023-12-27 08:46:36 +0000
• 8496391064 Update to remove tophosts output datechnoman 2023-12-26 11:59:44 +0000
• ae515fb425 Upload files to "/" datechnoman 2023-12-23 04:39:00 +0000