datechnoman

0 Followers · 0 Following

• Joined on 2023-03-10

Repositories Projects Packages Public Activity Starred Repositories

datechnoman created branch main in ArchiveTeam/ArchiveOrg_Convert_Items_to_Do... 2024-01-28 01:58:52 +00:00

datechnoman pushed to main at ArchiveTeam/ArchiveOrg_Convert_Items_to_Do... 2024-01-28 01:58:52 +00:00

38f8f98795 Upload files to "/"

datechnoman transferred repository datechnoman/ArchiveOrg_Convert_Items_to_Download_URLs to ArchiveTeam/ArchiveOrg_Convert_Items_to_Do... 2024-01-28 01:57:22 +00:00

datechnoman created repository ArchiveTeam/ArchiveOrg_Convert_Items_to_Do... 2024-01-28 01:57:07 +00:00

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-27 06:31:39 +00:00

875082e8d9 Update prerequisites.sh

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-27 06:28:47 +00:00

ea8aa8f755 Update commoncrawl_local_to_share_move.ps1

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-27 06:28:18 +00:00

54d85523b4 Update commoncrawl_transfer.ps1

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-27 06:03:52 +00:00

0014256679 Update commoncrawl_transfer.ps1

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-27 03:02:57 +00:00

4f46c841b3 Updated to include disk space checking

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-27 02:42:15 +00:00

488571b4c0 Added in Lock file support

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-27 02:26:31 +00:00

674a7ae450 Update to zst extension

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-27 02:24:40 +00:00

7eafadc2fe Update to zst file extension

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-26 08:01:43 +00:00

8244b9241a Update concurrency

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-26 07:17:26 +00:00

f76dbb13fd Update README.md

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-26 07:14:28 +00:00

5661ce44b2 Updated loop issue

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-25 01:33:15 +00:00

2bee6db85a Updated error processing for zstd compression errors

datechnoman pushed to main at ArchiveTeam/Migrated_ArchiveTeam_Project_U... 2024-01-23 22:20:45 +00:00

fd15770812 Updated to include .zst support

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-23 10:45:35 +00:00

295c3daba4 Update warc_wat_url_processor.py

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-23 04:43:18 +00:00

6edffba451 Update warc_wat_url_processor.py

datechnoman pushed to main at ArchiveTeam/CommonCrawl_URL_Processor 2024-01-20 12:33:29 +00:00

513b32e80a Update warc_wat_url_processor.py