Commit Graph

33 Commits

Author SHA1 Message Date
b881641c69 Commented out URL Extractions (to be done post downloading of files) 2024-01-12 04:02:06 +00:00
cba96e96e7 Rollback of change 2023-12-22 01:06:30 +00:00
bfc13cb6ef Updated script to keep regenerating a list of files to download 2023-12-21 09:35:39 +00:00
50e89b9de2 Add in checking for new files once list is depleted 2023-12-21 01:58:55 +00:00
0aad853966 Update README.md 2023-12-20 04:09:47 +00:00
5f152307f2 Add commoncrawl_local_to_share_move.ps1 2023-12-20 04:09:13 +00:00
fd9376cbe0 Updated to extract Pastebin URL's 2023-12-19 00:23:55 +00:00
1036de64a7 Documentation Update 2023-12-18 04:34:20 +00:00
727d2c3187 Update commoncrawl_transfer.ps1 2023-12-18 04:27:30 +00:00
171d3e2d2d Upload files to "/" 2023-12-18 04:27:03 +00:00
65757f8cc4 Update README.md 2023-12-12 11:04:52 +00:00
1e25ef86fe Upload files to "/" 2023-12-12 10:23:58 +00:00
b24287ef6f Upload files to "/" 2023-12-12 10:23:37 +00:00
b7ce7aa4b0 Upload files to "/" 2023-12-12 10:22:31 +00:00
7f9480bc40 Update urlextractor_archiveteam.sh 2023-12-12 10:22:22 +00:00
ac0f299269 Update commoncrawl_url_processor.py 2023-12-12 10:05:46 +00:00
ba11c6af9f Update commoncrawl_url_processor.py 2023-12-12 10:05:23 +00:00
d97491b4f0 Update urlextractor_archiveteam.sh 2023-12-10 05:10:10 +00:00
6a90fc7f5e Update multithread_script_5.0.py 2023-12-06 10:59:41 +00:00
adc15ec579 Update urlextractor_archiveteam.sh 2023-12-06 10:35:31 +00:00
0a3cfd1008 Update urlextractor_archiveteam.sh 2023-12-06 10:19:02 +00:00
807f0136ad Update urlextractor_archiveteam.sh 2023-12-05 11:34:29 +00:00
0d5a54df43 Update urlextractor_archiveteam.sh 2023-12-05 10:20:47 +00:00
805b133dba Update multithread_script_5.0.py 2023-12-05 10:20:23 +00:00
bd939a62de Update urlextractor_archiveteam.sh 2023-12-05 02:41:43 +00:00
d95927c230 Update multithread_script_5.0.py 2023-12-05 02:41:08 +00:00
00c0678135 Update multithread_script_5.0.py 2023-12-04 12:00:27 +00:00
d326a35340 Delete urls_to_download.txt 2023-12-04 10:59:19 +00:00
6500764baa Update multithread_script_5.0.py 2023-12-04 10:53:05 +00:00
dcf47e4085 Upload files to "/" 2023-12-04 10:51:34 +00:00
c804a1e1ec Upload files to "/" 2023-12-04 10:49:28 +00:00
8ce7ed8f1a Upload files to "/" 2023-12-04 10:48:04 +00:00
5dd8e4f9ce Upload files to "/" 2023-12-04 10:39:04 +00:00