ArchiveTeam/CommonCrawl_URL_Processor
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Updated to include zstd package

Browse Source
This commit is contained in:
datechnoman 2024-02-13 22:35:10 +00:00
parent 3151fce353
commit 722838b24a
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
prerequisites.sh
View File

@ -2,6 +2,7 @@ apt-get update
apt-get install axel -y apt-get install axel -y
apt-get install parallel -y apt-get install parallel -y
apt-get install slurm -y apt-get install slurm -y
apt-get install zstd -y
cd /opt/ cd /opt/
git clone https://git.datechnoman.com/ArchiveTeam/CommonCrawl_URL_Processor.git git clone https://git.datechnoman.com/ArchiveTeam/CommonCrawl_URL_Processor.git
cd /opt/CommonCrawl_URL_Processor cd /opt/CommonCrawl_URL_Processor