ArchiveTeam/CommonCrawl_URL_Processor
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update prerequisites.sh

Browse Source
This commit is contained in:
datechnoman 2024-01-20 11:14:42 +00:00
parent 17b4ce6077
commit d1cfd0178f
1 changed files with 13 additions and 11 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
prerequisites.sh
View File

@ -1,6 +1,8 @@
apt-get update apt-get update
apt-get install axel -y apt-get install axel -y
apt-get install parallel -y apt-get install parallel -y
apt-get install python3-pip -y
pip install zstandard
cd /opt/ cd /opt/
git clone https://git.datechnoman.com/ArchiveTeam/CommonCrawl_URL_Processor.git git clone https://git.datechnoman.com/ArchiveTeam/CommonCrawl_URL_Processor.git
cd /opt/CommonCrawl_URL_Processor cd /opt/CommonCrawl_URL_Processor