ArchiveTeam/CommonCrawl_URL_Processor
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
datechnoman 2024-03-31 11:44:01 +00:00
parent 511629b012
commit f95513b9fd
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -37,7 +37,7 @@ I have developed a powershell script that uses WinSCP and the FTP protocol. Runn
<b>Notes:</b>
<ul>
<li>A text file with all of the CommonCrawl links named "urls_to_download.txt" is required to be located in /opt/CommonCrawl_URL_Processor.</li>
<li>A text file with all of the CommonCrawl links named "urls_to_download.txt" is required to be located in /opt/</li>
<li>I took the lazy way of setting up FTP on the server by allowing the root account SSH access to the server without a private key.</li>
<li>WinSCP Automation is required to be downloaded and copied over the top of the installed WinSCP installation directory for the script to work.</li>
</ul>