eGovMon - Revision 2986: /experimental/RobotsTXT

• ..
• downloads/
• extractdata.sql
• readrobotstxt.py
• results.csv
• tables.sql
• unurls.csv