Skip to topic | Skip to bottom
Home
TWiki
TWiki.BlackListPluginr1.1 - 27 Feb 2006 - 12:14 - TWikiGuesttopic end

Start of topic | Skip to actions

Black List Plugin

This is a simple utility to keep black sheep away from a public TWiki site. The site can be protected against excessive page access (e.g. by bad robots) and suspicious activities of users, such as multiple registrations or rapid topic updates indicating Wiki:WikiSpam.

The Plugin monitors activities by IP address and uses three IP address lists to protect the TWiki site:

  • WHITELIST: Manually maintained list of users who should never get on the BANLIST
  • BLACKLIST: Manually maintained list of malicious users
  • BANLIST: Automatically updated list of users with suspicious activities

Users on the BLACKLIST and BANLIST will have every page access delayed by one minute and will get an error message.

To fight Wiki-spam, the Plugin can also add a rel="nofollow" parameter to external URLs. Search engines will not follow links that have this parameter, taking away the incentive to add spam to TWiki.

Plugin Settings

Plugin settings are stored as preferences variables. To reference a plugin setting write %<plugin>_<setting>%, i.e. %INTERWIKIPLUGIN_SHORTDESCRIPTION%

  • One line description, is shown in the TextFormattingRules topic:
    • Set SHORTDESCRIPTION = Utility to keep malicious users away from a public TWiki site

  • Debug plugin: (See output in data/debug.txt)
    • Set DEBUG = 0

  • WHITELIST: Comma delimited list of IP addresses; possible to use partial addresses ending in a dot
    • Set WHITELIST = 127.0.0.1, 81.2.94., 206.49.179.8

  • BLACKLIST: Comma delimited list of IP addresses; possible to use partial addresses ending in a dot
    • Set BLACKLIST = 203.88.152., 203.88.155., 219.65.75., 222.183., 221.237., 218.87.222., 128.172.144.78, 128.180.121.221, 129.176.151.21, 129.46.51.199, 131.114.31.60, 145.28.70.253, 146.145.122.154, 146.50.1.121, 192.112.251.48, 192.18.42.11, 193.113.57.167, 193.138.110.138, 193.204.86.247, 194.255.110.3, 195.140.123.22, 195.208.147.114, 195.246.29.34, 195.27.215.89, 196.201.87.240, 198.232.129.38, 201.12.164.3, 202.131.163.229, 202.176.134.38, 202.41.121.132, 202.71.139.225, 203.134.87.155, 203.197.175.229, 203.59.106.100, 203.88.152., 203.88.155., 204.194.26.114, 204.60.124.22, 205.194.74.10, 207.37.254.250, 209.237.238.157, 210.213.12.154, 210.214.190.45, 212.142.33.102, 212.59.0.197, 213.140.6.111, 213.148.226.206, 213.150.180.130, 213.255.201.11, 216.139.181.138, 216.55.159.187, 217.225.75.104, 219.65.75., 220.139.14.96, 221.148.44.112, 221.217.48.121, 221.237.3.67, 221.237.5.169, 221.24.74.7, 222.47.183.35, 222.50.120.148, 222.64.144.87, 24.132.230.78, 24.236.73., 24.42.104.137, 38.144.36.19, 4.79.40.175, 58.8.0.251, 59.135.90.49, 61.149.245.150, 61.229.228.111, 61.229.231.60, 62.159.114.18, 62.163.12.101, 62.163.17.232, 62.163.37.188, 62.193.226.62, 62.193.235.107, 62.193.235.94, 62.193.236.130, 62.193.236.152, 62.193.238.104, 62.194.17.165, 62.194.7.249, 62.194.7.3, 62.218.146.85, 62.23.185.226, 63.241.61.8, 63.88.59.92, 63.96.171.26, 65.214.36.186, 65.214.38.210, 65.98.67.74, 66.163.170.185, 66.163.170.193, 66.194.55.242, 66.238.40.2, 66.92.68.227, 67.101.9.164, 67.15.130.23, 67.39.183.193, 68.130.216.242, 68.130.216.81, 69.93.108.202, 70.85.45.132, 70.92.154.224, 80.132.214.37, 80.146.121.129, 80.146.126.46, 80.180.69.245, 80.58.33.235, 80.58.4.111, 81.192.30.2, 81.196.22.25, 81.207.249.182, 82.255.5.216, 82.81.70.84, 83.76.180.170, 83.88.197.205, 84.28.56.169, 222.65.202.53, 200.207.217., 201.21.0., 85.202.125., 83.69.125.7

  • BANLIST: Automatically updated list of IP addresses based on BANLIST configuration
    • IP address
    • Current list: 222.248.40.21, 211.144.171.36, 68.125.160.140, 209.237.238.177, 66.249.65.233, 80.77.86.148, 82.46.143.154, 66.249.65.42, 66.249.65.203, 66.249.65.230, 66.249.65.83, 66.249.65.137, 66.17.15.164, 66.249.66.79, 196.1.177.10, 66.249.66.240, 66.249.66.36, 66.249.66.15, 66.249.66.176, 66.249.66.107, 194.9.79.22, 66.249.66.209, 82.52.23.154, 66.249.66.100, 66.234.139.215, 66.234.139.218, 66.249.66.39, 80.60.248.105, 213.244.179.168, 82.36.235.26, 66.249.65.141, 67.53.54.213, 66.249.65.163, 66.249.65.131, 66.249.65.40, 66.249.66.6, 66.249.65.237, 66.249.65.82, 66.249.66.78, 66.249.66.116, 64.127.124.140, 66.249.65.145, 66.249.66.177, 66.249.65.172, 66.249.65.35, 66.249.66.172, 66.249.65.44, 66.137.176.113, 66.249.65.227, 66.249.65.37, 67.172.124.117, 12.207.8.100, 66.249.66.162, 66.249.65.243, 204.96.144.157, 66.249.65.114, 66.249.66.102, 67.79.68.3, 24.255.147.138, 66.249.66.171, 205.209.183.161, 195.221.138.19, 66.249.66.47, 69.250.159.76, 213.216.199.14, 87.81.112.53, 202.142.95.202, 193.178.34.2, 62.216.23.236, 84.112.109.115, 24.74.156.32, 62.252.224.25, 65.184.221.93, 69.220.242.114, 66.249.66.43, 12.175.0.44, 71.16.207.98, 24.240.63.115, 72.20.89.158, 70.124.196.74, 218.80.17.210, 67.62.94.74, 66.249.65.170, 67.18.98.36, 83.69.125.7, 65.75.183.8, 24.89.233.164, 86.132.190.124, 66.249.65.45, 62.213.242.13, 216.255.117.130, 193.87.16.14, 69.226.246.223, 170.139.252.252, 66.249.65.231, 66.249.65.136, 69.23.82.111, 62.1.2.178, 66.249.65.177, 213.202.86.114, 84.48.210.110, 66.249.65.103, 24.20.50.4, 66.249.66.2, 66.249.72.74, 80.203.78.216, 84.52.244.2, 66.249.65.68, 67.22.194.224, 67.70.35.168, 65.13.155.222, 80.203.29.169, 66.249.65.16, 83.243.132.40, 67.86.175.134, 66.249.66.49, 66.249.65.238, 66.249.65.194, 68.2.88.31, 205.209.170.172, 67.169.126.226, 66.249.65.33, 66.249.65.129, 66.249.66.196, 66.249.65.234, 194.67.32.47, 212.164.87.151, 80.66.66.217, 66.199.242.146, 209.160.32.159, 4.78.166.130, 66.249.72.144, 208.66.195.2, 208.66.195.5, 66.249.65.242, 88.85.77.9, 208.68.210.169, 72.232.93.254, 66.249.65.36, 62.254.128.7, 80.203.121.182, 89.10.18.128, 205.209.170.161, 85.147.205.30, 90.7.199.70, 206.161.120.2, 66.249.65.133, 205.209.170.204, 66.249.72.143, 221.238.251.3, 71.168.107.138, 80.203.51.246, 68.48.242.29, 65.164.192.57, 129.241.111.168, 68.95.146.231, 71.63.97.77, 129.241.110.172, 69.245.1.124, 74.135.126.189, 80.202.221.231, 89.221.100.3, 66.249.66.40, 66.249.65.110, 85.255.117.221, 38.98.120.88, 216.195.54.53, 66.249.65.41, 85.255.118.108, 213.114.80.239, 71.168.66.176, 206.74.10.39, 193.157.237.124, 85.225.208.52, 72.90.37.75, 64.83.64.95, 8.11.2.98, 66.249.66.17, 84.173.172.110, 84.48.48.182, 66.55.151.2, 69.159.4.84, 161.16.0.50, 66.249.72.140, 66.249.71.201, 94.100.181.240, 38.98.120.70, 8.11.2.96, 38.98.120.74, 38.98.120.82, 38.98.120.94, 38.98.120.80, 194.8.75.153, 38.98.120.75, 38.98.120.77, 8.11.2.97, 67.202.16.43, 38.98.120.81, 38.98.120.72, 116.71.244.212, 38.98.120.93, 65.46.75.190, 8.11.2.10, 38.98.120.90, 66.249.71.198, 38.98.120.92, 65.98.224.7, 82.83.54.65, 38.108.180.28, 66.249.67.248, 62.249.174.223, 38.100.8.50, 38.101.148.126, 38.108.180.91, 38.98.120.84, 96.31.86.184, 174.133.177.66, 66.249.65.188, 174.34.157.98, 8.11.2.9, 173.66.178.246, 94.75.229.132, 217.77.223.20, 66.249.71.140, 89.149.254.73, 94.100.181.85, 66.249.71.233, 38.99.96.184, 209.51.162.219, 208.115.111.248, 67.152.29.130, 209.51.162.220, 38.99.96.70, 91.205.96.13, 66.249.66.10, 66.249.65.132, 66.249.65.76, 66.249.65.175, 66.249.65.138, 66.249.65.156, 212.95.54.211, 38.99.97.94, 91.214.45.223, 78.46.79.46, 67.195.114.244, 38.99.96.169, 66.249.68.236, 65.55.3.175, 195.42.102.25, 38.99.97.178, 38.99.98.120, 38.99.97.83, 94.23.238.27, 41.207.31.194, 195.42.102.21, 75.101.204.107, 66.249.65.245, 208.118.60.156, 66.249.66.97, 173.224.112.96, 188.65.74.36, 173.192.34.95, 67.195.112.239, 75.101.184.108, 178.63.20.133, 208.118.60.157, 188.40.42.56, 66.249.65.49, 66.249.65.38, 174.133.5.250, 95.169.190.103, 79.142.67.109, 89.248.172.26, 95.215.0.195, 38.99.98.19, 93.174.93.148, 213.186.120.196, 91.205.96.19, 66.249.71.243, 217.69.134.172, 74.111.12.244, 208.77.41.74, 213.93.147.235, 66.249.72.86, 65.55.3.201, 184.154.7.186, 38.99.96.4, 67.195.115.166, 213.180.209.251, 212.113.37.106, 38.99.96.71, 66.249.66.193, 66.249.72.45, 62.231.141.193, 66.249.72.68, 66.249.66.147, 67.195.37.124, 173.242.125.206, 67.195.112.160, 67.195.112.121, 72.4.71.66, 208.77.41.70, 77.248.111.238, 188.163.66.141, 157.56.2.14, 46.4.40.18, 66.249.72.147, 78.129.201.71, 67.195.114.42, 85.214.121.23, 217.172.180.18, 176.9.0.119, 66.249.66.1, 178.63.44.73, 66.249.72.199, 66.249.71.129, 66.249.72.42, 67.195.115.152, 68.68.28.170, 66.249.67.243, 66.249.72.71, 85.114.135.228, 66.249.72.107, 66.249.71.186, 184.154.48.82

  • BANLIST configuration, comma delimited list of: Points for registration, points for each save and upload, points for view raw, points for other actions like view, threshold to add to BANLIST, measured over time (in seconds)
    • Set BANLISTCONFIG = 20, 5, 1, 20, 120, 300
    • Your current score: 2 for IP address 38.107.179.231

  • Message for users on BLACKLIST and BANLIST:
    • Set BLACKLISTMESSAGE = You are black listed at the Open-org web site due to excessive access or suspicious activities. Please contact site administrator webmaster@socialtools.net if you got on the list by mistake. Black listed IP addresses will be submitted to major blacklist databases.

  • Add a rel="nofollow" parameter to external URLs. Use this is to fight Wiki-spam. Search engines will not follow the link if a URL has a nofollow parameter, such as <a href="http://spammer.com/" rel="nofollow">. Specify topic age in hours for which the nofollow parameter should appear (set it to a value that gives you enough time to remove spam); set it to -1 to add the nofollow parameter unconditionally to external URLs; or 0 to disable: (-1, 0, 1...N)
    • Set NOFOLLOWAGE = -1

  • Log access of users on BLACKLIST and BANLIST: (1 or 0)
    • Set LOGACCESS = 1

Plugin Installation Instructions

Note: You do not need to install anything on the browser to use this plugin. The following instructions are for the administrator who installs the plugin on the server where TWiki is running.

  • Download the ZIP file from the Plugin web (see below)
  • Unzip BlackListPlugin.zip in your twiki installation directory. Content:
    File: Description:
    data/TWiki/BlackListPlugin.txt Plugin topic
    data/TWiki/BlackListPlugin.txt,v Plugin topic repository
    lib/TWiki/Plugins/BlackListPlugin.pm Plugin Perl module
  • Test if the installation was successful:
    1. Using above form, add the IP address of one of your workstations to the BANLIST
    2. Access TWiki from that workstation
      • if you look at a TWiki topic (with the view script) you should see the BLACKLISTMESSAGE (defined above) after a one minute timeout
      • else, you should get an 500 Internal Server Error for other scripts
    3. On a different workstation, remove the IP address of the test workstation from the BANLIST

Known Issues

  • The BANLIST does not work until you add and remove an IP address using above form

Plugin Info

Plugin Author: TWiki:Main/PeterThoeny
Plugin Version: 22 Jan 2005 (V1.004)
Change History:  
22 Jan 2005: Added NOFOLLOWAGE handling
19 Jan 2005: Added score for "view raw" to address e-mail harvester issue
05 Apr 2004: Fixed bug in event log (requiring update of earlier Plugin versions); doc updates
04 Apr 2004: Added WHITELIST and BANLIST
21 Mar 2004: Initial version
CPAN Dependencies: none
Other Dependencies: none
Perl Version: 5.005
TWiki:Plugins/Benchmark: GoodStyle 99%, FormattedSearch 99%, BlackListPlugin 97%
Plugin Home: http://TWiki.org/cgi-bin/view/Plugins/BlackListPlugin
Feedback: http://TWiki.org/cgi-bin/view/Plugins/BlackListPluginDev

Related Topics: TWikiPreferences, TWikiPlugins, Google blacklist directory

-- TWiki:Main/PeterThoeny - 22 Jan 2005
to top


You are here: TWiki > BlackListPlugin

to top

Copyright © 1999-2012 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Open-org? Send feedback