Create A .htaccess File Without Referral Spam
At present, there is a growing nuisance for users and administrators alike of sites that ruin web servers and more particularly, blogs. This nuisance is being referred to as comment, trackback and referrer spams. Various solutions have been proposed with some being applicable to even two of these forms of spam using a single solution.
What is Referral Spam?
A referrer request-header file allows the client to specify the address (URI) of the resource from which the request?URI was obtained. It is a way for an HTTP client to send in the headers, the URI of the page that sent them there. This is especially handy for a site administrator to provide insight as to where the traffic on his web server is coming from. It is also depended upon by the most popular web server log analyzers in providing statistics on the most common referrers.
The HTTP Referrer: header is very useful but it is also completely arbitrary. Any web browser or HTTP client is free to send a forged Referrer: header with any request to a web server. Spammers have taken advantage of the fact that there is no provision for authentication in SMPTP and have used the existing openness to specially craft request with their website in the Referrer: header.
Most people will find it difficult to understand why someone would bother spamming something which only the site administrator will see in the logs. One probable motivation pinpointed is the boosting of search engine ranking. Another is simply to show-up in any stats published by the site. If a site being spammed runs a web server log analyzing software, access to the URL in the top referrer?s section is handily obtained by the spammer.
A serious consequence of referrer spam is that the process is often performed via an HTTP ?GET? or ?POST? request which retrieves the entire body of the document being spammed. A 30k document, for example, will have all the 30k transferred across one?s Internet pipe. This results to not a small amount of traffic in the web server which could be very costly since bandwidth is not cheap.
Referrer spam wastes CPU and disk space and can be a source of endless annoyance to server operators. It is being actually fought by search engine developers thus its initial effectiveness in boosting a site?s ranking has been considerably lessened. However, the problem persists and much has to be done to conquer it.
Some recommended practices in countering the threat of referral spam include the non-publication of referrers by bloggers, inclusion of the page in robots.txt when referrers have to be published, use of the rel=?no follow? attribute and gathering a cleaner list of referrers using JavaScript and beacon images. Some bloggers have begun fighting referrer spammers at the .htaccess level. Others have even taken steps to automate this.
Blocking Users by Referrer Notes
A very useful feature of .htaccess is the ability to block users or sites that originate from a particular domain. When there are tons of referrals from a particular site with no single visible link to one?s own site from the said site, the referral probably isn?t a legitimate one. The other site is most likely hot linking to certain files such as images, CSS file or other file. The blocking access by referrer in .htaccess requires the help of the Apache module mod rewrite to be able to make out the referrer first. There is a fear that spam would still come in even as .htaccess continue to grow. Blacklisting certain referrers in .htaccess is another option, the effectiveness of which has been greatly diminished due to the ease by which spammers are able to register thousands of domains and rotate them as quickly as they are blacklisted.
The .htaccess generator to prevent people from certain IP addresses, domains or even countries from gaining access to a site or to specific folders can be used. The full IP address has to be typed to block a specific IP. The use of a partial IP address is required to block a range of IPs. Blocking a particular domain can be done by typing the domain without the www. The tail extension is to be typed when blocking a country.
There is no limit to the entries that can be added one at a time. The ?add? should be checked after each entry while the generated code is to be copied and posted into a plain text file. This file is then named .htaccess. The ?.? Before the file name should be noted as well as the absence of any tail extension.
If there is already an .htaccess file in the root of the docs directory or the folder where it is to be applied, the generated code shall be added to the end of the current .htaccess file, taking extra care not to disturb the existing code. It will then be uploaded in ASCII mode.
The rel = ?no follow? solution
A coalition of blogging and search engine companies have joined together to support an HTML attribute designed primarily to combat comment spam but have high potentials as well for effective use against referral spam. This attribute is known as the rel =?no follow? is being praised by many bloggers as the ultimate solution for the prevailing problem. The idea is simple enough with the hardest part being the matter of convincing the major players such as Google, Yahoo! and MSN to agree on it.
Tagging a link with rel =?no follow? attribute would prevent any contribution to the site?s PageRank. This means that comment and referral spammers will not be rewarded for their illegitimate activities on websites that implement the attribute. The problem gets solved partially but this solution is unable to end it.
This truth is sought to be explained by the fact that it is impossible to reach a 100% adoption thus there will always be an incentive to spam. Spammers essentially do not care whether their techniques are specifically effective as long as they are generally effective. They need no particular reason to hit any site and will do so as their main target is the blogosphere as a whole. It is also quite unfortunate that the resources required to fight spam, particularly referral spam, is far bigger than the resources needed to create it.
Referral spam is an HTTP request. The client doesn?t even need to acknowledge the response. All it may need is a simple packet with formatted text.
Spammers take pains to make a request look legitimate. The user ? agent string would look very much like MSIE. It used to be that spam came from a single IP but things have definitely gotten more complex since then.
Filtering referrer IPs against spam blacklisting can also be done. Listing the referring URL in any section of a site?s web stats should be avoided if the IP is blacklisted. Do not pursue query once a given site is identified as a referral spam host name.
Related Articles:
Spam-Free Initiative SpamFrit.org Launches the BrandFlic Brand Monitoring and Spam Analysis Service
Spamfrit.org launches BrandFlic, the 'automated report' subscription system for brand managers and attorneys to track and trace both the legal and the illegal use of brand names in email campaigns.
MailWasher Pro 6 Released with Improved Spam Blocking and New Look: Now with over 8 Million Users Worldwide
Firetrust announces MailWasher Pro 6 with new features ... 8 million users worldwide.
Making Spam Filter Your Buddy
The web keeps the business world revolving. Infinite possibilities are unfolded as online business comes to exist. Through the internet, marketing campaign, promotion, news reports and many more are made in just a matter of minutes. With this, transactions are made easy resulting to more sales. But this is not the real score nowadays, with people sending unsolicited emails (dubbed as spam), mail administrators and users tend to install spam filters in order to prevent annoying and offensive messages from reaching their inboxes. But the thing is, your legitimate message can be blocked. Spam filters are generally designed to eliminate spam messages in the inbox by either directing the received message on the bulk folder or deleting it. In...
Cost Of Spam And Why Use Anti-spam Filter
E-mail is now being abused. The flow of spam on the Internet is the proof. It is annoying to download hundreds of disgusting spam emails into the inbox looking for some legitimate messages. Not only you waste your valuable time to delete junk emails by hand, you also waste your money as each spam message in your inbox takes precious kilobytes of bandwidth you paid for. In addition, spam messages can contain viruses, which can infect your computer system, and hidden tracking codes, which work as soon as you click on the message and let the spammer know that your email address is valid. With all that said, it would be great to delete the messages that you don?t want to receive beforehand and launch your email client to pull down only good ema...
Spam - We Have It, Now How Do We Stop It?
If your stock performance has matched the percentage rise of email spam, you will be retiring soon. The latest indicators are stating that Spam has nearly doubled in the past year alone. It now affects nearly everyone with an email account. Unfortunately for business, it also carries a rising cost in staff, resources and performance. Here are some strategies on how to start your assault on winning back your Inbox.
Spam Blockers: What They Can Do to Protect You
Spam blockers might be among the most important things that have to come along with your computer. This is most especially true if you are connected to the internet and you are more likely to be targeted by phishers and spammers. Having an efficient spam blocker installed in your PC will not only save you from the trouble of deleting numerous junk mails that arrive in your inbox. Spam blockers can even protect you from the dangers posed by viruses and phishing that usually get through your PC through unsolicited spams. Here are more reasons why you should have a spam blocker installed in your PC:
Irongate Integrates Mailshell's Engine To Block Spam, Phishing
IronGate, a leading Spanish manufacturer of security software solutions, today announced its selection of Mailshell Inc., the leading OEM provider of software engines that block email spam and phishing, to provide protection for its security appliances.
How To Identify Spam
Most of us have opened our email program and found, alongside correspondence from people that we know, offers for products from commercial web sites. Some of these emails we expect.
Use a Spam Blocker to Keep Your Computer Safe
Every individual who uses email should have a spam blocker up and running on their computer. Spam presents a major problem for both individuals and businesses. Unwanted email clogs up inboxes and can inflict a computer with a harmful virus.
SPAMfighter Receives Highest Rating Amongst Top Spam Filters from a Leading French Magazine
SPAMfighter was chosen as the Editor's Choice in a review done by Windows News in France.