The Spider Technique – Finding What Google Doesn’t Show You

This technique comes from the experience I got from expired domain research.

What is it about? Well, many times you need to research something and what you normally do is you Google it. This became a standard, cozy way to do this.

It has however a couple of drawbacks. You have no choice – the answer is given by a robot (algorithm) determining what is relevant for YOU. I must say that this algorithm is pretty good, however I am sure you also noticed that when you go down the search results, after 3-4 pages you start to see the same stuff coming up over and over. And there is stuff you never see.

Most people don’t realize this, but unfortunately the internet doesn’t have an overall directory or table of contents or a subject index where you can find everything. (If someone could make one up, they could make a lot of money out of it.) Instead we have search engine indexes.

The problem is that Google’s algorithm is that it is based on exclusion. Have you noticed this? It is called “relevance”, but it is actually exclusion. Have you noticed that if you have a new site, you may have the greatest content of all, it will be excluded and not shown. If your site doesn’t have links, high DA or PR or whatever, it is excluded. And many times this is unfair both to the site owner and to the readers, as there is no choice element. It could be quite lucrative to create an alternative search engine based on the above, provided it is figured out how to avoid spam.

There is an alternative way to find stuff that I accidentally discovered and I call it the spider technique. The reason being, you act like a spider. The only difference is that you are following the links backwards, like a reverse spider.

This is what I mean – you take the main authority site of your niche, put it into a backlink checker and follow the backlinks one by one. You will be in for a surprise!

I have been using SEO SpyGlass for this, as it has a free version, but you can use any backlink checker. It’s very important that these backlink checker services have their own backlink databases, independent of Google. They can contain links that Google doesn’t have.

So I just follow the links, scan through the article and bookmark the content that is useful. In addition to content, software tools and services, you will find sites that you can use for backlink building and affiliate programs for your niche.

To tell you the truth, I hate affiliate networks. They have a huge ego and they are very picky about who can join them. Also their sites are super slow and everyone promotes the same offers, which means competition. There are a lot of smaller sites that have a nice product and they offer an affiliate program. And all you have to do is open an account and get your affiliate link, you are all set to promote.

Here is an example. As you can notice by the title of my site, I research expired and deleted domains. So I put into my backlink checker and one of the links took me back to PBN HQ. Surprisingly it doesn’t rank in Google for the keyword “expired domains”, even though that is their main product.

Even though I am not a fan of PBNs as I find them risky, I find their expired domain selling service pretty impressive. They manually check every domain to ensure only clean domains are in their marketplace, update their metrics every 24 hours, and they replace your domain if you are not happy with it.

I don’t see any affiliate links on their site, therefore I Google “PBN HQ affiliate program”, and there you go, I find their affiliate program. I make an account, get my affiliate link, they offer a 15% commission. Their program is not listed.

Then I sign up for their mailing list, “Today’s Fresh Domains”, as I want to see their business model and what they have to offer. Right in their e-mail it says:

“Want to know our secret to finding Powerful expired domains? Domain Ronin is the amazing expired domain crawler we use”

DomainRonin also looks like a decent software for finding expired domains, with a Multi-threaded spider, with metrics from both Moz and Majestic and SpamZilla spam checker for your domain. And they say, “you can leave the Ronin crawling the internet for days if you so choose”.

I Google “DomainRonin affiliate program”, and there you go, I find their affiliate program. I make an account, get my affiliate link, they also offer a 15% commission. This is how you find great affiliate programs that are not over-promoted.

Now I will show you how to find great content using the spider technique. Staying on the subject of PBNs, I happened to randomly put into my backlink checker, and I found this really nice article on Hammerhead Domains about how to spam check a domain.

It is very useful information if you want to buy any domain even at an auction, or a re-register a deleted domain. I don’t think you would find it in Google.

What I do is I keep bookmarking such sites and then keep going following links until I feel that I know everything I want to know about the subject. Then I can write a great article. I am not talking about copy-pasting content, as you will never survive that way. You just write your own thoughts, which will be different with all the extra information you now have, and you can easily link to some of this content (they are in your boookmarks) and this way you can provide even more value to your readers as they would never find this data through Google search.

So this is a quick overview of the spider technique. You can leave a comment below if you had success with using this technique or if you have any questions or anything to add.

Also please share this with your social network followers and e-mail subscribers if you liked it, otherwise this article will also be sitting here unnoticed, as I doubt that it would get shown on the first page of search results. At this writing my site is not even indexed in Bing…