How to download content from a specific website

Sometimes you want to download content from one website, eg wikipedia.org instead of just downloading the top ranking results.

In previous versions of SCM, we had content sources that you can select from eg article directories.

This is no longer required as you can just use search operators.

The video below explores how search operators work.

Search Operators

All search operators are supported but the most useful ones are

inurl:

intitle:

Becareful!

Search operators are an expensive operation.

You can search 30 keywords a hour in Google with no problems. However, by the time of the 5th search operator search Google will start to issue captchas.

Use sparingly!

Above are the normal search results for sencha tea.

If we use the inurl search operator…

Now all our found search results are from wikipedia only. We can use this list to download all the content from one website.