Custom Scrapers
Custom Scraper in Skyridge: Unleash Customization
The Custom Scraper module in Skyridge is a remarkably versatile and highly customizable tool. It performs email scanning and link scraping just like the Predefined Scraper but with the added benefit of allowing you to define the specific links you are searching for. While it can be helpful to be familiar with the basics, the Custom Scraper empowers you to set precise criteria for your link scraping.
For example, if the link you want to scrape appears as follows: https://www.paypal.com/cgi-bin/webscr?cmd=_express-checkout&token=EC-3J713945X, you should input only https://www.paypal.com/cgi-bin/webscr?cmd=_express-checkout&token= into the bot, as the token portion can vary with each instance.
To maximize the tool's effectiveness, aim for utmost precision when defining your link criteria. With the right expertise, this tool becomes a powerful asset in your Skyridge arsenal.
Custom Scraper Method Selection: Your Choices
When opting for the Custom Scraper, the bot will prompt you to select your preferred search method. You have three distinct search methods to choose from:
FROM
This method will let Skyridge check for the sender of an email. You either enter a whole address like "subscribe@dsm-ny.com" or just a part of the address or the sender as a whole like "Basket4Ballers".
SUBJECT
This method scans every subject line of an email for the given criteria. Possible criteria can be "YOU ARE A WINNER" or "GOT'EM".
TEXT
This method scans the whole text of an email and searches for the matching criteria given. We recommend to be as precisely as possible as you could download a lot of unwanted emails.
Defining Search Criteria: Precision Is Key
Following that, Skyridge will request you to input your search criteria. It's essential to be as precise as possible in your entries. It can be helpful to review emails you already possess, as they often share similarities with the emails you're searching for. This can aid in refining your search criteria effectively.
Now you have to select an account file. Please check out mailAccounts.csv on how to setup up an account file.
After selecting the file, Skyridge will scrape every link it can find and will save it in the LINKS.csv in your Skyridge root folder.
Last updated