Do you want to take advantage of what Dotidot has to offer, but you're missing the data source? With Feed scraper, you can easily create your own feed using sitemap.
In the menu, open the data source tab and use the + button to select the Create new data source option. You will see a list of available data sources, this time you will select Scraper.
Select the name of your future data source and enter the URL of your sitemap you want to scrape. You can also filter the pages and subpages you want to scrape. You can refine your selection using conditions. On the right side you have a preview of what will be scraped and an example of a random product.
In the Scraping tab you can choose html tags that will not be scraped. In case your site needs Javascript to render the content, turn on the Use browser to load content button. Use this option only as a last resort.
Now you can choose to get even more data, and for that you can either use CSS selectors and select information from your site that will then be loaded as attributes in your new data source. Or use our Scraper wizard, which allows you to select data in a visual way.
Scraper Wizard
Thanks to the wizard option, you don't have to choose CSS selectors from the source URL, but simply click on the attributes from the visual preview of your page.
After clicking on Use Scraper wizard, you will see a window with a preview of the page you entered. Here you can select the attributes that your new feed will contain with a simple click. Thera are two ways how to select desired atributes:
A: In the preview on the right you can see what data will be copied to the feed. Remember to name your new variable correctly. If you want to select more attributes, click on Save and continue.
B: If, for example, your preview contains a drop-down menu from which you cannot select all the necessary attributes with a simple click, you can switch from the image preview to the text preview, which will be displayed without any formatting. Then proceed with the selection in the same way as for point A.
After saving, you will clearly see the attributes you have chosen in the previous step.
Then you have the option to choose, what will Dotidot do if the input data source contains 0 items.
If you are satisfied with your settings, select the Add data source option.
As soon as a new source is generated (the time depends on the amount of scrapped data), you will see in the overview all products that meet the conditions you have specified.