Quantcast
Channel: Azure Virtual Machines forum
Viewing all articles
Browse latest Browse all 12545

Cheap and scalable way to host Scrapy and Portia on Azure

$
0
0

Hi,

I am looking for a cheap and scalable solution to host Scrapy and Portia on Microsoft Azure.
Scrapy is a web scraping framework written in python. http://www.scrapy.org
Portia is a tool to visually create web scraping spiders for Scrapy in the browser. Portia also requires python. https://github.com/scrapinghub/portia

My goal is to create a spider with portia, deploy this spider to scrapy running inside a web app and save the crawl results as json.

My Azure experience is limited. Therefore I don't know if I need a fully fledged Virtual Machine or a simple Web App to run Portia.

Thank you!


Viewing all articles
Browse latest Browse all 12545

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>