Forums

Have a web scraper, can I save/get .csvs with PythonAnywhere?

Hi y'all,

I'm not a subscriber yet but I am shopping around.

I want to run web scrapers and save the data I get into .csvs or .txt or whatever; or even just download .pdfs and save them, etc.

How would that work on PythonAnywhere? Can I run a scraper that gives me a .csv and puts it in dropbox? I just want to figure out how I'd get my data.

Thanks! -ML

You can run a scraper, and, on a paid account, it should work fine (unless the sites you are scraping complain to us, in which case we might have to block them -- make sure you don't scrape pages excessively fast!).

You'd have to write the code to upload your results to Dropbox yourself, but they have an excellent API. Alternatively you could just download it from the "Files" tab on PythonAnywhere.