Forums

Opening specific URL throwing an internal server error

I have created a web app using Flask and have used modules like beautifulsoup4, urllib. Now, whenever I send a request to the URL, to which I want to, using urllib.request.urlopen(myurl) it throws an internal server error. The interesting thing is my web app works perfectly fine on my localhost and also if I try opening any other url using urllib.request.urlopen(otherurl) it opens up just fine. What maybe the possible reasons behind this?

The most likely possibility is that you're trying to access a site that isn't on our whitelist for free accounts. If the site you're trying to access has an official public API then we can consider it for whitelisting -- just let us know the domain, and give a link to the API docs.

If there's no official public API, then it will only be accessible from a paid account.

Great! Is there any other way?

No

vitwifi: I would point out that paid accounts start from as little as $4/month

thus allowing you to access the sites you need, and to feel good about contributing to a fantastic service