[SOLVED] HTTP Get - scraping behind a paywall?

[shabbysquire]

I'm hoping to use HTTP Get to scrape content (behind a paywall), but have to be logged into the site. I assume it's possible to log in by using my unique cookie in: HTTP Get > more tab > cookie?

 

[rostonix]

You can use cookies. But for a lot of sites it will not be enough. A lot of sites use several cookies + flash ones.
Try and test for your case.

 

[shabbysquire]

Ok thanks. Also in http get, can I grab the url? Sometimes I'm redirected to another url & I need to know which one.

 

[rostonix]

It should be in header of result. You can parse it with regex from variable which you get by this action.