- Регистрация
- 08.07.2013
- Сообщения
- 81
- Благодарностей
- 1
- Баллы
- 8
Hi,
I am working on a Twitter Follower Scraper. Template is pretty simple, its goes to Twitter User Followers page, scrolls down page then stops, takes DOM, Regex, save to file. Problem is when I am user page with 50k followers and I am trying to scrape the followers the DOM wont load when the page is after 2.5k followers. Im not sure what issue is. I am working on 32GB dedicated server so it isnt memory. Any suggestions how to fix this?
I am working on a Twitter Follower Scraper. Template is pretty simple, its goes to Twitter User Followers page, scrolls down page then stops, takes DOM, Regex, save to file. Problem is when I am user page with 50k followers and I am trying to scrape the followers the DOM wont load when the page is after 2.5k followers. Im not sure what issue is. I am working on 32GB dedicated server so it isnt memory. Any suggestions how to fix this?