how would i make a youtube url scraper. would i have to navigate to each search result, then grab the url. or can url be grabbed from the search results without opening each individual video?
thx
**edit ok after some messing around i have found that i can grab all the urls from the search results page and not have to navigate to each individual video.
also found with this with the reg ex designer
(?<=<div\ class="yt-lockup2-thumbnail"><a\ href=")/watch[\w\W]*?(?="\ class="ux-thumb-wrap)
i get it to work, but it only saves 1 url, and not all the ones on the page. (What to save --> First)
take a look at screen shot.
If i change it to all, then i cannot select dropdown to add it to a variable
thx
**edit ok after some messing around i have found that i can grab all the urls from the search results page and not have to navigate to each individual video.
also found with this with the reg ex designer
(?<=<div\ class="yt-lockup2-thumbnail"><a\ href=")/watch[\w\W]*?(?="\ class="ux-thumb-wrap)
i get it to work, but it only saves 1 url, and not all the ones on the page. (What to save --> First)
take a look at screen shot.
If i change it to all, then i cannot select dropdown to add it to a variable
Вложения
-
27,2 КБ Просмотры: 713