youtube url scraper

akash

Client
Регистрация
01.08.2012
Сообщения
40
Благодарностей
2
Баллы
0
how would i make a youtube url scraper. would i have to navigate to each search result, then grab the url. or can url be grabbed from the search results without opening each individual video?

thx


**edit ok after some messing around i have found that i can grab all the urls from the search results page and not have to navigate to each individual video.

also found with this with the reg ex designer

(?<=<div\ class="yt-lockup2-thumbnail"><a\ href=")/watch[\w\W]*?(?="\ class="ux-thumb-wrap)

i get it to work, but it only saves 1 url, and not all the ones on the page. (What to save --> First)

take a look at screen shot.

If i change it to all, then i cannot select dropdown to add it to a variable
 

Вложения

  • 27,2 КБ Просмотры: 692

rostonix

Известная личность
Регистрация
23.12.2011
Сообщения
29 067
Благодарностей
5 712
Баллы
113
You need to create List and save results to it.
If you use regex and interested in all matches, there's no option to save to variable.

Only to list.
 

akash

Client
Регистрация
01.08.2012
Сообщения
40
Благодарностей
2
Баллы
0
Do I still use regex? I'm not sure I follow what youre saying.

Do I save first to Variable using regex save to list then loop back?

Thx.
 

rostonix

Известная личность
Регистрация
23.12.2011
Сообщения
29 067
Благодарностей
5 712
Баллы
113

akash

Client
Регистрация
01.08.2012
Сообщения
40
Благодарностей
2
Баллы
0
I'll try this thanks.
 

Кто просматривает тему: (Всего: 1, Пользователи: 0, Гости: 1)