Multithread problems is still there

[lokiys]

I have to admit that many problems is solved with multithread, but a lot of them is still there...

Like just now I did e-bay scrape and I had 824 product links, after scrape with 5 threads I got 84 bad end.
After that I put that 84 links in my link list and ran again but this time just with one thread and now bad end was just 1 link with error, and running this one link in PM there was no error at all...

Everything Worked without proxy

 

[rostonix]

What errors do you get in logs?

 

[lokiys]

What errors do you get in logs?

General errors about random html elements...
My template does not use any emulations...

 

[rostonix]

Proxies?

 

[lokiys]

Proxies?

This time without proxies and I worked with this template whole day and every time I run it I'm getting same problems.
Only way to got all links scrapped was run first with 10 threads, then copy bad end links back to link list, run with 5 threads, again copy bad end links to linklist, and then run with one thread and get all links scrapped...

 

[lokiys]

I talked with one developer and he said that in .NET multi-threading fundamentally is working like crap... Is that true ? If so that could explain everything...

 

[rostonix]

More threads = more possible errors in any spot of the projects since threads use PC resources. We made serious update in 5.7.1.0 and there should be improvements for html errors.
It's not something that will work in 100% in any cases. It always depends on projects. You can set 1 instance per base if you have html errors when you use multiply threads per base.

 

[lokiys]

More threads = more possible errors in any spot of the projects since threads use PC resources. We made serious update in 5.7.1.0 and there should be improvements for html errors.
It's not something that will work in 100% in any cases. It always depends on projects. You can set 1 instance per base if you have html errors when you use multiply threads per base.

I hope that this answer is no need to read like this "Everything is fine and this is how it should work" and there will be some fix for this.
I sent full working template in ticket, would like to follow how it goes...

Thanks