OZONE Asylum
Forums
Server-Side Scripting - Oh my!
Hidden url finder on remote server with cURL slow timout
This page's ID:
27781
Search
QuickChanges
Forums
FAQ
Archives
Register
Edit Post
Who can edit a post?
The poster and administrators may edit a post. The poster can only edit it for a short while after the initial post.
Your User Name:
Your Password:
Login Options:
Remember Me On This Computer
Your Text:
Insert Slimies »
Insert UBB Code »
Close
Last Tag
|
All Tags
UBB Help
This might work, but hitting 10^6 pages ain't gonna be ever fast. Now, I don't even want to know why there's this hidden url around... nayhow, I'd advise on doing that only against your own server - you're bound to generate a lot of traffic. All right, I'd see if the server suppered HTTP HEAD instead of HTTP GET (check with a known url, read the rfc if yo must), I'd probably dump curl in this and do the talking directly on a tcp socket on port 80, but that' just an off chance. Otherwise, you probably should be running this in serveral threads (or server php page calls), just to lower the latency. See... the actuall sending of data is neglible in what you are doing - but it simply takes half a second to establish a new tcp connection, and ask the server wether there's a page there. But you could probably do 50 of them at the same time. Oh, and I'd so put a known good url in there just to check that your code would actually print on the found url ;). so long, ->Tyberius Prime
Loading...
Options:
Enable Slimies
Enable Linkwords
« Backwards
—
Onwards »
Maximum Security
OZONE
DHTML/Javascript
Server-Side Scripting - Oh my!
CSS - DOM - XHTML - XML - XSL - XSLT
Stupid Basic HTML
Visual Therapy
Photoshop
Photoshop Pong, Anyone?
***WARNING*** BIG SIG APPROACHING
Photography
3D Modelling & Rendering
Multimedia/Animation
Print Graphics
Holding Pens
Philosophy and other Silliness
Outpatient Counseling
Site reviews!
Mad Scientists' Laboratory
Getting to know the Grail