Free Web Hosting Forum
wolx wolx is offline
Junior Member
wolx is on a distinguished road
Posts: 10
Join Date: May 2008
Default CRON jobs - 05-03-2011, 05:21 PM

I have a simple question.

If a CRON job downloads an external web page's page source, does that use up my account's bandwidth?
Reply With Quote

mopedmaniac's Avatar
mopedmaniac mopedmaniac is offline
Senior Member
mopedmaniac is on a distinguished road
Posts: 453
Join Date: Dec 2010
Location: Wales, UK
Send a message via Skype™ to mopedmaniac
Default 05-03-2011, 08:26 PM

Yes, it would as it measures traffic that passes through your account

Use the coupon code 000webhost at checkout to receive a 25% discount for life on paid hosting packages!

If I have helped you, click the Karma button
Reply With Quote
Sogo7 Sogo7 is offline
Sogo7 is on a distinguished road
Posts: 294
Join Date: Dec 2010
Default 05-04-2011, 02:11 AM

There are a couple of ways to reduce the amount of bandwidth used by Data Intergration (Scraping is an ugly word, especially if you have permission) by using either Python on the Google Apps Engine or Yahoo Pipes. Yahoo Pipes being a whole lot simpler plus it can be called both server side and client side so probably worth looking at first.

Either of these free external server services can be used to retrieve HTML data ( in accordance with the donor sites robots.txt file ) and perform much if not all the parsing required to extract the data you require before sending it to your site for storage and re-use. OR directly to the web page on the visitors PC thus sidestepping the bandwidth issue completely.


Not done much expermentation with CRON here at 000, so this is just a supplemental note:

experience from other free hosting providers is that the CRON account lacks the required privaliges to query external URLs, send mail and POST form data etc
Reply With Quote

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Powered by vBulletin® Version 3.8.2
Copyright ©2000 - 2016, Jelsoft Enterprises Ltd.
vBulletin Skin developed by: