Hacker News new | past | comments | ask | show | jobs | submit login
The new Task Queue API on Google App Engine (googleappengine.blogspot.com)
35 points by jcsalterego on June 18, 2009 | hide | past | favorite | 8 comments



We've had a home-brewed solution for a while. PendingNotification(s) that get processed by a cron task that runs every minute. The PendingNotification has all the data the cron task needs to execute it.

Actually, for a while, GAE didn't even have cron tasks. So we were kicking off stuff using silent ajax calls from clients.


Not usable for my needs due to a maximum of 10,000 insertions per day and 10 executions per second.


agreed. ever since i started playing around with GAE, i keep getting disappointed at the fine print of its limitations. its almost useless to do any kind of meaningful reporting from the datastore and i'm sure even this task api as you mentioned will keep hammering away at my sanity.

but with that said, i still play with it since i have faith it'll mature into a full platform. and if nothing else, it's a free hosting service for experimental websites, bringing down the barrier to entry officially to zero.


The 10.000 insertions per day is the real limit for now. Otherwise you could execute 24 (hours) * 3600 (s/h) * 10 (tasks/s) * 11 (queues, 1 default + 10 custom queues) = 9504000 tasks per day, which is not bad at all. But as you can only create 10k tasks per day, you cannot even approach this limit.

But note that these quotas are bound to change, they ask for feedback on precisely these issues, task throughput per day and task length, on the Overview page: http://code.google.com/appengine/docs/python/taskqueue/overv...


Agreed. You are already paying for bandwidth (which is _inside_ the datastore, and so should be free). Additional limitations are simply stupid.


Why not just offer persistent threads?


[deleted]


Yes, I do, and so do everyone who have read the article.

> The Task Queue API is Python-only for now; we'll have a Java language version available soon.


about time




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: