Comments on: RabbitMQ, Celery and Django http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/ On stuff I do for living (and some random things as well). Tue, 09 Mar 2010 23:26:40 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: andrew http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-127 andrew Sun, 28 Feb 2010 04:33:28 +0000 http://robertpogorzelski.com/blog/?p=78#comment-127 Franz, as alternative to Roberts suggestion, one way to get the results to the front end is to write some status to the database after the task worker finishes. The web page can do a meta refresh every 5 seconds, checking the db if the task has completed successfully or not. Franz, as alternative to Roberts suggestion, one way to get the results to the front end is to write some status to the database after the task worker finishes. The web page can do a meta refresh every 5 seconds, checking the db if the task has completed successfully or not.

]]> By: Robert http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-111 Robert Sun, 21 Feb 2010 00:56:34 +0000 http://robertpogorzelski.com/blog/?p=78#comment-111 I believe that depends much on the way you want to retrieve data. If you need an API for accessing results remotely, and you're using Django, I'd go for <a href="http://bitbucket.org/jespern/django-piston/wiki/Home" rel="nofollow">Piston</a>. That could help you building a nice and flexible RESTful interface. On the other hand, if you expect your data to get into the browser in real-time, you may want to have a look at Comet-like frameworks, e.g. <a href="http://orbited.org/" rel="nofollow">Orbited</a> (currently in zombie-state, as core developers concentrate on <a href="http://js.io/" rel="nofollow">Js.io</a>) or <a href="http://www.ape-project.org/" rel="nofollow">APE</a> (very cool, but I don't "feel" it personally). Anyway, there's a lot of cool stuff around, especially when dealing with STOMP/AMQP brokers. Please let me know about your further findings, I'm very much interested in this stuff recently! I believe that depends much on the way you want to retrieve data. If you need an API for accessing results remotely, and you’re using Django, I’d go for Piston. That could help you building a nice and flexible RESTful interface. On the other hand, if you expect your data to get into the browser in real-time, you may want to have a look at Comet-like frameworks, e.g. Orbited (currently in zombie-state, as core developers concentrate on Js.io) or APE (very cool, but I don’t “feel” it personally). Anyway, there’s a lot of cool stuff around, especially when dealing with STOMP/AMQP brokers. Please let me know about your further findings, I’m very much interested in this stuff recently!

]]> By: Franz http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-110 Franz Fri, 19 Feb 2010 23:24:58 +0000 http://robertpogorzelski.com/blog/?p=78#comment-110 Nice writeup! One question though: how can the celery task report its status back to the web app? I'm thinking of some ajaxy notification like "xy% of your video converted". Nice writeup! One question though: how can the celery task report its status back to the web app? I’m thinking of some ajaxy notification like “xy% of your video converted”.

]]> By: Debian Lennyでcelery/rabbitmqを動かすメモ | Go for it! http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-58 Debian Lennyでcelery/rabbitmqを動かすメモ | Go for it! Sat, 14 Nov 2009 10:37:10 +0000 http://robertpogorzelski.com/blog/?p=78#comment-58 [...] ちょっと駆け足でしたがPython Hack-a-thon #2で熱いネタだったのでとりあえず公開。突っ込み歓迎。 – もしmultiprocessing周りでエラーが出たら、以下のURLのパッチを適用する。 http://robertpogorzelski.com/blog/2009/09/10/rabbitmq-celery-and-django/ [...] [...] ちょっと駆け足でしたがPython Hack-a-thon #2で熱いネタだったのでとりあえず公開。突っ込み歓迎。 – もしmultiprocessing周りでエラーが出たら、以下のURLのパッチを適用する。 http://robertpogorzelski.com/blog/2009/09/10/rabbitmq-celery-and-django/ [...]

]]> By: Robert http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-56 Robert Tue, 10 Nov 2009 22:00:51 +0000 http://robertpogorzelski.com/blog/?p=78#comment-56 You're absolutely right, missed that somehow - updated. Thanks for pointing this out! You’re absolutely right, missed that somehow – updated. Thanks for pointing this out!

]]> By: Rob C http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-54 Rob C Wed, 04 Nov 2009 18:35:56 +0000 http://robertpogorzelski.com/blog/?p=78#comment-54 Oops! Looks like the problem was that in INSTALLED_APPS I was using package.appname.tasks instead of just appname.tasks. I think you still might need the tasks.register bit though. Good times! Oops! Looks like the problem was that in INSTALLED_APPS I was using package.appname.tasks instead of just appname.tasks.

I think you still might need the tasks.register bit though. Good times!

]]> By: Rob C http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-53 Rob C Wed, 04 Nov 2009 18:20:11 +0000 http://robertpogorzelski.com/blog/?p=78#comment-53 Doesn't seem to work as described. I continue to get error messages such as: [ERROR/MainProcess] Unknown task ignored: videos.tasks.ProcessVideoTask [ERROR/MainProcess] Unknown task ignored: None Also I noticed on the other celery tutorial they suggest adding a line to your tasks.py file: >>> tasks.register(ProcessVideoTask) However adding this didn't seem to solve anything for me. Doesn’t seem to work as described. I continue to get error messages such as:
[ERROR/MainProcess] Unknown task ignored: videos.tasks.ProcessVideoTask
[ERROR/MainProcess] Unknown task ignored: None

Also I noticed on the other celery tutorial they suggest adding a line to your tasks.py file:
>>> tasks.register(ProcessVideoTask)

However adding this didn’t seem to solve anything for me.

]]> By: Krish http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-24 Krish Sat, 19 Sep 2009 15:52:26 +0000 http://robertpogorzelski.com/blog/?p=78#comment-24 Hi Robert, Thanks for the post. It is very useful. I am looking into setting up a task manager and I think, this will be very useful for me Regards, Krish Hi Robert,

Thanks for the post. It is very useful. I am looking into setting up a task manager and I think, this will be very useful for me

Regards,

Krish

]]> By: Tweets that mention RabbitMQ, Celery and Django « Happy stream of thoughts -- Topsy.com http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-16 Tweets that mention RabbitMQ, Celery and Django « Happy stream of thoughts -- Topsy.com Thu, 10 Sep 2009 20:20:14 +0000 http://robertpogorzelski.com/blog/?p=78#comment-16 [...] This post was mentioned on Twitter by Ask Solem Hoel and Ask Solem Hoel. Ask Solem Hoel said: RT @rpogorzelski: New blog post: RabbitMQ, Celery and Django http://bit.ly/1qTTFE [...] [...] This post was mentioned on Twitter by Ask Solem Hoel and Ask Solem Hoel. Ask Solem Hoel said: RT @rpogorzelski: New blog post: RabbitMQ, Celery and Django http://bit.ly/1qTTFE [...]

]]>