Comments on: RabbitMQ, Celery and Django http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/ On stuff I do for living (and some random things as well). Tue, 27 Jul 2010 20:10:00 +0000 hourly 1 http://wordpress.org/?v=3.0 By: Mike Bannister http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-333 Mike Bannister Tue, 27 Jul 2010 20:10:00 +0000 http://robertpogorzelski.com/blog/?p=78#comment-333 Hi, I'm probably missing something obvious but I'm wondering if there's a way to automatically reload tasks when the source changes? I'm using celery in a django app, starting it with a supervisord script with the command: /path/manage.py celeryd --loglevel=INFO I have to reload or restart it every time I change the source code. Is there some way I can make it auto reload tasks when in development? Thanks very much for any advice, Mike Hi,

I’m probably missing something obvious but I’m wondering if there’s a
way to automatically reload tasks when the source changes? I’m using
celery in a django app, starting it with a supervisord script with the
command:

/path/manage.py celeryd –loglevel=INFO

I have to reload or restart it every time I change the source code. Is
there some way I can make it auto reload tasks when in development?

Thanks very much for any advice,
Mike

]]> By: Robert http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-254 Robert Mon, 26 Apr 2010 03:12:07 +0000 http://robertpogorzelski.com/blog/?p=78#comment-254 Good point. Better go with what Celery already offers. Good point. Better go with what Celery already offers.

]]> By: grigory http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-252 grigory Sun, 25 Apr 2010 21:03:24 +0000 http://robertpogorzelski.com/blog/?p=78#comment-252 Franz, Robert, You can also use celery's own views, if using in tandem with Django: http://ask.github.com/celery/reference/celery.views.html Franz, Robert,

You can also use celery’s own views, if using in tandem with Django: http://ask.github.com/celery/reference/celery.views.html

]]> By: andrew http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-127 andrew Sun, 28 Feb 2010 04:33:28 +0000 http://robertpogorzelski.com/blog/?p=78#comment-127 Franz, as alternative to Roberts suggestion, one way to get the results to the front end is to write some status to the database after the task worker finishes. The web page can do a meta refresh every 5 seconds, checking the db if the task has completed successfully or not. Franz, as alternative to Roberts suggestion, one way to get the results to the front end is to write some status to the database after the task worker finishes. The web page can do a meta refresh every 5 seconds, checking the db if the task has completed successfully or not.

]]> By: Robert http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-111 Robert Sun, 21 Feb 2010 00:56:34 +0000 http://robertpogorzelski.com/blog/?p=78#comment-111 I believe that depends much on the way you want to retrieve data. If you need an API for accessing results remotely, and you're using Django, I'd go for <a href="http://bitbucket.org/jespern/django-piston/wiki/Home" rel="nofollow">Piston</a>. That could help you building a nice and flexible RESTful interface. On the other hand, if you expect your data to get into the browser in real-time, you may want to have a look at Comet-like frameworks, e.g. <a href="http://orbited.org/" rel="nofollow">Orbited</a> (currently in zombie-state, as core developers concentrate on <a href="http://js.io/" rel="nofollow">Js.io</a>) or <a href="http://www.ape-project.org/" rel="nofollow">APE</a> (very cool, but I don't "feel" it personally). Anyway, there's a lot of cool stuff around, especially when dealing with STOMP/AMQP brokers. Please let me know about your further findings, I'm very much interested in this stuff recently! I believe that depends much on the way you want to retrieve data. If you need an API for accessing results remotely, and you’re using Django, I’d go for Piston. That could help you building a nice and flexible RESTful interface. On the other hand, if you expect your data to get into the browser in real-time, you may want to have a look at Comet-like frameworks, e.g. Orbited (currently in zombie-state, as core developers concentrate on Js.io) or APE (very cool, but I don’t “feel” it personally). Anyway, there’s a lot of cool stuff around, especially when dealing with STOMP/AMQP brokers. Please let me know about your further findings, I’m very much interested in this stuff recently!

]]> By: Franz http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-110 Franz Fri, 19 Feb 2010 23:24:58 +0000 http://robertpogorzelski.com/blog/?p=78#comment-110 Nice writeup! One question though: how can the celery task report its status back to the web app? I'm thinking of some ajaxy notification like "xy% of your video converted". Nice writeup! One question though: how can the celery task report its status back to the web app? I’m thinking of some ajaxy notification like “xy% of your video converted”.

]]> By: Debian Lennyでcelery/rabbitmqを動かすメモ | Go for it! http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-58 Debian Lennyでcelery/rabbitmqを動かすメモ | Go for it! Sat, 14 Nov 2009 10:37:10 +0000 http://robertpogorzelski.com/blog/?p=78#comment-58 [...] ちょっと駆け足でしたがPython Hack-a-thon #2で熱いネタだったのでとりあえず公開。突っ込み歓迎。 – もしmultiprocessing周りでエラーが出たら、以下のURLのパッチを適用する。 http://robertpogorzelski.com/blog/2009/09/10/rabbitmq-celery-and-django/ [...] [...] ちょっと駆け足でしたがPython Hack-a-thon #2で熱いネタだったのでとりあえず公開。突っ込み歓迎。 – もしmultiprocessing周りでエラーが出たら、以下のURLのパッチを適用する。 http://robertpogorzelski.com/blog/2009/09/10/rabbitmq-celery-and-django/ [...]

]]> By: Robert http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-56 Robert Tue, 10 Nov 2009 22:00:51 +0000 http://robertpogorzelski.com/blog/?p=78#comment-56 You're absolutely right, missed that somehow - updated. Thanks for pointing this out! You’re absolutely right, missed that somehow – updated. Thanks for pointing this out!

]]> By: Rob C http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-54 Rob C Wed, 04 Nov 2009 18:35:56 +0000 http://robertpogorzelski.com/blog/?p=78#comment-54 Oops! Looks like the problem was that in INSTALLED_APPS I was using package.appname.tasks instead of just appname.tasks. I think you still might need the tasks.register bit though. Good times! Oops! Looks like the problem was that in INSTALLED_APPS I was using package.appname.tasks instead of just appname.tasks.

I think you still might need the tasks.register bit though. Good times!

]]> By: Rob C http://webcookies.org/blog/2009/09/10/rabbitmq-celery-and-django/comment-page-1/#comment-53 Rob C Wed, 04 Nov 2009 18:20:11 +0000 http://robertpogorzelski.com/blog/?p=78#comment-53 Doesn't seem to work as described. I continue to get error messages such as: [ERROR/MainProcess] Unknown task ignored: videos.tasks.ProcessVideoTask [ERROR/MainProcess] Unknown task ignored: None Also I noticed on the other celery tutorial they suggest adding a line to your tasks.py file: >>> tasks.register(ProcessVideoTask) However adding this didn't seem to solve anything for me. Doesn’t seem to work as described. I continue to get error messages such as:
[ERROR/MainProcess] Unknown task ignored: videos.tasks.ProcessVideoTask
[ERROR/MainProcess] Unknown task ignored: None

Also I noticed on the other celery tutorial they suggest adding a line to your tasks.py file:
>>> tasks.register(ProcessVideoTask)

However adding this didn’t seem to solve anything for me.

]]>