Changelog 12 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352
  1. ==============
  2. Change history
  3. ==============
  4. 0.3.7 [2008-06-16 11:41 P.M CET]
  5. -----------------------------------------------
  6. * **IMPORTANT** Use AMQP's ``basic.consume`` instead of ``basic.get``.
  7. This means we're no longer polling the broker for new messages.
  8. * **IMPORTANT** Default concurrency is now set to the number of CPU
  9. available on the system.
  10. * **IMPORTANT** ``tasks.register``: Renamed ``task_name`` argument to
  11. ``name``, so
  12. >>> tasks.register(func, task_name="mytask")
  13. has to be replaced with:
  14. >>> tasks.register(func, name="mytask")
  15. * The daemon now correctly runs if the pidlock is stale.
  16. * Now compatible with carrot 0.5.0 (TBA)
  17. * Default AMQP connnection timeout is now 4 seconds.
  18. * ``AsyncResult.read()`` was always returning ``True``.
  19. * Only use README as long_description if the file exists so easy_install don't
  20. break. Closes #11.
  21. * ``celery.view``: JSON responses now properly set its mime-type.
  22. * ``apply_async`` now has a ``connection`` keyword argument so you
  23. can re-use the same AMQP connection if you want to execute
  24. more than one task.
  25. * Handle failures in task_status view such that it won't throw 500s.
  26. * Fixed typo ``AMQP_SERVER`` in documentation to ``AMQP_HOST``.
  27. * Worker exception e-mails send to admins now works properly.
  28. * No longer depends on ``django``, so installing ``celery`` won't affect
  29. the preferred django version installed.
  30. * Now works with PostgreSQL (psycopg2) again by registering the
  31. ``PickledObject`` field.
  32. * ``celeryd``: Added ``--detach`` option as an alias to ``--daemon``, and
  33. it's the term used in the documentation from now on.
  34. * Make sure the pool and periodic task worker thread is terminated
  35. properly at exit. (So ``Ctrl-C`` works again).
  36. * Now depends on ``python-daemon``.
  37. * Removed dependency to ``simplejson``
  38. * Cache Backend: Re-establishes connection for every task process
  39. if the Django cache backend is memcached/libmemcached.
  40. * Tyrant Backend: Now re-establishes the connection for every task
  41. executed.
  42. 0.3.3 [2009-06-08 01:07 P.M CET]
  43. -----------------------------------------------
  44. * The ``PeriodicWorkController`` now sleeps for 1 second between checking
  45. for periodic tasks to execute.
  46. 0.3.2 [2009-06-08 01:07 P.M CET]
  47. -----------------------------------------------
  48. * celeryd: Added option ``--discard``: Discard (delete!) all waiting
  49. messages in the queue.
  50. * celeryd: The ``--wakeup-after`` option was not handled as a float.
  51. 0.3.1 [2009-06-08 01:07 P.M CET]
  52. -----------------------------------------------
  53. * The `PeriodicTask`` worker is now running in its own thread instead
  54. of blocking the ``TaskController`` loop.
  55. * Default ``QUEUE_WAKEUP_AFTER`` has been lowered to ``0.1`` (was ``0.3``)
  56. 0.3.0 [2009-06-08 12:41 P.M CET]
  57. -----------------------------------------------
  58. **NOTE** This is a development version, for the stable release, please
  59. see versions 0.2.x.
  60. **VERY IMPORTANT:** Pickle is now the encoder used for serializing task
  61. arguments, so be sure to flush your task queue before you upgrade.
  62. * **IMPORTANT** TaskSet.run() now returns a celery.result.TaskSetResult
  63. instance, which lets you inspect the status and return values of a
  64. taskset as it was a single entity.
  65. * **IMPORTANT** Celery now depends on carrot >= 0.4.1.
  66. * The celery daemon now sends task errors to the registered admin e-mails.
  67. To turn off this feature, set ``SEND_CELERY_TASK_ERROR_EMAILS`` to
  68. ``False`` in your ``settings.py``. Thanks to Grégoire Cachet.
  69. * You can now run the celery daemon by using ``manage.py``::
  70. $ python manage.py celeryd
  71. Thanks to Grégoire Cachet.
  72. * Added support for message priorities, topic exchanges, custom routing
  73. keys for tasks. This means we have introduced
  74. ``celery.task.apply_async``, a new way of executing tasks.
  75. You can use ``celery.task.delay`` and ``celery.Task.delay`` like usual, but
  76. if you want greater control over the message sent, you want
  77. ``celery.task.apply_async`` and ``celery.Task.apply_async``.
  78. This also means the AMQP configuration has changed. Some settings has
  79. been renamed, while others are new::
  80. CELERY_AMQP_EXCHANGE
  81. CELERY_AMQP_PUBLISHER_ROUTING_KEY
  82. CELERY_AMQP_CONSUMER_ROUTING_KEY
  83. CELERY_AMQP_CONSUMER_QUEUE
  84. CELERY_AMQP_EXCHANGE_TYPE
  85. See the entry `Can I send some tasks to only some servers?`_ in the
  86. `FAQ`_ for more information.
  87. .. _`Can I send some tasks to only some servers?`:
  88. http://bit.ly/celery_AMQP_routing
  89. .. _`FAQ`: http://ask.github.com/celery/faq.html
  90. * Task errors are now logged using loglevel ``ERROR`` instead of ``INFO``,
  91. and backtraces are dumped. Thanks to Grégoire Cachet.
  92. * Make every new worker process re-establish it's Django DB connection,
  93. this solving the "MySQL connection died?" exceptions.
  94. Thanks to Vitaly Babiy and Jirka Vejrazka.
  95. * **IMOPORTANT** Now using pickle to encode task arguments. This means you
  96. now can pass complex python objects to tasks as arguments.
  97. * Removed dependency on ``yadayada``.
  98. * Added a FAQ, see ``docs/faq.rst``.
  99. * Now converts any unicode keys in task ``kwargs`` to regular strings.
  100. Thanks Vitaly Babiy.
  101. * Renamed the ``TaskDaemon`` to ``WorkController``.
  102. * ``celery.datastructures.TaskProcessQueue`` is now renamed to
  103. ``celery.pool.TaskPool``.
  104. * The pool algorithm has been refactored for greater performance and
  105. stability.
  106. 0.2.0 [2009-05-20 05:14 P.M CET]
  107. ------------------------------------------------
  108. * Final release of 0.2.0
  109. * Compatible with carrot version 0.4.0.
  110. * Fixes some syntax errors related to fetching results
  111. from the database backend.
  112. 0.2.0-pre3 [2009-05-20 05:14 P.M CET]
  113. ----------------------------------------------------
  114. * *Internal release*. Improved handling of unpickled exceptions,
  115. get_result() now tries to recreate something looking like the
  116. original exception.
  117. 0.2.0-pre2 [2009-05-20 01:56 P.M CET]
  118. ----------------------------------------------------
  119. * Now handles unpickleable exceptions (like the dynimically generated
  120. subclasses of ``django.core.exception.MultipleObjectsReturned``).
  121. 0.2.0-pre1 [2009-05-20 12:33 P.M CET]
  122. ----------------------------------------------------
  123. * It's getting quite stable, with a lot of new features, so bump
  124. version to 0.2. This is a pre-release.
  125. * ``celery.task.mark_as_read()`` and ``celery.task.mark_as_failure()`` has
  126. been removed. Use ``celery.backends.default_backend.mark_as_read()``,
  127. and ``celery.backends.default_backend.mark_as_failure()`` instead.
  128. 0.1.15 [2009-05-19 04:13 P.M CET]
  129. ------------------------------------------------
  130. * The celery daemon was leaking AMQP connections, this should be fixed,
  131. if you have any problems with too many files open (like ``emfile``
  132. errors in ``rabbit.log``, please contact us!
  133. 0.1.14 [2009-05-19 01:08 P.M CET]
  134. ------------------------------------------------
  135. * Fixed a syntax error in the ``TaskSet`` class. (No such variable
  136. ``TimeOutError``).
  137. 0.1.13 [2009-05-19 12:36 P.M CET]
  138. ------------------------------------------------
  139. * Forgot to add ``yadayada`` to install requirements.
  140. * Now deletes all expired task results, not just those marked as done.
  141. * Able to load the Tokyo Tyrant backend class without django
  142. configuration, can specify tyrant settings directly in the class
  143. constructor.
  144. * Improved API documentation
  145. * Now using the Sphinx documentation system, you can build
  146. the html documentation by doing ::
  147. $ cd docs
  148. $ make html
  149. and the result will be in ``docs/.build/html``.
  150. 0.1.12 [2009-05-18 04:38 P.M CET]
  151. ------------------------------------------------
  152. * ``delay_task()`` etc. now returns ``celery.task.AsyncResult`` object,
  153. which lets you check the result and any failure that might have
  154. happened. It kind of works like the ``multiprocessing.AsyncResult``
  155. class returned by ``multiprocessing.Pool.map_async``.
  156. * Added dmap() and dmap_async(). This works like the
  157. ``multiprocessing.Pool`` versions except they are tasks
  158. distributed to the celery server. Example:
  159. >>> from celery.task import dmap
  160. >>> import operator
  161. >>> dmap(operator.add, [[2, 2], [4, 4], [8, 8]])
  162. >>> [4, 8, 16]
  163. >>> from celery.task import dmap_async
  164. >>> import operator
  165. >>> result = dmap_async(operator.add, [[2, 2], [4, 4], [8, 8]])
  166. >>> result.ready()
  167. False
  168. >>> time.sleep(1)
  169. >>> result.ready()
  170. True
  171. >>> result.result
  172. [4, 8, 16]
  173. * Refactored the task metadata cache and database backends, and added a new backend for Tokyo Tyrant. You can set the backend in your django settings file. e.g
  174. CELERY_BACKEND = "database"; # Uses the database
  175. CELERY_BACKEND = "cache"; # Uses the django cache framework
  176. CELERY_BACKEND = "tyrant"; # Uses Tokyo Tyrant
  177. TT_HOST = "localhost"; # Hostname for the Tokyo Tyrant server.
  178. TT_PORT = 6657; # Port of the Tokyo Tyrant server.
  179. 0.1.11 [2009-05-12 02:08 P.M CET]
  180. -------------------------------------------------
  181. * The logging system was leaking file descriptors, resulting in
  182. servers stopping with the EMFILES (too many open files) error. (fixed)
  183. 0.1.10 [2009-05-11 12:46 P.M CET]
  184. -------------------------------------------------
  185. * Tasks now supports both positional arguments and keyword arguments.
  186. * Requires carrot 0.3.8.
  187. * The daemon now tries to reconnect if the connection is lost.
  188. 0.1.8 [2009-05-07 12:27 P.M CET]
  189. ------------------------------------------------
  190. * Better test coverage
  191. * More documentation
  192. * celeryd doesn't emit ``Queue is empty`` message if
  193. ``settings.CELERYD_EMPTY_MSG_EMIT_EVERY`` is 0.
  194. 0.1.7 [2009-04-30 1:50 P.M CET]
  195. -----------------------------------------------
  196. * Added some unittests
  197. * Can now use the database for task metadata (like if the task has
  198. been executed or not). Set ``settings.CELERY_TASK_META``
  199. * Can now run ``python setup.py test`` to run the unittests from
  200. within the ``testproj`` project.
  201. * Can set the AMQP exchange/routing key/queue using
  202. ``settings.CELERY_AMQP_EXCHANGE``, ``settings.CELERY_AMQP_ROUTING_KEY``,
  203. and ``settings.CELERY_AMQP_CONSUMER_QUEUE``.
  204. 0.1.6 [2009-04-28 2:13 P.M CET]
  205. -----------------------------------------------
  206. * Introducing ``TaskSet``. A set of subtasks is executed and you can
  207. find out how many, or if all them, are done (excellent for progress bars and such)
  208. * Now catches all exceptions when running ``Task.__call__``, so the
  209. daemon doesn't die. This does't happen for pure functions yet, only
  210. ``Task`` classes.
  211. * ``autodiscover()`` now works with zipped eggs.
  212. * celeryd: Now adds curernt working directory to ``sys.path`` for
  213. convenience.
  214. * The ``run_every`` attribute of ``PeriodicTask`` classes can now be a
  215. ``datetime.timedelta()`` object.
  216. * celeryd: You can now set the ``DJANGO_PROJECT_DIR`` variable
  217. for ``celeryd`` and it will add that to ``sys.path`` for easy launching.
  218. * Can now check if a task has been executed or not via HTTP.
  219. You can do this by including the celery ``urls.py`` into your project,
  220. >>> url(r'^celery/$', include("celery.urls"))
  221. then visiting the following url,::
  222. http://mysite/celery/$task_id/done/
  223. this will return a JSON dictionary like e.g:
  224. >>> {"task": {"id": $task_id, "executed": true}}
  225. * ``delay_task`` now returns string id, not ``uuid.UUID`` instance.
  226. * Now has ``PeriodicTasks``, to have ``cron`` like functionality.
  227. * Project changed name from ``crunchy`` to ``celery``. The details of
  228. the name change request is in ``docs/name_change_request.txt``.
  229. 0.1.0 [2009-04-24 11:28 A.M CET]
  230. ------------------------------------------------
  231. * Initial release