Changelog 13 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383
  1. ==============
  2. Change history
  3. ==============
  4. x.x.x [xxxx-xx-xx xx:xx P.M CET]
  5. -----------------------------------------------
  6. * **IMPORTANT** The ``subtask_ids`` attribute on the ``TaskSetResult``
  7. instance has been removed. To get this information instead use:
  8. >>> subtask_ids = [subtask.task_id for subtask in ts_res.subtasks]
  9. * Taskset.run() now respects extra message options from the task class.
  10. * Task: Add attribute ``ignore_result``: Don't store the status and
  11. return value. This means you can't use the
  12. :class:`celery.result.AsyncResult` to check if the task is
  13. done, or get its return value. Only use if you need the performance
  14. and is able live without these features. Any exceptions raised will
  15. store the return value/status as usual.
  16. * Task: Add attribute ``disable_error_emails`` to disable sending error
  17. emails for that task.
  18. * Should now work on Windows (although running in the background won't
  19. work, so using the ``--detach`` argument results in an exception
  20. being raised.)
  21. * Added support for statistics for profiling and monitoring.
  22. To start sending statistics start ``celeryd`` with the
  23. ``--statistics`` option. Then after a while you can dump the results
  24. by running ``python manage.py celerystats``. See
  25. :mod:`celery.monitoring` for more information.
  26. 0.3.7 [2008-06-16 11:41 P.M CET]
  27. -----------------------------------------------
  28. * **IMPORTANT** Now uses AMQP's ``basic.consume`` instead of
  29. ``basic.get``. This means we're no longer polling the broker for
  30. new messages.
  31. * **IMPORTANT** Default concurrency limit is now set to the number of CPUs
  32. available on the system.
  33. * **IMPORTANT** ``tasks.register``: Renamed ``task_name`` argument to
  34. ``name``, so
  35. >>> tasks.register(func, task_name="mytask")
  36. has to be replaced with:
  37. >>> tasks.register(func, name="mytask")
  38. * The daemon now correctly runs if the pidlock is stale.
  39. * Now compatible with carrot 0.4.5
  40. * Default AMQP connnection timeout is now 4 seconds.
  41. * ``AsyncResult.read()`` was always returning ``True``.
  42. * Only use README as long_description if the file exists so easy_install
  43. doesn't break.
  44. * ``celery.view``: JSON responses now properly set its mime-type.
  45. * ``apply_async`` now has a ``connection`` keyword argument so you
  46. can re-use the same AMQP connection if you want to execute
  47. more than one task.
  48. * Handle failures in task_status view such that it won't throw 500s.
  49. * Fixed typo ``AMQP_SERVER`` in documentation to ``AMQP_HOST``.
  50. * Worker exception e-mails sent to admins now works properly.
  51. * No longer depends on ``django``, so installing ``celery`` won't affect
  52. the preferred Django version installed.
  53. * Now works with PostgreSQL (psycopg2) again by registering the
  54. ``PickledObject`` field.
  55. * ``celeryd``: Added ``--detach`` option as an alias to ``--daemon``, and
  56. it's the term used in the documentation from now on.
  57. * Make sure the pool and periodic task worker thread is terminated
  58. properly at exit. (So ``Ctrl-C`` works again).
  59. * Now depends on ``python-daemon``.
  60. * Removed dependency to ``simplejson``
  61. * Cache Backend: Re-establishes connection for every task process
  62. if the Django cache backend is memcached/libmemcached.
  63. * Tyrant Backend: Now re-establishes the connection for every task
  64. executed.
  65. 0.3.3 [2009-06-08 01:07 P.M CET]
  66. -----------------------------------------------
  67. * The ``PeriodicWorkController`` now sleeps for 1 second between checking
  68. for periodic tasks to execute.
  69. 0.3.2 [2009-06-08 01:07 P.M CET]
  70. -----------------------------------------------
  71. * celeryd: Added option ``--discard``: Discard (delete!) all waiting
  72. messages in the queue.
  73. * celeryd: The ``--wakeup-after`` option was not handled as a float.
  74. 0.3.1 [2009-06-08 01:07 P.M CET]
  75. -----------------------------------------------
  76. * The `PeriodicTask`` worker is now running in its own thread instead
  77. of blocking the ``TaskController`` loop.
  78. * Default ``QUEUE_WAKEUP_AFTER`` has been lowered to ``0.1`` (was ``0.3``)
  79. 0.3.0 [2009-06-08 12:41 P.M CET]
  80. -----------------------------------------------
  81. **NOTE** This is a development version, for the stable release, please
  82. see versions 0.2.x.
  83. **VERY IMPORTANT:** Pickle is now the encoder used for serializing task
  84. arguments, so be sure to flush your task queue before you upgrade.
  85. * **IMPORTANT** TaskSet.run() now returns a celery.result.TaskSetResult
  86. instance, which lets you inspect the status and return values of a
  87. taskset as it was a single entity.
  88. * **IMPORTANT** Celery now depends on carrot >= 0.4.1.
  89. * The celery daemon now sends task errors to the registered admin e-mails.
  90. To turn off this feature, set ``SEND_CELERY_TASK_ERROR_EMAILS`` to
  91. ``False`` in your ``settings.py``. Thanks to Grégoire Cachet.
  92. * You can now run the celery daemon by using ``manage.py``::
  93. $ python manage.py celeryd
  94. Thanks to Grégoire Cachet.
  95. * Added support for message priorities, topic exchanges, custom routing
  96. keys for tasks. This means we have introduced
  97. ``celery.task.apply_async``, a new way of executing tasks.
  98. You can use ``celery.task.delay`` and ``celery.Task.delay`` like usual, but
  99. if you want greater control over the message sent, you want
  100. ``celery.task.apply_async`` and ``celery.Task.apply_async``.
  101. This also means the AMQP configuration has changed. Some settings has
  102. been renamed, while others are new::
  103. CELERY_AMQP_EXCHANGE
  104. CELERY_AMQP_PUBLISHER_ROUTING_KEY
  105. CELERY_AMQP_CONSUMER_ROUTING_KEY
  106. CELERY_AMQP_CONSUMER_QUEUE
  107. CELERY_AMQP_EXCHANGE_TYPE
  108. See the entry `Can I send some tasks to only some servers?`_ in the
  109. `FAQ`_ for more information.
  110. .. _`Can I send some tasks to only some servers?`:
  111. http://bit.ly/celery_AMQP_routing
  112. .. _`FAQ`: http://ask.github.com/celery/faq.html
  113. * Task errors are now logged using loglevel ``ERROR`` instead of ``INFO``,
  114. and backtraces are dumped. Thanks to Grégoire Cachet.
  115. * Make every new worker process re-establish it's Django DB connection,
  116. this solving the "MySQL connection died?" exceptions.
  117. Thanks to Vitaly Babiy and Jirka Vejrazka.
  118. * **IMOPORTANT** Now using pickle to encode task arguments. This means you
  119. now can pass complex python objects to tasks as arguments.
  120. * Removed dependency on ``yadayada``.
  121. * Added a FAQ, see ``docs/faq.rst``.
  122. * Now converts any unicode keys in task ``kwargs`` to regular strings.
  123. Thanks Vitaly Babiy.
  124. * Renamed the ``TaskDaemon`` to ``WorkController``.
  125. * ``celery.datastructures.TaskProcessQueue`` is now renamed to
  126. ``celery.pool.TaskPool``.
  127. * The pool algorithm has been refactored for greater performance and
  128. stability.
  129. 0.2.0 [2009-05-20 05:14 P.M CET]
  130. ------------------------------------------------
  131. * Final release of 0.2.0
  132. * Compatible with carrot version 0.4.0.
  133. * Fixes some syntax errors related to fetching results
  134. from the database backend.
  135. 0.2.0-pre3 [2009-05-20 05:14 P.M CET]
  136. ----------------------------------------------------
  137. * *Internal release*. Improved handling of unpickled exceptions,
  138. get_result() now tries to recreate something looking like the
  139. original exception.
  140. 0.2.0-pre2 [2009-05-20 01:56 P.M CET]
  141. ----------------------------------------------------
  142. * Now handles unpickleable exceptions (like the dynimically generated
  143. subclasses of ``django.core.exception.MultipleObjectsReturned``).
  144. 0.2.0-pre1 [2009-05-20 12:33 P.M CET]
  145. ----------------------------------------------------
  146. * It's getting quite stable, with a lot of new features, so bump
  147. version to 0.2. This is a pre-release.
  148. * ``celery.task.mark_as_read()`` and ``celery.task.mark_as_failure()`` has
  149. been removed. Use ``celery.backends.default_backend.mark_as_read()``,
  150. and ``celery.backends.default_backend.mark_as_failure()`` instead.
  151. 0.1.15 [2009-05-19 04:13 P.M CET]
  152. ------------------------------------------------
  153. * The celery daemon was leaking AMQP connections, this should be fixed,
  154. if you have any problems with too many files open (like ``emfile``
  155. errors in ``rabbit.log``, please contact us!
  156. 0.1.14 [2009-05-19 01:08 P.M CET]
  157. ------------------------------------------------
  158. * Fixed a syntax error in the ``TaskSet`` class. (No such variable
  159. ``TimeOutError``).
  160. 0.1.13 [2009-05-19 12:36 P.M CET]
  161. ------------------------------------------------
  162. * Forgot to add ``yadayada`` to install requirements.
  163. * Now deletes all expired task results, not just those marked as done.
  164. * Able to load the Tokyo Tyrant backend class without django
  165. configuration, can specify tyrant settings directly in the class
  166. constructor.
  167. * Improved API documentation
  168. * Now using the Sphinx documentation system, you can build
  169. the html documentation by doing ::
  170. $ cd docs
  171. $ make html
  172. and the result will be in ``docs/.build/html``.
  173. 0.1.12 [2009-05-18 04:38 P.M CET]
  174. ------------------------------------------------
  175. * ``delay_task()`` etc. now returns ``celery.task.AsyncResult`` object,
  176. which lets you check the result and any failure that might have
  177. happened. It kind of works like the ``multiprocessing.AsyncResult``
  178. class returned by ``multiprocessing.Pool.map_async``.
  179. * Added dmap() and dmap_async(). This works like the
  180. ``multiprocessing.Pool`` versions except they are tasks
  181. distributed to the celery server. Example:
  182. >>> from celery.task import dmap
  183. >>> import operator
  184. >>> dmap(operator.add, [[2, 2], [4, 4], [8, 8]])
  185. >>> [4, 8, 16]
  186. >>> from celery.task import dmap_async
  187. >>> import operator
  188. >>> result = dmap_async(operator.add, [[2, 2], [4, 4], [8, 8]])
  189. >>> result.ready()
  190. False
  191. >>> time.sleep(1)
  192. >>> result.ready()
  193. True
  194. >>> result.result
  195. [4, 8, 16]
  196. * Refactored the task metadata cache and database backends, and added a new backend for Tokyo Tyrant. You can set the backend in your django settings file. e.g
  197. CELERY_BACKEND = "database"; # Uses the database
  198. CELERY_BACKEND = "cache"; # Uses the django cache framework
  199. CELERY_BACKEND = "tyrant"; # Uses Tokyo Tyrant
  200. TT_HOST = "localhost"; # Hostname for the Tokyo Tyrant server.
  201. TT_PORT = 6657; # Port of the Tokyo Tyrant server.
  202. 0.1.11 [2009-05-12 02:08 P.M CET]
  203. -------------------------------------------------
  204. * The logging system was leaking file descriptors, resulting in
  205. servers stopping with the EMFILES (too many open files) error. (fixed)
  206. 0.1.10 [2009-05-11 12:46 P.M CET]
  207. -------------------------------------------------
  208. * Tasks now supports both positional arguments and keyword arguments.
  209. * Requires carrot 0.3.8.
  210. * The daemon now tries to reconnect if the connection is lost.
  211. 0.1.8 [2009-05-07 12:27 P.M CET]
  212. ------------------------------------------------
  213. * Better test coverage
  214. * More documentation
  215. * celeryd doesn't emit ``Queue is empty`` message if
  216. ``settings.CELERYD_EMPTY_MSG_EMIT_EVERY`` is 0.
  217. 0.1.7 [2009-04-30 1:50 P.M CET]
  218. -----------------------------------------------
  219. * Added some unittests
  220. * Can now use the database for task metadata (like if the task has
  221. been executed or not). Set ``settings.CELERY_TASK_META``
  222. * Can now run ``python setup.py test`` to run the unittests from
  223. within the ``testproj`` project.
  224. * Can set the AMQP exchange/routing key/queue using
  225. ``settings.CELERY_AMQP_EXCHANGE``, ``settings.CELERY_AMQP_ROUTING_KEY``,
  226. and ``settings.CELERY_AMQP_CONSUMER_QUEUE``.
  227. 0.1.6 [2009-04-28 2:13 P.M CET]
  228. -----------------------------------------------
  229. * Introducing ``TaskSet``. A set of subtasks is executed and you can
  230. find out how many, or if all them, are done (excellent for progress bars and such)
  231. * Now catches all exceptions when running ``Task.__call__``, so the
  232. daemon doesn't die. This does't happen for pure functions yet, only
  233. ``Task`` classes.
  234. * ``autodiscover()`` now works with zipped eggs.
  235. * celeryd: Now adds curernt working directory to ``sys.path`` for
  236. convenience.
  237. * The ``run_every`` attribute of ``PeriodicTask`` classes can now be a
  238. ``datetime.timedelta()`` object.
  239. * celeryd: You can now set the ``DJANGO_PROJECT_DIR`` variable
  240. for ``celeryd`` and it will add that to ``sys.path`` for easy launching.
  241. * Can now check if a task has been executed or not via HTTP.
  242. You can do this by including the celery ``urls.py`` into your project,
  243. >>> url(r'^celery/$', include("celery.urls"))
  244. then visiting the following url,::
  245. http://mysite/celery/$task_id/done/
  246. this will return a JSON dictionary like e.g:
  247. >>> {"task": {"id": $task_id, "executed": true}}
  248. * ``delay_task`` now returns string id, not ``uuid.UUID`` instance.
  249. * Now has ``PeriodicTasks``, to have ``cron`` like functionality.
  250. * Project changed name from ``crunchy`` to ``celery``. The details of
  251. the name change request is in ``docs/name_change_request.txt``.
  252. 0.1.0 [2009-04-24 11:28 A.M CET]
  253. ------------------------------------------------
  254. * Initial release