Changelog 14 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440
  1. ==============
  2. Change history
  3. ==============
  4. 0.4.0 [2009-07-01 07:29 P.M CET]
  5. -----------------------------------------------
  6. * Adds eager execution. celery.execute.apply|Task.apply executes the
  7. function blocking until the task is done, for API compatiblity it
  8. returns an ``celery.result.EagerResult`` instance. You can configure
  9. celery to always run tasks locally by setting the
  10. ``CELERY_ALWAYS_EAGER`` setting to ``True``.
  11. * Now depends on ``anyjson``.
  12. * 99% coverage using python coverage 3.0.
  13. 0.3.20 [2009-06-25 08:42 P.M CET]
  14. -----------------------------------------------
  15. * New arguments to ``apply_async`` (the advanced version of
  16. ``delay_task``), ``countdown`` and ``eta``;
  17. >>> # Run 10 seconds into the future.
  18. >>> res = apply_async(MyTask, countdown=10);
  19. >>> # Run 1 day from now
  20. >>> res = apply_async(MyTask, eta=datetime.now() +
  21. ... timedelta(days=1)
  22. * Now unlinks the pidfile if it's stale.
  23. * Lots of more tests.
  24. * Now compatible with carrot >= 0.5.0.
  25. * **IMPORTANT** The ``subtask_ids`` attribute on the ``TaskSetResult``
  26. instance has been removed. To get this information instead use:
  27. >>> subtask_ids = [subtask.task_id for subtask in ts_res.subtasks]
  28. * Taskset.run() now respects extra message options from the task class.
  29. * Task: Add attribute ``ignore_result``: Don't store the status and
  30. return value. This means you can't use the
  31. ``celery.result.AsyncResult`` to check if the task is
  32. done, or get its return value. Only use if you need the performance
  33. and is able live without these features. Any exceptions raised will
  34. store the return value/status as usual.
  35. * Task: Add attribute ``disable_error_emails`` to disable sending error
  36. emails for that task.
  37. * Should now work on Windows (although running in the background won't
  38. work, so using the ``--detach`` argument results in an exception
  39. being raised.)
  40. * Added support for statistics for profiling and monitoring.
  41. To start sending statistics start ``celeryd`` with the
  42. ``--statistics`` option. Then after a while you can dump the results
  43. by running ``python manage.py celerystats``. See
  44. ``celery.monitoring`` for more information.
  45. * The celery daemon can now be supervised (i.e it is automatically
  46. restarted if it crashes). To use this start celeryd with the
  47. ``--supervised`` option (or alternatively ``-S``).
  48. * views.apply: View applying a task. Example::
  49. http://e.com/celery/apply/task_name/arg1/arg2//?kwarg1=a&kwarg2=b
  50. **NOTE** Use with caution, preferably not make this publicly
  51. accessible without ensuring your code is safe!
  52. * Refactored celery.task. It's now split into three modules:
  53. * celery.task
  54. Contains apply_async, delay_task, discard_all, and task
  55. shortcuts, plus imports objects from celery.task.base and
  56. celery.task.builtins
  57. * celery.task.base
  58. Contains task base classes: Task, PeriodicTask, TaskSet
  59. * celery.task.builtins
  60. Built-in tasks: PingTask, AsynchronousMapTask,
  61. ExecuteRemoteTask, ++.
  62. 0.3.7 [2008-06-16 11:41 P.M CET]
  63. -----------------------------------------------
  64. * **IMPORTANT** Now uses AMQP's ``basic.consume`` instead of
  65. ``basic.get``. This means we're no longer polling the broker for
  66. new messages.
  67. * **IMPORTANT** Default concurrency limit is now set to the number of CPUs
  68. available on the system.
  69. * **IMPORTANT** ``tasks.register``: Renamed ``task_name`` argument to
  70. ``name``, so
  71. >>> tasks.register(func, task_name="mytask")
  72. has to be replaced with:
  73. >>> tasks.register(func, name="mytask")
  74. * The daemon now correctly runs if the pidlock is stale.
  75. * Now compatible with carrot 0.4.5
  76. * Default AMQP connnection timeout is now 4 seconds.
  77. * ``AsyncResult.read()`` was always returning ``True``.
  78. * Only use README as long_description if the file exists so easy_install
  79. doesn't break.
  80. * ``celery.view``: JSON responses now properly set its mime-type.
  81. * ``apply_async`` now has a ``connection`` keyword argument so you
  82. can re-use the same AMQP connection if you want to execute
  83. more than one task.
  84. * Handle failures in task_status view such that it won't throw 500s.
  85. * Fixed typo ``AMQP_SERVER`` in documentation to ``AMQP_HOST``.
  86. * Worker exception e-mails sent to admins now works properly.
  87. * No longer depends on ``django``, so installing ``celery`` won't affect
  88. the preferred Django version installed.
  89. * Now works with PostgreSQL (psycopg2) again by registering the
  90. ``PickledObject`` field.
  91. * ``celeryd``: Added ``--detach`` option as an alias to ``--daemon``, and
  92. it's the term used in the documentation from now on.
  93. * Make sure the pool and periodic task worker thread is terminated
  94. properly at exit. (So ``Ctrl-C`` works again).
  95. * Now depends on ``python-daemon``.
  96. * Removed dependency to ``simplejson``
  97. * Cache Backend: Re-establishes connection for every task process
  98. if the Django cache backend is memcached/libmemcached.
  99. * Tyrant Backend: Now re-establishes the connection for every task
  100. executed.
  101. 0.3.3 [2009-06-08 01:07 P.M CET]
  102. -----------------------------------------------
  103. * The ``PeriodicWorkController`` now sleeps for 1 second between checking
  104. for periodic tasks to execute.
  105. 0.3.2 [2009-06-08 01:07 P.M CET]
  106. -----------------------------------------------
  107. * celeryd: Added option ``--discard``: Discard (delete!) all waiting
  108. messages in the queue.
  109. * celeryd: The ``--wakeup-after`` option was not handled as a float.
  110. 0.3.1 [2009-06-08 01:07 P.M CET]
  111. -----------------------------------------------
  112. * The `PeriodicTask`` worker is now running in its own thread instead
  113. of blocking the ``TaskController`` loop.
  114. * Default ``QUEUE_WAKEUP_AFTER`` has been lowered to ``0.1`` (was ``0.3``)
  115. 0.3.0 [2009-06-08 12:41 P.M CET]
  116. -----------------------------------------------
  117. **NOTE** This is a development version, for the stable release, please
  118. see versions 0.2.x.
  119. **VERY IMPORTANT:** Pickle is now the encoder used for serializing task
  120. arguments, so be sure to flush your task queue before you upgrade.
  121. * **IMPORTANT** TaskSet.run() now returns a celery.result.TaskSetResult
  122. instance, which lets you inspect the status and return values of a
  123. taskset as it was a single entity.
  124. * **IMPORTANT** Celery now depends on carrot >= 0.4.1.
  125. * The celery daemon now sends task errors to the registered admin e-mails.
  126. To turn off this feature, set ``SEND_CELERY_TASK_ERROR_EMAILS`` to
  127. ``False`` in your ``settings.py``. Thanks to Grégoire Cachet.
  128. * You can now run the celery daemon by using ``manage.py``::
  129. $ python manage.py celeryd
  130. Thanks to Grégoire Cachet.
  131. * Added support for message priorities, topic exchanges, custom routing
  132. keys for tasks. This means we have introduced
  133. ``celery.task.apply_async``, a new way of executing tasks.
  134. You can use ``celery.task.delay`` and ``celery.Task.delay`` like usual, but
  135. if you want greater control over the message sent, you want
  136. ``celery.task.apply_async`` and ``celery.Task.apply_async``.
  137. This also means the AMQP configuration has changed. Some settings has
  138. been renamed, while others are new::
  139. CELERY_AMQP_EXCHANGE
  140. CELERY_AMQP_PUBLISHER_ROUTING_KEY
  141. CELERY_AMQP_CONSUMER_ROUTING_KEY
  142. CELERY_AMQP_CONSUMER_QUEUE
  143. CELERY_AMQP_EXCHANGE_TYPE
  144. See the entry `Can I send some tasks to only some servers?`_ in the
  145. `FAQ`_ for more information.
  146. .. _`Can I send some tasks to only some servers?`:
  147. http://bit.ly/celery_AMQP_routing
  148. .. _`FAQ`: http://ask.github.com/celery/faq.html
  149. * Task errors are now logged using loglevel ``ERROR`` instead of ``INFO``,
  150. and backtraces are dumped. Thanks to Grégoire Cachet.
  151. * Make every new worker process re-establish it's Django DB connection,
  152. this solving the "MySQL connection died?" exceptions.
  153. Thanks to Vitaly Babiy and Jirka Vejrazka.
  154. * **IMOPORTANT** Now using pickle to encode task arguments. This means you
  155. now can pass complex python objects to tasks as arguments.
  156. * Removed dependency on ``yadayada``.
  157. * Added a FAQ, see ``docs/faq.rst``.
  158. * Now converts any unicode keys in task ``kwargs`` to regular strings.
  159. Thanks Vitaly Babiy.
  160. * Renamed the ``TaskDaemon`` to ``WorkController``.
  161. * ``celery.datastructures.TaskProcessQueue`` is now renamed to
  162. ``celery.pool.TaskPool``.
  163. * The pool algorithm has been refactored for greater performance and
  164. stability.
  165. 0.2.0 [2009-05-20 05:14 P.M CET]
  166. ------------------------------------------------
  167. * Final release of 0.2.0
  168. * Compatible with carrot version 0.4.0.
  169. * Fixes some syntax errors related to fetching results
  170. from the database backend.
  171. 0.2.0-pre3 [2009-05-20 05:14 P.M CET]
  172. ----------------------------------------------------
  173. * *Internal release*. Improved handling of unpickled exceptions,
  174. get_result() now tries to recreate something looking like the
  175. original exception.
  176. 0.2.0-pre2 [2009-05-20 01:56 P.M CET]
  177. ----------------------------------------------------
  178. * Now handles unpickleable exceptions (like the dynimically generated
  179. subclasses of ``django.core.exception.MultipleObjectsReturned``).
  180. 0.2.0-pre1 [2009-05-20 12:33 P.M CET]
  181. ----------------------------------------------------
  182. * It's getting quite stable, with a lot of new features, so bump
  183. version to 0.2. This is a pre-release.
  184. * ``celery.task.mark_as_read()`` and ``celery.task.mark_as_failure()`` has
  185. been removed. Use ``celery.backends.default_backend.mark_as_read()``,
  186. and ``celery.backends.default_backend.mark_as_failure()`` instead.
  187. 0.1.15 [2009-05-19 04:13 P.M CET]
  188. ------------------------------------------------
  189. * The celery daemon was leaking AMQP connections, this should be fixed,
  190. if you have any problems with too many files open (like ``emfile``
  191. errors in ``rabbit.log``, please contact us!
  192. 0.1.14 [2009-05-19 01:08 P.M CET]
  193. ------------------------------------------------
  194. * Fixed a syntax error in the ``TaskSet`` class. (No such variable
  195. ``TimeOutError``).
  196. 0.1.13 [2009-05-19 12:36 P.M CET]
  197. ------------------------------------------------
  198. * Forgot to add ``yadayada`` to install requirements.
  199. * Now deletes all expired task results, not just those marked as done.
  200. * Able to load the Tokyo Tyrant backend class without django
  201. configuration, can specify tyrant settings directly in the class
  202. constructor.
  203. * Improved API documentation
  204. * Now using the Sphinx documentation system, you can build
  205. the html documentation by doing ::
  206. $ cd docs
  207. $ make html
  208. and the result will be in ``docs/.build/html``.
  209. 0.1.12 [2009-05-18 04:38 P.M CET]
  210. ------------------------------------------------
  211. * ``delay_task()`` etc. now returns ``celery.task.AsyncResult`` object,
  212. which lets you check the result and any failure that might have
  213. happened. It kind of works like the ``multiprocessing.AsyncResult``
  214. class returned by ``multiprocessing.Pool.map_async``.
  215. * Added dmap() and dmap_async(). This works like the
  216. ``multiprocessing.Pool`` versions except they are tasks
  217. distributed to the celery server. Example:
  218. >>> from celery.task import dmap
  219. >>> import operator
  220. >>> dmap(operator.add, [[2, 2], [4, 4], [8, 8]])
  221. >>> [4, 8, 16]
  222. >>> from celery.task import dmap_async
  223. >>> import operator
  224. >>> result = dmap_async(operator.add, [[2, 2], [4, 4], [8, 8]])
  225. >>> result.ready()
  226. False
  227. >>> time.sleep(1)
  228. >>> result.ready()
  229. True
  230. >>> result.result
  231. [4, 8, 16]
  232. * Refactored the task metadata cache and database backends, and added a new backend for Tokyo Tyrant. You can set the backend in your django settings file. e.g
  233. CELERY_BACKEND = "database"; # Uses the database
  234. CELERY_BACKEND = "cache"; # Uses the django cache framework
  235. CELERY_BACKEND = "tyrant"; # Uses Tokyo Tyrant
  236. TT_HOST = "localhost"; # Hostname for the Tokyo Tyrant server.
  237. TT_PORT = 6657; # Port of the Tokyo Tyrant server.
  238. 0.1.11 [2009-05-12 02:08 P.M CET]
  239. -------------------------------------------------
  240. * The logging system was leaking file descriptors, resulting in
  241. servers stopping with the EMFILES (too many open files) error. (fixed)
  242. 0.1.10 [2009-05-11 12:46 P.M CET]
  243. -------------------------------------------------
  244. * Tasks now supports both positional arguments and keyword arguments.
  245. * Requires carrot 0.3.8.
  246. * The daemon now tries to reconnect if the connection is lost.
  247. 0.1.8 [2009-05-07 12:27 P.M CET]
  248. ------------------------------------------------
  249. * Better test coverage
  250. * More documentation
  251. * celeryd doesn't emit ``Queue is empty`` message if
  252. ``settings.CELERYD_EMPTY_MSG_EMIT_EVERY`` is 0.
  253. 0.1.7 [2009-04-30 1:50 P.M CET]
  254. -----------------------------------------------
  255. * Added some unittests
  256. * Can now use the database for task metadata (like if the task has
  257. been executed or not). Set ``settings.CELERY_TASK_META``
  258. * Can now run ``python setup.py test`` to run the unittests from
  259. within the ``testproj`` project.
  260. * Can set the AMQP exchange/routing key/queue using
  261. ``settings.CELERY_AMQP_EXCHANGE``, ``settings.CELERY_AMQP_ROUTING_KEY``,
  262. and ``settings.CELERY_AMQP_CONSUMER_QUEUE``.
  263. 0.1.6 [2009-04-28 2:13 P.M CET]
  264. -----------------------------------------------
  265. * Introducing ``TaskSet``. A set of subtasks is executed and you can
  266. find out how many, or if all them, are done (excellent for progress bars and such)
  267. * Now catches all exceptions when running ``Task.__call__``, so the
  268. daemon doesn't die. This does't happen for pure functions yet, only
  269. ``Task`` classes.
  270. * ``autodiscover()`` now works with zipped eggs.
  271. * celeryd: Now adds curernt working directory to ``sys.path`` for
  272. convenience.
  273. * The ``run_every`` attribute of ``PeriodicTask`` classes can now be a
  274. ``datetime.timedelta()`` object.
  275. * celeryd: You can now set the ``DJANGO_PROJECT_DIR`` variable
  276. for ``celeryd`` and it will add that to ``sys.path`` for easy launching.
  277. * Can now check if a task has been executed or not via HTTP.
  278. You can do this by including the celery ``urls.py`` into your project,
  279. >>> url(r'^celery/$', include("celery.urls"))
  280. then visiting the following url,::
  281. http://mysite/celery/$task_id/done/
  282. this will return a JSON dictionary like e.g:
  283. >>> {"task": {"id": $task_id, "executed": true}}
  284. * ``delay_task`` now returns string id, not ``uuid.UUID`` instance.
  285. * Now has ``PeriodicTasks``, to have ``cron`` like functionality.
  286. * Project changed name from ``crunchy`` to ``celery``. The details of
  287. the name change request is in ``docs/name_change_request.txt``.
  288. 0.1.0 [2009-04-24 11:28 A.M CET]
  289. ------------------------------------------------
  290. * Initial release