changelog.html 31 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556
  1. <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
  2. "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
  3. <html xmlns="http://www.w3.org/1999/xhtml">
  4. <head>
  5. <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
  6. <title>Change history &mdash; Celery v0.3.7 (unstable) documentation</title>
  7. <link rel="stylesheet" href="static/agogo.css" type="text/css" />
  8. <link rel="stylesheet" href="static/pygments.css" type="text/css" />
  9. <script type="text/javascript">
  10. var DOCUMENTATION_OPTIONS = {
  11. URL_ROOT: '',
  12. VERSION: '0.3.7 (unstable)',
  13. COLLAPSE_MODINDEX: false,
  14. FILE_SUFFIX: '.html',
  15. HAS_SOURCE: true
  16. };
  17. </script>
  18. <script type="text/javascript" src="static/jquery.js"></script>
  19. <script type="text/javascript" src="static/doctools.js"></script>
  20. <link rel="top" title="Celery v0.3.7 (unstable) documentation" href="index.html" />
  21. <link rel="prev" title="Celery Worker Daemon - celery.bin.celeryd" href="reference/celery.bin.celeryd.html" />
  22. </head>
  23. <body>
  24. <div class="header-wrapper">
  25. <div class="header">
  26. <h1><a href="index.html">Celery v0.3.7 (unstable) documentation</a></h1>
  27. <div class="rel">
  28. <a href="genindex.html" title="General Index"
  29. accesskey="I">index</a> |
  30. <a href="modindex.html" title="Global Module Index"
  31. accesskey="M">modules</a> |
  32. <a href="reference/celery.bin.celeryd.html" title="Celery Worker Daemon - celery.bin.celeryd"
  33. accesskey="P">previous</a>
  34. </div>
  35. </div>
  36. </div>
  37. <div class="content-wrapper">
  38. <div class="content">
  39. <div class="document">
  40. <div class="documentwrapper">
  41. <div class="bodywrapper">
  42. <div class="body">
  43. <div class="section" id="change-history">
  44. <h1>Change history<a class="headerlink" href="#change-history" title="Permalink to this headline">¶</a></h1>
  45. <div class="section" id="p-m-cet">
  46. <h2>0.3.7 [2008-06-16 11:41 P.M CET]<a class="headerlink" href="#p-m-cet" title="Permalink to this headline">¶</a></h2>
  47. <ul>
  48. <li><dl class="first docutils">
  49. <dt><strong>IMPORTANT</strong> Now uses AMQP&#8217;s <tt class="docutils literal"><span class="pre">basic.consume</span></tt> instead of</dt>
  50. <dd><p class="first last"><tt class="docutils literal"><span class="pre">basic.get</span></tt>. This means we&#8217;re no longer polling the broker for
  51. new messages.</p>
  52. </dd>
  53. </dl>
  54. </li>
  55. <li><dl class="first docutils">
  56. <dt><strong>IMPORTANT</strong> Default concurrency is now set to the number of CPU</dt>
  57. <dd><p class="first last">available on the system.</p>
  58. </dd>
  59. </dl>
  60. </li>
  61. <li><dl class="first docutils">
  62. <dt><strong>IMPORTANT</strong> <tt class="docutils literal"><span class="pre">tasks.register</span></tt>: Renamed <tt class="docutils literal"><span class="pre">task_name</span></tt> argument to</dt>
  63. <dd><p class="first"><tt class="docutils literal"><span class="pre">name</span></tt>, so</p>
  64. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="n">tasks</span><span class="o">.</span><span class="n">register</span><span class="p">(</span><span class="n">func</span><span class="p">,</span> <span class="n">task_name</span><span class="o">=</span><span class="s">&quot;mytask&quot;</span><span class="p">)</span>
  65. </pre></div>
  66. </div>
  67. <p>has to be replaced with:</p>
  68. <div class="last highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="n">tasks</span><span class="o">.</span><span class="n">register</span><span class="p">(</span><span class="n">func</span><span class="p">,</span> <span class="n">name</span><span class="o">=</span><span class="s">&quot;mytask&quot;</span><span class="p">)</span>
  69. </pre></div>
  70. </div>
  71. </dd>
  72. </dl>
  73. </li>
  74. <li><p class="first">The daemon now correctly runs if the pidlock is stale.</p>
  75. </li>
  76. <li><p class="first">Now compatible with carrot 0.5.0 (TBA)</p>
  77. </li>
  78. <li><p class="first">Default AMQP connnection timeout is now 4 seconds.</p>
  79. </li>
  80. <li><p class="first"><tt class="docutils literal"><span class="pre">AsyncResult.read()</span></tt> was always returning <tt class="xref docutils literal"><span class="pre">True</span></tt>.</p>
  81. </li>
  82. <li><dl class="first docutils">
  83. <dt>Only use README as long_description if the file exists so easy_install don&#8217;t</dt>
  84. <dd><p class="first last">break. Closes #11.</p>
  85. </dd>
  86. </dl>
  87. </li>
  88. <li><p class="first"><tt class="docutils literal"><span class="pre">celery.view</span></tt>: JSON responses now properly set its mime-type.</p>
  89. </li>
  90. <li><dl class="first docutils">
  91. <dt><tt class="docutils literal"><span class="pre">apply_async</span></tt> now has a <tt class="docutils literal"><span class="pre">connection</span></tt> keyword argument so you</dt>
  92. <dd><p class="first last">can re-use the same AMQP connection if you want to execute
  93. more than one task.</p>
  94. </dd>
  95. </dl>
  96. </li>
  97. <li><p class="first">Handle failures in task_status view such that it won&#8217;t throw 500s.</p>
  98. </li>
  99. <li><p class="first">Fixed typo <tt class="docutils literal"><span class="pre">AMQP_SERVER</span></tt> in documentation to <tt class="docutils literal"><span class="pre">AMQP_HOST</span></tt>.</p>
  100. </li>
  101. <li><p class="first">Worker exception e-mails send to admins now works properly.</p>
  102. </li>
  103. <li><dl class="first docutils">
  104. <dt>No longer depends on <tt class="docutils literal"><span class="pre">django</span></tt>, so installing <tt class="docutils literal"><span class="pre">celery</span></tt> won&#8217;t affect</dt>
  105. <dd><p class="first last">the preferred django version installed.</p>
  106. </dd>
  107. </dl>
  108. </li>
  109. <li><dl class="first docutils">
  110. <dt>Now works with PostgreSQL (psycopg2) again by registering the</dt>
  111. <dd><p class="first last"><tt class="docutils literal"><span class="pre">PickledObject</span></tt> field.</p>
  112. </dd>
  113. </dl>
  114. </li>
  115. <li><dl class="first docutils">
  116. <dt><tt class="docutils literal"><span class="pre">celeryd</span></tt>: Added <tt class="docutils literal"><span class="pre">--detach</span></tt> option as an alias to <tt class="docutils literal"><span class="pre">--daemon</span></tt>, and</dt>
  117. <dd><p class="first last">it&#8217;s the term used in the documentation from now on.</p>
  118. </dd>
  119. </dl>
  120. </li>
  121. <li><dl class="first docutils">
  122. <dt>Make sure the pool and periodic task worker thread is terminated</dt>
  123. <dd><p class="first last">properly at exit. (So <tt class="docutils literal"><span class="pre">Ctrl-C</span></tt> works again).</p>
  124. </dd>
  125. </dl>
  126. </li>
  127. <li><p class="first">Now depends on <tt class="docutils literal"><span class="pre">python-daemon</span></tt>.</p>
  128. </li>
  129. <li><p class="first">Removed dependency to <tt class="docutils literal"><span class="pre">simplejson</span></tt></p>
  130. </li>
  131. <li><dl class="first docutils">
  132. <dt>Cache Backend: Re-establishes connection for every task process</dt>
  133. <dd><p class="first last">if the Django cache backend is memcached/libmemcached.</p>
  134. </dd>
  135. </dl>
  136. </li>
  137. <li><dl class="first docutils">
  138. <dt>Tyrant Backend: Now re-establishes the connection for every task</dt>
  139. <dd><p class="first last">executed.</p>
  140. </dd>
  141. </dl>
  142. </li>
  143. </ul>
  144. </div>
  145. <div class="section" id="id1">
  146. <h2>0.3.3 [2009-06-08 01:07 P.M CET]<a class="headerlink" href="#id1" title="Permalink to this headline">¶</a></h2>
  147. <ul>
  148. <li><dl class="first docutils">
  149. <dt>The <tt class="docutils literal"><span class="pre">PeriodicWorkController</span></tt> now sleeps for 1 second between checking</dt>
  150. <dd><p class="first last">for periodic tasks to execute.</p>
  151. </dd>
  152. </dl>
  153. </li>
  154. </ul>
  155. </div>
  156. <div class="section" id="id2">
  157. <h2>0.3.2 [2009-06-08 01:07 P.M CET]<a class="headerlink" href="#id2" title="Permalink to this headline">¶</a></h2>
  158. <ul>
  159. <li><dl class="first docutils">
  160. <dt>celeryd: Added option <tt class="docutils literal"><span class="pre">--discard</span></tt>: Discard (delete!) all waiting</dt>
  161. <dd><p class="first last">messages in the queue.</p>
  162. </dd>
  163. </dl>
  164. </li>
  165. <li><p class="first">celeryd: The <tt class="docutils literal"><span class="pre">--wakeup-after</span></tt> option was not handled as a float.</p>
  166. </li>
  167. </ul>
  168. </div>
  169. <div class="section" id="id3">
  170. <h2>0.3.1 [2009-06-08 01:07 P.M CET]<a class="headerlink" href="#id3" title="Permalink to this headline">¶</a></h2>
  171. <ul>
  172. <li><dl class="first docutils">
  173. <dt>The <cite>PeriodicTask`</cite> worker is now running in its own thread instead</dt>
  174. <dd><p class="first last">of blocking the <tt class="docutils literal"><span class="pre">TaskController</span></tt> loop.</p>
  175. </dd>
  176. </dl>
  177. </li>
  178. <li><p class="first">Default <tt class="docutils literal"><span class="pre">QUEUE_WAKEUP_AFTER</span></tt> has been lowered to <tt class="docutils literal"><span class="pre">0.1</span></tt> (was <tt class="docutils literal"><span class="pre">0.3</span></tt>)</p>
  179. </li>
  180. </ul>
  181. </div>
  182. <div class="section" id="id4">
  183. <h2>0.3.0 [2009-06-08 12:41 P.M CET]<a class="headerlink" href="#id4" title="Permalink to this headline">¶</a></h2>
  184. <p><strong>NOTE</strong> This is a development version, for the stable release, please
  185. see versions 0.2.x.</p>
  186. <p><strong>VERY IMPORTANT:</strong> Pickle is now the encoder used for serializing task
  187. arguments, so be sure to flush your task queue before you upgrade.</p>
  188. <ul>
  189. <li><dl class="first docutils">
  190. <dt><strong>IMPORTANT</strong> TaskSet.run() now returns a celery.result.TaskSetResult</dt>
  191. <dd><p class="first last">instance, which lets you inspect the status and return values of a
  192. taskset as it was a single entity.</p>
  193. </dd>
  194. </dl>
  195. </li>
  196. <li><p class="first"><strong>IMPORTANT</strong> Celery now depends on carrot &gt;= 0.4.1.</p>
  197. </li>
  198. <li><dl class="first docutils">
  199. <dt>The celery daemon now sends task errors to the registered admin e-mails.</dt>
  200. <dd><p class="first last">To turn off this feature, set <tt class="docutils literal"><span class="pre">SEND_CELERY_TASK_ERROR_EMAILS</span></tt> to
  201. <tt class="xref docutils literal"><span class="pre">False</span></tt> in your <tt class="docutils literal"><span class="pre">settings.py</span></tt>. Thanks to Grégoire Cachet.</p>
  202. </dd>
  203. </dl>
  204. </li>
  205. <li><p class="first">You can now run the celery daemon by using <tt class="docutils literal"><span class="pre">manage.py</span></tt>:</p>
  206. <div class="highlight-python"><pre> $ python manage.py celeryd
  207. Thanks to Grégoire Cachet.</pre>
  208. </div>
  209. </li>
  210. <li><dl class="first docutils">
  211. <dt>Added support for message priorities, topic exchanges, custom routing</dt>
  212. <dd><p class="first">keys for tasks. This means we have introduced
  213. <tt class="docutils literal"><span class="pre">celery.task.apply_async</span></tt>, a new way of executing tasks.</p>
  214. <p>You can use <tt class="docutils literal"><span class="pre">celery.task.delay</span></tt> and <tt class="docutils literal"><span class="pre">celery.Task.delay</span></tt> like usual, but
  215. if you want greater control over the message sent, you want
  216. <tt class="docutils literal"><span class="pre">celery.task.apply_async</span></tt> and <tt class="docutils literal"><span class="pre">celery.Task.apply_async</span></tt>.</p>
  217. <p>This also means the AMQP configuration has changed. Some settings has
  218. been renamed, while others are new:</p>
  219. <div class="highlight-python"><div class="highlight"><pre><span class="n">CELERY_AMQP_EXCHANGE</span>
  220. <span class="n">CELERY_AMQP_PUBLISHER_ROUTING_KEY</span>
  221. <span class="n">CELERY_AMQP_CONSUMER_ROUTING_KEY</span>
  222. <span class="n">CELERY_AMQP_CONSUMER_QUEUE</span>
  223. <span class="n">CELERY_AMQP_EXCHANGE_TYPE</span>
  224. </pre></div>
  225. </div>
  226. <p class="last">See the entry <a class="reference external" href="http://bit.ly/celery_AMQP_routing">Can I send some tasks to only some servers?</a> in the
  227. <a class="reference external" href="http://ask.github.com/celery/faq.html">FAQ</a> for more information.</p>
  228. </dd>
  229. </dl>
  230. </li>
  231. </ul>
  232. <ul>
  233. <li><dl class="first docutils">
  234. <dt>Task errors are now logged using loglevel <tt class="docutils literal"><span class="pre">ERROR</span></tt> instead of <tt class="docutils literal"><span class="pre">INFO</span></tt>,</dt>
  235. <dd><p class="first last">and backtraces are dumped. Thanks to Grégoire Cachet.</p>
  236. </dd>
  237. </dl>
  238. </li>
  239. <li><dl class="first docutils">
  240. <dt>Make every new worker process re-establish it&#8217;s Django DB connection,</dt>
  241. <dd><p class="first last">this solving the &#8220;MySQL connection died?&#8221; exceptions.
  242. Thanks to Vitaly Babiy and Jirka Vejrazka.</p>
  243. </dd>
  244. </dl>
  245. </li>
  246. <li><dl class="first docutils">
  247. <dt><strong>IMOPORTANT</strong> Now using pickle to encode task arguments. This means you</dt>
  248. <dd><p class="first last">now can pass complex python objects to tasks as arguments.</p>
  249. </dd>
  250. </dl>
  251. </li>
  252. <li><p class="first">Removed dependency on <tt class="docutils literal"><span class="pre">yadayada</span></tt>.</p>
  253. </li>
  254. <li><p class="first">Added a FAQ, see <tt class="docutils literal"><span class="pre">docs/faq.rst</span></tt>.</p>
  255. </li>
  256. <li><dl class="first docutils">
  257. <dt>Now converts any unicode keys in task <tt class="docutils literal"><span class="pre">kwargs</span></tt> to regular strings.</dt>
  258. <dd><p class="first last">Thanks Vitaly Babiy.</p>
  259. </dd>
  260. </dl>
  261. </li>
  262. <li><p class="first">Renamed the <tt class="docutils literal"><span class="pre">TaskDaemon</span></tt> to <tt class="docutils literal"><span class="pre">WorkController</span></tt>.</p>
  263. </li>
  264. <li><dl class="first docutils">
  265. <dt><tt class="docutils literal"><span class="pre">celery.datastructures.TaskProcessQueue</span></tt> is now renamed to</dt>
  266. <dd><p class="first last"><tt class="docutils literal"><span class="pre">celery.pool.TaskPool</span></tt>.</p>
  267. </dd>
  268. </dl>
  269. </li>
  270. <li><dl class="first docutils">
  271. <dt>The pool algorithm has been refactored for greater performance and</dt>
  272. <dd><p class="first last">stability.</p>
  273. </dd>
  274. </dl>
  275. </li>
  276. </ul>
  277. </div>
  278. <div class="section" id="id5">
  279. <h2>0.2.0 [2009-05-20 05:14 P.M CET]<a class="headerlink" href="#id5" title="Permalink to this headline">¶</a></h2>
  280. <ul class="simple">
  281. <li>Final release of 0.2.0</li>
  282. <li>Compatible with carrot version 0.4.0.</li>
  283. <li>Fixes some syntax errors related to fetching results
  284. from the database backend.</li>
  285. </ul>
  286. </div>
  287. <div class="section" id="pre3-2009-05-20-05-14-p-m-cet">
  288. <h2>0.2.0-pre3 [2009-05-20 05:14 P.M CET]<a class="headerlink" href="#pre3-2009-05-20-05-14-p-m-cet" title="Permalink to this headline">¶</a></h2>
  289. <ul>
  290. <li><dl class="first docutils">
  291. <dt><em>Internal release</em>. Improved handling of unpickled exceptions,</dt>
  292. <dd><p class="first last">get_result() now tries to recreate something looking like the
  293. original exception.</p>
  294. </dd>
  295. </dl>
  296. </li>
  297. </ul>
  298. </div>
  299. <div class="section" id="pre2-2009-05-20-01-56-p-m-cet">
  300. <h2>0.2.0-pre2 [2009-05-20 01:56 P.M CET]<a class="headerlink" href="#pre2-2009-05-20-01-56-p-m-cet" title="Permalink to this headline">¶</a></h2>
  301. <ul class="simple">
  302. <li>Now handles unpickleable exceptions (like the dynimically generated
  303. subclasses of <tt class="docutils literal"><span class="pre">django.core.exception.MultipleObjectsReturned</span></tt>).</li>
  304. </ul>
  305. </div>
  306. <div class="section" id="pre1-2009-05-20-12-33-p-m-cet">
  307. <h2>0.2.0-pre1 [2009-05-20 12:33 P.M CET]<a class="headerlink" href="#pre1-2009-05-20-12-33-p-m-cet" title="Permalink to this headline">¶</a></h2>
  308. <ul class="simple">
  309. <li>It&#8217;s getting quite stable, with a lot of new features, so bump
  310. version to 0.2. This is a pre-release.</li>
  311. <li><tt class="docutils literal"><span class="pre">celery.task.mark_as_read()</span></tt> and <tt class="docutils literal"><span class="pre">celery.task.mark_as_failure()</span></tt> has
  312. been removed. Use <tt class="docutils literal"><span class="pre">celery.backends.default_backend.mark_as_read()</span></tt>,
  313. and <tt class="docutils literal"><span class="pre">celery.backends.default_backend.mark_as_failure()</span></tt> instead.</li>
  314. </ul>
  315. </div>
  316. <div class="section" id="id6">
  317. <h2>0.1.15 [2009-05-19 04:13 P.M CET]<a class="headerlink" href="#id6" title="Permalink to this headline">¶</a></h2>
  318. <ul class="simple">
  319. <li>The celery daemon was leaking AMQP connections, this should be fixed,
  320. if you have any problems with too many files open (like <tt class="docutils literal"><span class="pre">emfile</span></tt>
  321. errors in <tt class="docutils literal"><span class="pre">rabbit.log</span></tt>, please contact us!</li>
  322. </ul>
  323. </div>
  324. <div class="section" id="id7">
  325. <h2>0.1.14 [2009-05-19 01:08 P.M CET]<a class="headerlink" href="#id7" title="Permalink to this headline">¶</a></h2>
  326. <ul class="simple">
  327. <li>Fixed a syntax error in the <tt class="docutils literal"><span class="pre">TaskSet</span></tt> class. (No such variable
  328. <tt class="docutils literal"><span class="pre">TimeOutError</span></tt>).</li>
  329. </ul>
  330. </div>
  331. <div class="section" id="id8">
  332. <h2>0.1.13 [2009-05-19 12:36 P.M CET]<a class="headerlink" href="#id8" title="Permalink to this headline">¶</a></h2>
  333. <ul>
  334. <li><p class="first">Forgot to add <tt class="docutils literal"><span class="pre">yadayada</span></tt> to install requirements.</p>
  335. </li>
  336. <li><p class="first">Now deletes all expired task results, not just those marked as done.</p>
  337. </li>
  338. <li><p class="first">Able to load the Tokyo Tyrant backend class without django
  339. configuration, can specify tyrant settings directly in the class
  340. constructor.</p>
  341. </li>
  342. <li><p class="first">Improved API documentation</p>
  343. </li>
  344. <li><p class="first">Now using the Sphinx documentation system, you can build
  345. the html documentation by doing</p>
  346. <div class="highlight-python"><pre>$ cd docs
  347. $ make html</pre>
  348. </div>
  349. <p>and the result will be in <tt class="docutils literal"><span class="pre">docs/.build/html</span></tt>.</p>
  350. </li>
  351. </ul>
  352. </div>
  353. <div class="section" id="id9">
  354. <h2>0.1.12 [2009-05-18 04:38 P.M CET]<a class="headerlink" href="#id9" title="Permalink to this headline">¶</a></h2>
  355. <ul>
  356. <li><p class="first"><tt class="docutils literal"><span class="pre">delay_task()</span></tt> etc. now returns <tt class="docutils literal"><span class="pre">celery.task.AsyncResult</span></tt> object,
  357. which lets you check the result and any failure that might have
  358. happened. It kind of works like the <tt class="docutils literal"><span class="pre">multiprocessing.AsyncResult</span></tt>
  359. class returned by <tt class="docutils literal"><span class="pre">multiprocessing.Pool.map_async</span></tt>.</p>
  360. </li>
  361. <li><p class="first">Added dmap() and dmap_async(). This works like the
  362. <tt class="docutils literal"><span class="pre">multiprocessing.Pool</span></tt> versions except they are tasks
  363. distributed to the celery server. Example:</p>
  364. <blockquote>
  365. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="kn">from</span> <span class="nn">celery.task</span> <span class="kn">import</span> <span class="n">dmap</span>
  366. <span class="gp">&gt;&gt;&gt; </span><span class="kn">import</span> <span class="nn">operator</span>
  367. <span class="gp">&gt;&gt;&gt; </span><span class="n">dmap</span><span class="p">(</span><span class="n">operator</span><span class="o">.</span><span class="n">add</span><span class="p">,</span> <span class="p">[[</span><span class="mf">2</span><span class="p">,</span> <span class="mf">2</span><span class="p">],</span> <span class="p">[</span><span class="mf">4</span><span class="p">,</span> <span class="mf">4</span><span class="p">],</span> <span class="p">[</span><span class="mf">8</span><span class="p">,</span> <span class="mf">8</span><span class="p">]])</span>
  368. <span class="gp">&gt;&gt;&gt; </span><span class="p">[</span><span class="mf">4</span><span class="p">,</span> <span class="mf">8</span><span class="p">,</span> <span class="mf">16</span><span class="p">]</span>
  369. </pre></div>
  370. </div>
  371. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="kn">from</span> <span class="nn">celery.task</span> <span class="kn">import</span> <span class="n">dmap_async</span>
  372. <span class="gp">&gt;&gt;&gt; </span><span class="kn">import</span> <span class="nn">operator</span>
  373. <span class="gp">&gt;&gt;&gt; </span><span class="n">result</span> <span class="o">=</span> <span class="n">dmap_async</span><span class="p">(</span><span class="n">operator</span><span class="o">.</span><span class="n">add</span><span class="p">,</span> <span class="p">[[</span><span class="mf">2</span><span class="p">,</span> <span class="mf">2</span><span class="p">],</span> <span class="p">[</span><span class="mf">4</span><span class="p">,</span> <span class="mf">4</span><span class="p">],</span> <span class="p">[</span><span class="mf">8</span><span class="p">,</span> <span class="mf">8</span><span class="p">]])</span>
  374. <span class="gp">&gt;&gt;&gt; </span><span class="n">result</span><span class="o">.</span><span class="n">ready</span><span class="p">()</span>
  375. <span class="go">False</span>
  376. <span class="gp">&gt;&gt;&gt; </span><span class="n">time</span><span class="o">.</span><span class="n">sleep</span><span class="p">(</span><span class="mf">1</span><span class="p">)</span>
  377. <span class="gp">&gt;&gt;&gt; </span><span class="n">result</span><span class="o">.</span><span class="n">ready</span><span class="p">()</span>
  378. <span class="go">True</span>
  379. <span class="gp">&gt;&gt;&gt; </span><span class="n">result</span><span class="o">.</span><span class="n">result</span>
  380. <span class="go">[4, 8, 16]</span>
  381. </pre></div>
  382. </div>
  383. </blockquote>
  384. </li>
  385. <li><p class="first">Refactored the task metadata cache and database backends, and added a new backend for Tokyo Tyrant. You can set the backend in your django settings file. e.g</p>
  386. <blockquote>
  387. <p>CELERY_BACKEND = &#8220;database&#8221;; # Uses the database</p>
  388. <p>CELERY_BACKEND = &#8220;cache&#8221;; # Uses the django cache framework</p>
  389. <p>CELERY_BACKEND = &#8220;tyrant&#8221;; # Uses Tokyo Tyrant
  390. TT_HOST = &#8220;localhost&#8221;; # Hostname for the Tokyo Tyrant server.
  391. TT_PORT = 6657; # Port of the Tokyo Tyrant server.</p>
  392. </blockquote>
  393. </li>
  394. </ul>
  395. </div>
  396. <div class="section" id="id10">
  397. <h2>0.1.11 [2009-05-12 02:08 P.M CET]<a class="headerlink" href="#id10" title="Permalink to this headline">¶</a></h2>
  398. <ul class="simple">
  399. <li>The logging system was leaking file descriptors, resulting in
  400. servers stopping with the EMFILES (too many open files) error. (fixed)</li>
  401. </ul>
  402. </div>
  403. <div class="section" id="id11">
  404. <h2>0.1.10 [2009-05-11 12:46 P.M CET]<a class="headerlink" href="#id11" title="Permalink to this headline">¶</a></h2>
  405. <ul class="simple">
  406. <li>Tasks now supports both positional arguments and keyword arguments.</li>
  407. <li>Requires carrot 0.3.8.</li>
  408. <li>The daemon now tries to reconnect if the connection is lost.</li>
  409. </ul>
  410. </div>
  411. <div class="section" id="id12">
  412. <h2>0.1.8 [2009-05-07 12:27 P.M CET]<a class="headerlink" href="#id12" title="Permalink to this headline">¶</a></h2>
  413. <ul class="simple">
  414. <li>Better test coverage</li>
  415. <li>More documentation</li>
  416. <li>celeryd doesn&#8217;t emit <tt class="docutils literal"><span class="pre">Queue</span> <span class="pre">is</span> <span class="pre">empty</span></tt> message if
  417. <tt class="docutils literal"><span class="pre">settings.CELERYD_EMPTY_MSG_EMIT_EVERY</span></tt> is 0.</li>
  418. </ul>
  419. </div>
  420. <div class="section" id="id13">
  421. <h2>0.1.7 [2009-04-30 1:50 P.M CET]<a class="headerlink" href="#id13" title="Permalink to this headline">¶</a></h2>
  422. <ul class="simple">
  423. <li>Added some unittests</li>
  424. <li>Can now use the database for task metadata (like if the task has
  425. been executed or not). Set <tt class="docutils literal"><span class="pre">settings.CELERY_TASK_META</span></tt></li>
  426. <li>Can now run <tt class="docutils literal"><span class="pre">python</span> <span class="pre">setup.py</span> <span class="pre">test</span></tt> to run the unittests from
  427. within the <tt class="docutils literal"><span class="pre">testproj</span></tt> project.</li>
  428. <li>Can set the AMQP exchange/routing key/queue using
  429. <tt class="docutils literal"><span class="pre">settings.CELERY_AMQP_EXCHANGE</span></tt>, <tt class="docutils literal"><span class="pre">settings.CELERY_AMQP_ROUTING_KEY</span></tt>,
  430. and <tt class="docutils literal"><span class="pre">settings.CELERY_AMQP_CONSUMER_QUEUE</span></tt>.</li>
  431. </ul>
  432. </div>
  433. <div class="section" id="id14">
  434. <h2>0.1.6 [2009-04-28 2:13 P.M CET]<a class="headerlink" href="#id14" title="Permalink to this headline">¶</a></h2>
  435. <blockquote>
  436. <ul class="simple">
  437. <li>Introducing <tt class="docutils literal"><span class="pre">TaskSet</span></tt>. A set of subtasks is executed and you can
  438. find out how many, or if all them, are done (excellent for progress bars and such)</li>
  439. <li>Now catches all exceptions when running <tt class="docutils literal"><span class="pre">Task.__call__</span></tt>, so the
  440. daemon doesn&#8217;t die. This does&#8217;t happen for pure functions yet, only
  441. <tt class="docutils literal"><span class="pre">Task</span></tt> classes.</li>
  442. <li><tt class="docutils literal"><span class="pre">autodiscover()</span></tt> now works with zipped eggs.</li>
  443. <li>celeryd: Now adds curernt working directory to <tt class="docutils literal"><span class="pre">sys.path</span></tt> for
  444. convenience.</li>
  445. <li>The <tt class="docutils literal"><span class="pre">run_every</span></tt> attribute of <tt class="docutils literal"><span class="pre">PeriodicTask</span></tt> classes can now be a
  446. <tt class="docutils literal"><span class="pre">datetime.timedelta()</span></tt> object.</li>
  447. <li>celeryd: You can now set the <tt class="docutils literal"><span class="pre">DJANGO_PROJECT_DIR</span></tt> variable
  448. for <tt class="docutils literal"><span class="pre">celeryd</span></tt> and it will add that to <tt class="docutils literal"><span class="pre">sys.path</span></tt> for easy launching.</li>
  449. <li>Can now check if a task has been executed or not via HTTP.</li>
  450. </ul>
  451. <p>You can do this by including the celery <tt class="docutils literal"><span class="pre">urls.py</span></tt> into your project,</p>
  452. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="n">url</span><span class="p">(</span><span class="s">r&#39;^celery/$&#39;</span><span class="p">,</span> <span class="n">include</span><span class="p">(</span><span class="s">&quot;celery.urls&quot;</span><span class="p">))</span>
  453. </pre></div>
  454. </div>
  455. <p>then visiting the following url,:</p>
  456. <div class="highlight-python"><pre>http://mysite/celery/$task_id/done/</pre>
  457. </div>
  458. <p>this will return a JSON dictionary like e.g:</p>
  459. <div class="highlight-python"><pre>&gt;&gt;&gt; {"task": {"id": $task_id, "executed": true}}</pre>
  460. </div>
  461. <ul class="simple">
  462. <li><tt class="docutils literal"><span class="pre">delay_task</span></tt> now returns string id, not <tt class="docutils literal"><span class="pre">uuid.UUID</span></tt> instance.</li>
  463. <li>Now has <tt class="docutils literal"><span class="pre">PeriodicTasks</span></tt>, to have <tt class="docutils literal"><span class="pre">cron</span></tt> like functionality.</li>
  464. <li>Project changed name from <tt class="docutils literal"><span class="pre">crunchy</span></tt> to <tt class="docutils literal"><span class="pre">celery</span></tt>. The details of
  465. the name change request is in <tt class="docutils literal"><span class="pre">docs/name_change_request.txt</span></tt>.</li>
  466. </ul>
  467. </blockquote>
  468. </div>
  469. <div class="section" id="a-m-cet">
  470. <h2>0.1.0 [2009-04-24 11:28 A.M CET]<a class="headerlink" href="#a-m-cet" title="Permalink to this headline">¶</a></h2>
  471. <ul class="simple">
  472. <li>Initial release</li>
  473. </ul>
  474. </div>
  475. </div>
  476. </div>
  477. </div>
  478. </div>
  479. </div>
  480. <div class="sidebar">
  481. <h3>Contents</h3>
  482. <ul class="current">
  483. <li class="toctree-l1"><a class="reference external" href="introduction.html">celery - Distributed Task Queue for Django.</a></li>
  484. <li class="toctree-l1"><a class="reference external" href="faq.html">Frequently Asked Questions</a></li>
  485. <li class="toctree-l1"><a class="reference external" href="reference/index.html">Module API Reference</a></li>
  486. <li class="toctree-l1 current"><a class="current reference external" href="">Change history</a><ul>
  487. <li class="toctree-l2"><a class="reference external" href="#p-m-cet">0.3.7 [2008-06-16 11:41 P.M CET]</a></li>
  488. <li class="toctree-l2"><a class="reference external" href="#id1">0.3.3 [2009-06-08 01:07 P.M CET]</a></li>
  489. <li class="toctree-l2"><a class="reference external" href="#id2">0.3.2 [2009-06-08 01:07 P.M CET]</a></li>
  490. <li class="toctree-l2"><a class="reference external" href="#id3">0.3.1 [2009-06-08 01:07 P.M CET]</a></li>
  491. <li class="toctree-l2"><a class="reference external" href="#id4">0.3.0 [2009-06-08 12:41 P.M CET]</a></li>
  492. <li class="toctree-l2"><a class="reference external" href="#id5">0.2.0 [2009-05-20 05:14 P.M CET]</a></li>
  493. <li class="toctree-l2"><a class="reference external" href="#pre3-2009-05-20-05-14-p-m-cet">0.2.0-pre3 [2009-05-20 05:14 P.M CET]</a></li>
  494. <li class="toctree-l2"><a class="reference external" href="#pre2-2009-05-20-01-56-p-m-cet">0.2.0-pre2 [2009-05-20 01:56 P.M CET]</a></li>
  495. <li class="toctree-l2"><a class="reference external" href="#pre1-2009-05-20-12-33-p-m-cet">0.2.0-pre1 [2009-05-20 12:33 P.M CET]</a></li>
  496. <li class="toctree-l2"><a class="reference external" href="#id6">0.1.15 [2009-05-19 04:13 P.M CET]</a></li>
  497. <li class="toctree-l2"><a class="reference external" href="#id7">0.1.14 [2009-05-19 01:08 P.M CET]</a></li>
  498. <li class="toctree-l2"><a class="reference external" href="#id8">0.1.13 [2009-05-19 12:36 P.M CET]</a></li>
  499. <li class="toctree-l2"><a class="reference external" href="#id9">0.1.12 [2009-05-18 04:38 P.M CET]</a></li>
  500. <li class="toctree-l2"><a class="reference external" href="#id10">0.1.11 [2009-05-12 02:08 P.M CET]</a></li>
  501. <li class="toctree-l2"><a class="reference external" href="#id11">0.1.10 [2009-05-11 12:46 P.M CET]</a></li>
  502. <li class="toctree-l2"><a class="reference external" href="#id12">0.1.8 [2009-05-07 12:27 P.M CET]</a></li>
  503. <li class="toctree-l2"><a class="reference external" href="#id13">0.1.7 [2009-04-30 1:50 P.M CET]</a></li>
  504. <li class="toctree-l2"><a class="reference external" href="#id14">0.1.6 [2009-04-28 2:13 P.M CET]</a></li>
  505. <li class="toctree-l2"><a class="reference external" href="#a-m-cet">0.1.0 [2009-04-24 11:28 A.M CET]</a></li>
  506. </ul>
  507. </li>
  508. </ul>
  509. <h3 style="margin-top: 1.5em;">Search</h3>
  510. <form class="search" action="search.html" method="get">
  511. <input type="text" name="q" size="18" />
  512. <input type="submit" value="Go" />
  513. <input type="hidden" name="check_keywords" value="yes" />
  514. <input type="hidden" name="area" value="default" />
  515. </form>
  516. <p class="searchtip" style="font-size: 90%">
  517. Enter search terms or a module, class or function name.
  518. </p>
  519. </div>
  520. <div class="clearer"></div>
  521. </div>
  522. </div>
  523. <div class="footer-wrapper">
  524. <div class="footer">
  525. <div class="left">
  526. <a href="genindex.html" title="General Index"
  527. >index</a> |
  528. <a href="modindex.html" title="Global Module Index"
  529. >modules</a> |
  530. <a href="reference/celery.bin.celeryd.html" title="Celery Worker Daemon - celery.bin.celeryd"
  531. >previous</a>
  532. <br/>
  533. <a href="sources/changelog.txt"
  534. rel="nofollow">Show Source</a>
  535. </div>
  536. <div class="right">
  537. &copy; Copyright 2009, Ask Solem.<br/>
  538. Created using <a href="http://sphinx.pocoo.org/">Sphinx</a> 0.6.1.
  539. </div>
  540. <div class="clearer"></div>
  541. </div>
  542. </div>
  543. </body>
  544. </html>