changelog.html 32 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577
  1. <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
  2. "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
  3. <html xmlns="http://www.w3.org/1999/xhtml">
  4. <head>
  5. <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
  6. <title>Change history &mdash; Celery v0.3.11 (unstable) documentation</title>
  7. <link rel="stylesheet" href="static/agogo.css" type="text/css" />
  8. <link rel="stylesheet" href="static/pygments.css" type="text/css" />
  9. <script type="text/javascript">
  10. var DOCUMENTATION_OPTIONS = {
  11. URL_ROOT: '',
  12. VERSION: '0.3.11 (unstable)',
  13. COLLAPSE_MODINDEX: false,
  14. FILE_SUFFIX: '.html',
  15. HAS_SOURCE: true
  16. };
  17. </script>
  18. <script type="text/javascript" src="static/jquery.js"></script>
  19. <script type="text/javascript" src="static/doctools.js"></script>
  20. <link rel="top" title="Celery v0.3.11 (unstable) documentation" href="index.html" />
  21. <link rel="prev" title="Celery Worker Daemon - celery.bin.celeryd" href="reference/celery.bin.celeryd.html" />
  22. </head>
  23. <body>
  24. <div class="header-wrapper">
  25. <div class="header">
  26. <h1><a href="index.html">Celery v0.3.11 (unstable) documentation</a></h1>
  27. <div class="rel">
  28. <a href="genindex.html" title="General Index"
  29. accesskey="I">index</a> |
  30. <a href="modindex.html" title="Global Module Index"
  31. accesskey="M">modules</a> |
  32. <a href="reference/celery.bin.celeryd.html" title="Celery Worker Daemon - celery.bin.celeryd"
  33. accesskey="P">previous</a>
  34. </div>
  35. </div>
  36. </div>
  37. <div class="content-wrapper">
  38. <div class="content">
  39. <div class="document">
  40. <div class="documentwrapper">
  41. <div class="bodywrapper">
  42. <div class="body">
  43. <div class="section" id="change-history">
  44. <h1>Change history<a class="headerlink" href="#change-history" title="Permalink to this headline">¶</a></h1>
  45. <div class="section" id="x-x-x-xxxx-xx-xx-xx-xx-p-m-cet">
  46. <h2>x.x.x [xxxx-xx-xx xx:xx P.M CET]<a class="headerlink" href="#x-x-x-xxxx-xx-xx-xx-xx-p-m-cet" title="Permalink to this headline">¶</a></h2>
  47. <ul>
  48. <li><p class="first"><strong>IMPORTANT</strong> The <tt class="docutils literal"><span class="pre">subtask_ids</span></tt> attribute on the <tt class="docutils literal"><span class="pre">TaskSetResult</span></tt>
  49. instance has been removed. To get this information instead use:</p>
  50. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="n">subtask_ids</span> <span class="o">=</span> <span class="p">[</span><span class="n">subtask</span><span class="o">.</span><span class="n">task_id</span> <span class="k">for</span> <span class="n">subtask</span> <span class="ow">in</span> <span class="n">ts_res</span><span class="o">.</span><span class="n">subtasks</span><span class="p">]</span>
  51. </pre></div>
  52. </div>
  53. </li>
  54. <li><p class="first">Taskset.run() now respects extra message options from the task class.</p>
  55. </li>
  56. <li><dl class="first docutils">
  57. <dt>Should now work on Windows (although running in the background won&#8217;t</dt>
  58. <dd><p class="first last">work, so using the <tt class="docutils literal"><span class="pre">--detach</span></tt> argument results in an exception
  59. being raised.)</p>
  60. </dd>
  61. </dl>
  62. </li>
  63. </ul>
  64. </div>
  65. <div class="section" id="p-m-cet">
  66. <h2>0.3.7 [2008-06-16 11:41 P.M CET]<a class="headerlink" href="#p-m-cet" title="Permalink to this headline">¶</a></h2>
  67. <ul>
  68. <li><dl class="first docutils">
  69. <dt><strong>IMPORTANT</strong> Now uses AMQP&#8217;s <tt class="docutils literal"><span class="pre">basic.consume</span></tt> instead of</dt>
  70. <dd><p class="first last"><tt class="docutils literal"><span class="pre">basic.get</span></tt>. This means we&#8217;re no longer polling the broker for
  71. new messages.</p>
  72. </dd>
  73. </dl>
  74. </li>
  75. <li><dl class="first docutils">
  76. <dt><strong>IMPORTANT</strong> Default concurrency limit is now set to the number of CPUs</dt>
  77. <dd><p class="first last">available on the system.</p>
  78. </dd>
  79. </dl>
  80. </li>
  81. <li><dl class="first docutils">
  82. <dt><strong>IMPORTANT</strong> <tt class="docutils literal"><span class="pre">tasks.register</span></tt>: Renamed <tt class="docutils literal"><span class="pre">task_name</span></tt> argument to</dt>
  83. <dd><p class="first"><tt class="docutils literal"><span class="pre">name</span></tt>, so</p>
  84. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="n">tasks</span><span class="o">.</span><span class="n">register</span><span class="p">(</span><span class="n">func</span><span class="p">,</span> <span class="n">task_name</span><span class="o">=</span><span class="s">&quot;mytask&quot;</span><span class="p">)</span>
  85. </pre></div>
  86. </div>
  87. <p>has to be replaced with:</p>
  88. <div class="last highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="n">tasks</span><span class="o">.</span><span class="n">register</span><span class="p">(</span><span class="n">func</span><span class="p">,</span> <span class="n">name</span><span class="o">=</span><span class="s">&quot;mytask&quot;</span><span class="p">)</span>
  89. </pre></div>
  90. </div>
  91. </dd>
  92. </dl>
  93. </li>
  94. <li><p class="first">The daemon now correctly runs if the pidlock is stale.</p>
  95. </li>
  96. <li><p class="first">Now compatible with carrot 0.4.5</p>
  97. </li>
  98. <li><p class="first">Default AMQP connnection timeout is now 4 seconds.</p>
  99. </li>
  100. <li><p class="first"><tt class="docutils literal"><span class="pre">AsyncResult.read()</span></tt> was always returning <tt class="xref docutils literal"><span class="pre">True</span></tt>.</p>
  101. </li>
  102. <li><dl class="first docutils">
  103. <dt>Only use README as long_description if the file exists so easy_install</dt>
  104. <dd><p class="first last">doesn&#8217;t break.</p>
  105. </dd>
  106. </dl>
  107. </li>
  108. <li><p class="first"><tt class="docutils literal"><span class="pre">celery.view</span></tt>: JSON responses now properly set its mime-type.</p>
  109. </li>
  110. <li><dl class="first docutils">
  111. <dt><tt class="docutils literal"><span class="pre">apply_async</span></tt> now has a <tt class="docutils literal"><span class="pre">connection</span></tt> keyword argument so you</dt>
  112. <dd><p class="first last">can re-use the same AMQP connection if you want to execute
  113. more than one task.</p>
  114. </dd>
  115. </dl>
  116. </li>
  117. <li><p class="first">Handle failures in task_status view such that it won&#8217;t throw 500s.</p>
  118. </li>
  119. <li><p class="first">Fixed typo <tt class="docutils literal"><span class="pre">AMQP_SERVER</span></tt> in documentation to <tt class="docutils literal"><span class="pre">AMQP_HOST</span></tt>.</p>
  120. </li>
  121. <li><p class="first">Worker exception e-mails sent to admins now works properly.</p>
  122. </li>
  123. <li><dl class="first docutils">
  124. <dt>No longer depends on <tt class="docutils literal"><span class="pre">django</span></tt>, so installing <tt class="docutils literal"><span class="pre">celery</span></tt> won&#8217;t affect</dt>
  125. <dd><p class="first last">the preferred Django version installed.</p>
  126. </dd>
  127. </dl>
  128. </li>
  129. <li><dl class="first docutils">
  130. <dt>Now works with PostgreSQL (psycopg2) again by registering the</dt>
  131. <dd><p class="first last"><tt class="docutils literal"><span class="pre">PickledObject</span></tt> field.</p>
  132. </dd>
  133. </dl>
  134. </li>
  135. <li><dl class="first docutils">
  136. <dt><tt class="docutils literal"><span class="pre">celeryd</span></tt>: Added <tt class="docutils literal"><span class="pre">--detach</span></tt> option as an alias to <tt class="docutils literal"><span class="pre">--daemon</span></tt>, and</dt>
  137. <dd><p class="first last">it&#8217;s the term used in the documentation from now on.</p>
  138. </dd>
  139. </dl>
  140. </li>
  141. <li><dl class="first docutils">
  142. <dt>Make sure the pool and periodic task worker thread is terminated</dt>
  143. <dd><p class="first last">properly at exit. (So <tt class="docutils literal"><span class="pre">Ctrl-C</span></tt> works again).</p>
  144. </dd>
  145. </dl>
  146. </li>
  147. <li><p class="first">Now depends on <tt class="docutils literal"><span class="pre">python-daemon</span></tt>.</p>
  148. </li>
  149. <li><p class="first">Removed dependency to <tt class="docutils literal"><span class="pre">simplejson</span></tt></p>
  150. </li>
  151. <li><dl class="first docutils">
  152. <dt>Cache Backend: Re-establishes connection for every task process</dt>
  153. <dd><p class="first last">if the Django cache backend is memcached/libmemcached.</p>
  154. </dd>
  155. </dl>
  156. </li>
  157. <li><dl class="first docutils">
  158. <dt>Tyrant Backend: Now re-establishes the connection for every task</dt>
  159. <dd><p class="first last">executed.</p>
  160. </dd>
  161. </dl>
  162. </li>
  163. </ul>
  164. </div>
  165. <div class="section" id="id1">
  166. <h2>0.3.3 [2009-06-08 01:07 P.M CET]<a class="headerlink" href="#id1" title="Permalink to this headline">¶</a></h2>
  167. <ul>
  168. <li><dl class="first docutils">
  169. <dt>The <tt class="docutils literal"><span class="pre">PeriodicWorkController</span></tt> now sleeps for 1 second between checking</dt>
  170. <dd><p class="first last">for periodic tasks to execute.</p>
  171. </dd>
  172. </dl>
  173. </li>
  174. </ul>
  175. </div>
  176. <div class="section" id="id2">
  177. <h2>0.3.2 [2009-06-08 01:07 P.M CET]<a class="headerlink" href="#id2" title="Permalink to this headline">¶</a></h2>
  178. <ul>
  179. <li><dl class="first docutils">
  180. <dt>celeryd: Added option <tt class="docutils literal"><span class="pre">--discard</span></tt>: Discard (delete!) all waiting</dt>
  181. <dd><p class="first last">messages in the queue.</p>
  182. </dd>
  183. </dl>
  184. </li>
  185. <li><p class="first">celeryd: The <tt class="docutils literal"><span class="pre">--wakeup-after</span></tt> option was not handled as a float.</p>
  186. </li>
  187. </ul>
  188. </div>
  189. <div class="section" id="id3">
  190. <h2>0.3.1 [2009-06-08 01:07 P.M CET]<a class="headerlink" href="#id3" title="Permalink to this headline">¶</a></h2>
  191. <ul>
  192. <li><dl class="first docutils">
  193. <dt>The <cite>PeriodicTask`</cite> worker is now running in its own thread instead</dt>
  194. <dd><p class="first last">of blocking the <tt class="docutils literal"><span class="pre">TaskController</span></tt> loop.</p>
  195. </dd>
  196. </dl>
  197. </li>
  198. <li><p class="first">Default <tt class="docutils literal"><span class="pre">QUEUE_WAKEUP_AFTER</span></tt> has been lowered to <tt class="docutils literal"><span class="pre">0.1</span></tt> (was <tt class="docutils literal"><span class="pre">0.3</span></tt>)</p>
  199. </li>
  200. </ul>
  201. </div>
  202. <div class="section" id="id4">
  203. <h2>0.3.0 [2009-06-08 12:41 P.M CET]<a class="headerlink" href="#id4" title="Permalink to this headline">¶</a></h2>
  204. <p><strong>NOTE</strong> This is a development version, for the stable release, please
  205. see versions 0.2.x.</p>
  206. <p><strong>VERY IMPORTANT:</strong> Pickle is now the encoder used for serializing task
  207. arguments, so be sure to flush your task queue before you upgrade.</p>
  208. <ul>
  209. <li><dl class="first docutils">
  210. <dt><strong>IMPORTANT</strong> TaskSet.run() now returns a celery.result.TaskSetResult</dt>
  211. <dd><p class="first last">instance, which lets you inspect the status and return values of a
  212. taskset as it was a single entity.</p>
  213. </dd>
  214. </dl>
  215. </li>
  216. <li><p class="first"><strong>IMPORTANT</strong> Celery now depends on carrot &gt;= 0.4.1.</p>
  217. </li>
  218. <li><dl class="first docutils">
  219. <dt>The celery daemon now sends task errors to the registered admin e-mails.</dt>
  220. <dd><p class="first last">To turn off this feature, set <tt class="docutils literal"><span class="pre">SEND_CELERY_TASK_ERROR_EMAILS</span></tt> to
  221. <tt class="xref docutils literal"><span class="pre">False</span></tt> in your <tt class="docutils literal"><span class="pre">settings.py</span></tt>. Thanks to Grégoire Cachet.</p>
  222. </dd>
  223. </dl>
  224. </li>
  225. <li><p class="first">You can now run the celery daemon by using <tt class="docutils literal"><span class="pre">manage.py</span></tt>:</p>
  226. <div class="highlight-python"><pre> $ python manage.py celeryd
  227. Thanks to Grégoire Cachet.</pre>
  228. </div>
  229. </li>
  230. <li><dl class="first docutils">
  231. <dt>Added support for message priorities, topic exchanges, custom routing</dt>
  232. <dd><p class="first">keys for tasks. This means we have introduced
  233. <tt class="docutils literal"><span class="pre">celery.task.apply_async</span></tt>, a new way of executing tasks.</p>
  234. <p>You can use <tt class="docutils literal"><span class="pre">celery.task.delay</span></tt> and <tt class="docutils literal"><span class="pre">celery.Task.delay</span></tt> like usual, but
  235. if you want greater control over the message sent, you want
  236. <tt class="docutils literal"><span class="pre">celery.task.apply_async</span></tt> and <tt class="docutils literal"><span class="pre">celery.Task.apply_async</span></tt>.</p>
  237. <p>This also means the AMQP configuration has changed. Some settings has
  238. been renamed, while others are new:</p>
  239. <div class="highlight-python"><div class="highlight"><pre><span class="n">CELERY_AMQP_EXCHANGE</span>
  240. <span class="n">CELERY_AMQP_PUBLISHER_ROUTING_KEY</span>
  241. <span class="n">CELERY_AMQP_CONSUMER_ROUTING_KEY</span>
  242. <span class="n">CELERY_AMQP_CONSUMER_QUEUE</span>
  243. <span class="n">CELERY_AMQP_EXCHANGE_TYPE</span>
  244. </pre></div>
  245. </div>
  246. <p class="last">See the entry <a class="reference external" href="http://bit.ly/celery_AMQP_routing">Can I send some tasks to only some servers?</a> in the
  247. <a class="reference external" href="http://ask.github.com/celery/faq.html">FAQ</a> for more information.</p>
  248. </dd>
  249. </dl>
  250. </li>
  251. </ul>
  252. <ul>
  253. <li><dl class="first docutils">
  254. <dt>Task errors are now logged using loglevel <tt class="docutils literal"><span class="pre">ERROR</span></tt> instead of <tt class="docutils literal"><span class="pre">INFO</span></tt>,</dt>
  255. <dd><p class="first last">and backtraces are dumped. Thanks to Grégoire Cachet.</p>
  256. </dd>
  257. </dl>
  258. </li>
  259. <li><dl class="first docutils">
  260. <dt>Make every new worker process re-establish it&#8217;s Django DB connection,</dt>
  261. <dd><p class="first last">this solving the &#8220;MySQL connection died?&#8221; exceptions.
  262. Thanks to Vitaly Babiy and Jirka Vejrazka.</p>
  263. </dd>
  264. </dl>
  265. </li>
  266. <li><dl class="first docutils">
  267. <dt><strong>IMOPORTANT</strong> Now using pickle to encode task arguments. This means you</dt>
  268. <dd><p class="first last">now can pass complex python objects to tasks as arguments.</p>
  269. </dd>
  270. </dl>
  271. </li>
  272. <li><p class="first">Removed dependency on <tt class="docutils literal"><span class="pre">yadayada</span></tt>.</p>
  273. </li>
  274. <li><p class="first">Added a FAQ, see <tt class="docutils literal"><span class="pre">docs/faq.rst</span></tt>.</p>
  275. </li>
  276. <li><dl class="first docutils">
  277. <dt>Now converts any unicode keys in task <tt class="docutils literal"><span class="pre">kwargs</span></tt> to regular strings.</dt>
  278. <dd><p class="first last">Thanks Vitaly Babiy.</p>
  279. </dd>
  280. </dl>
  281. </li>
  282. <li><p class="first">Renamed the <tt class="docutils literal"><span class="pre">TaskDaemon</span></tt> to <tt class="docutils literal"><span class="pre">WorkController</span></tt>.</p>
  283. </li>
  284. <li><dl class="first docutils">
  285. <dt><tt class="docutils literal"><span class="pre">celery.datastructures.TaskProcessQueue</span></tt> is now renamed to</dt>
  286. <dd><p class="first last"><tt class="docutils literal"><span class="pre">celery.pool.TaskPool</span></tt>.</p>
  287. </dd>
  288. </dl>
  289. </li>
  290. <li><dl class="first docutils">
  291. <dt>The pool algorithm has been refactored for greater performance and</dt>
  292. <dd><p class="first last">stability.</p>
  293. </dd>
  294. </dl>
  295. </li>
  296. </ul>
  297. </div>
  298. <div class="section" id="id5">
  299. <h2>0.2.0 [2009-05-20 05:14 P.M CET]<a class="headerlink" href="#id5" title="Permalink to this headline">¶</a></h2>
  300. <ul class="simple">
  301. <li>Final release of 0.2.0</li>
  302. <li>Compatible with carrot version 0.4.0.</li>
  303. <li>Fixes some syntax errors related to fetching results
  304. from the database backend.</li>
  305. </ul>
  306. </div>
  307. <div class="section" id="pre3-2009-05-20-05-14-p-m-cet">
  308. <h2>0.2.0-pre3 [2009-05-20 05:14 P.M CET]<a class="headerlink" href="#pre3-2009-05-20-05-14-p-m-cet" title="Permalink to this headline">¶</a></h2>
  309. <ul>
  310. <li><dl class="first docutils">
  311. <dt><em>Internal release</em>. Improved handling of unpickled exceptions,</dt>
  312. <dd><p class="first last">get_result() now tries to recreate something looking like the
  313. original exception.</p>
  314. </dd>
  315. </dl>
  316. </li>
  317. </ul>
  318. </div>
  319. <div class="section" id="pre2-2009-05-20-01-56-p-m-cet">
  320. <h2>0.2.0-pre2 [2009-05-20 01:56 P.M CET]<a class="headerlink" href="#pre2-2009-05-20-01-56-p-m-cet" title="Permalink to this headline">¶</a></h2>
  321. <ul class="simple">
  322. <li>Now handles unpickleable exceptions (like the dynimically generated
  323. subclasses of <tt class="docutils literal"><span class="pre">django.core.exception.MultipleObjectsReturned</span></tt>).</li>
  324. </ul>
  325. </div>
  326. <div class="section" id="pre1-2009-05-20-12-33-p-m-cet">
  327. <h2>0.2.0-pre1 [2009-05-20 12:33 P.M CET]<a class="headerlink" href="#pre1-2009-05-20-12-33-p-m-cet" title="Permalink to this headline">¶</a></h2>
  328. <ul class="simple">
  329. <li>It&#8217;s getting quite stable, with a lot of new features, so bump
  330. version to 0.2. This is a pre-release.</li>
  331. <li><tt class="docutils literal"><span class="pre">celery.task.mark_as_read()</span></tt> and <tt class="docutils literal"><span class="pre">celery.task.mark_as_failure()</span></tt> has
  332. been removed. Use <tt class="docutils literal"><span class="pre">celery.backends.default_backend.mark_as_read()</span></tt>,
  333. and <tt class="docutils literal"><span class="pre">celery.backends.default_backend.mark_as_failure()</span></tt> instead.</li>
  334. </ul>
  335. </div>
  336. <div class="section" id="id6">
  337. <h2>0.1.15 [2009-05-19 04:13 P.M CET]<a class="headerlink" href="#id6" title="Permalink to this headline">¶</a></h2>
  338. <ul class="simple">
  339. <li>The celery daemon was leaking AMQP connections, this should be fixed,
  340. if you have any problems with too many files open (like <tt class="docutils literal"><span class="pre">emfile</span></tt>
  341. errors in <tt class="docutils literal"><span class="pre">rabbit.log</span></tt>, please contact us!</li>
  342. </ul>
  343. </div>
  344. <div class="section" id="id7">
  345. <h2>0.1.14 [2009-05-19 01:08 P.M CET]<a class="headerlink" href="#id7" title="Permalink to this headline">¶</a></h2>
  346. <ul class="simple">
  347. <li>Fixed a syntax error in the <tt class="docutils literal"><span class="pre">TaskSet</span></tt> class. (No such variable
  348. <tt class="docutils literal"><span class="pre">TimeOutError</span></tt>).</li>
  349. </ul>
  350. </div>
  351. <div class="section" id="id8">
  352. <h2>0.1.13 [2009-05-19 12:36 P.M CET]<a class="headerlink" href="#id8" title="Permalink to this headline">¶</a></h2>
  353. <ul>
  354. <li><p class="first">Forgot to add <tt class="docutils literal"><span class="pre">yadayada</span></tt> to install requirements.</p>
  355. </li>
  356. <li><p class="first">Now deletes all expired task results, not just those marked as done.</p>
  357. </li>
  358. <li><p class="first">Able to load the Tokyo Tyrant backend class without django
  359. configuration, can specify tyrant settings directly in the class
  360. constructor.</p>
  361. </li>
  362. <li><p class="first">Improved API documentation</p>
  363. </li>
  364. <li><p class="first">Now using the Sphinx documentation system, you can build
  365. the html documentation by doing</p>
  366. <div class="highlight-python"><pre>$ cd docs
  367. $ make html</pre>
  368. </div>
  369. <p>and the result will be in <tt class="docutils literal"><span class="pre">docs/.build/html</span></tt>.</p>
  370. </li>
  371. </ul>
  372. </div>
  373. <div class="section" id="id9">
  374. <h2>0.1.12 [2009-05-18 04:38 P.M CET]<a class="headerlink" href="#id9" title="Permalink to this headline">¶</a></h2>
  375. <ul>
  376. <li><p class="first"><tt class="docutils literal"><span class="pre">delay_task()</span></tt> etc. now returns <tt class="docutils literal"><span class="pre">celery.task.AsyncResult</span></tt> object,
  377. which lets you check the result and any failure that might have
  378. happened. It kind of works like the <tt class="docutils literal"><span class="pre">multiprocessing.AsyncResult</span></tt>
  379. class returned by <tt class="docutils literal"><span class="pre">multiprocessing.Pool.map_async</span></tt>.</p>
  380. </li>
  381. <li><p class="first">Added dmap() and dmap_async(). This works like the
  382. <tt class="docutils literal"><span class="pre">multiprocessing.Pool</span></tt> versions except they are tasks
  383. distributed to the celery server. Example:</p>
  384. <blockquote>
  385. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="kn">from</span> <span class="nn">celery.task</span> <span class="kn">import</span> <span class="n">dmap</span>
  386. <span class="gp">&gt;&gt;&gt; </span><span class="kn">import</span> <span class="nn">operator</span>
  387. <span class="gp">&gt;&gt;&gt; </span><span class="n">dmap</span><span class="p">(</span><span class="n">operator</span><span class="o">.</span><span class="n">add</span><span class="p">,</span> <span class="p">[[</span><span class="mf">2</span><span class="p">,</span> <span class="mf">2</span><span class="p">],</span> <span class="p">[</span><span class="mf">4</span><span class="p">,</span> <span class="mf">4</span><span class="p">],</span> <span class="p">[</span><span class="mf">8</span><span class="p">,</span> <span class="mf">8</span><span class="p">]])</span>
  388. <span class="gp">&gt;&gt;&gt; </span><span class="p">[</span><span class="mf">4</span><span class="p">,</span> <span class="mf">8</span><span class="p">,</span> <span class="mf">16</span><span class="p">]</span>
  389. </pre></div>
  390. </div>
  391. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="kn">from</span> <span class="nn">celery.task</span> <span class="kn">import</span> <span class="n">dmap_async</span>
  392. <span class="gp">&gt;&gt;&gt; </span><span class="kn">import</span> <span class="nn">operator</span>
  393. <span class="gp">&gt;&gt;&gt; </span><span class="n">result</span> <span class="o">=</span> <span class="n">dmap_async</span><span class="p">(</span><span class="n">operator</span><span class="o">.</span><span class="n">add</span><span class="p">,</span> <span class="p">[[</span><span class="mf">2</span><span class="p">,</span> <span class="mf">2</span><span class="p">],</span> <span class="p">[</span><span class="mf">4</span><span class="p">,</span> <span class="mf">4</span><span class="p">],</span> <span class="p">[</span><span class="mf">8</span><span class="p">,</span> <span class="mf">8</span><span class="p">]])</span>
  394. <span class="gp">&gt;&gt;&gt; </span><span class="n">result</span><span class="o">.</span><span class="n">ready</span><span class="p">()</span>
  395. <span class="go">False</span>
  396. <span class="gp">&gt;&gt;&gt; </span><span class="n">time</span><span class="o">.</span><span class="n">sleep</span><span class="p">(</span><span class="mf">1</span><span class="p">)</span>
  397. <span class="gp">&gt;&gt;&gt; </span><span class="n">result</span><span class="o">.</span><span class="n">ready</span><span class="p">()</span>
  398. <span class="go">True</span>
  399. <span class="gp">&gt;&gt;&gt; </span><span class="n">result</span><span class="o">.</span><span class="n">result</span>
  400. <span class="go">[4, 8, 16]</span>
  401. </pre></div>
  402. </div>
  403. </blockquote>
  404. </li>
  405. <li><p class="first">Refactored the task metadata cache and database backends, and added a new backend for Tokyo Tyrant. You can set the backend in your django settings file. e.g</p>
  406. <blockquote>
  407. <p>CELERY_BACKEND = &#8220;database&#8221;; # Uses the database</p>
  408. <p>CELERY_BACKEND = &#8220;cache&#8221;; # Uses the django cache framework</p>
  409. <p>CELERY_BACKEND = &#8220;tyrant&#8221;; # Uses Tokyo Tyrant
  410. TT_HOST = &#8220;localhost&#8221;; # Hostname for the Tokyo Tyrant server.
  411. TT_PORT = 6657; # Port of the Tokyo Tyrant server.</p>
  412. </blockquote>
  413. </li>
  414. </ul>
  415. </div>
  416. <div class="section" id="id10">
  417. <h2>0.1.11 [2009-05-12 02:08 P.M CET]<a class="headerlink" href="#id10" title="Permalink to this headline">¶</a></h2>
  418. <ul class="simple">
  419. <li>The logging system was leaking file descriptors, resulting in
  420. servers stopping with the EMFILES (too many open files) error. (fixed)</li>
  421. </ul>
  422. </div>
  423. <div class="section" id="id11">
  424. <h2>0.1.10 [2009-05-11 12:46 P.M CET]<a class="headerlink" href="#id11" title="Permalink to this headline">¶</a></h2>
  425. <ul class="simple">
  426. <li>Tasks now supports both positional arguments and keyword arguments.</li>
  427. <li>Requires carrot 0.3.8.</li>
  428. <li>The daemon now tries to reconnect if the connection is lost.</li>
  429. </ul>
  430. </div>
  431. <div class="section" id="id12">
  432. <h2>0.1.8 [2009-05-07 12:27 P.M CET]<a class="headerlink" href="#id12" title="Permalink to this headline">¶</a></h2>
  433. <ul class="simple">
  434. <li>Better test coverage</li>
  435. <li>More documentation</li>
  436. <li>celeryd doesn&#8217;t emit <tt class="docutils literal"><span class="pre">Queue</span> <span class="pre">is</span> <span class="pre">empty</span></tt> message if
  437. <tt class="docutils literal"><span class="pre">settings.CELERYD_EMPTY_MSG_EMIT_EVERY</span></tt> is 0.</li>
  438. </ul>
  439. </div>
  440. <div class="section" id="id13">
  441. <h2>0.1.7 [2009-04-30 1:50 P.M CET]<a class="headerlink" href="#id13" title="Permalink to this headline">¶</a></h2>
  442. <ul class="simple">
  443. <li>Added some unittests</li>
  444. <li>Can now use the database for task metadata (like if the task has
  445. been executed or not). Set <tt class="docutils literal"><span class="pre">settings.CELERY_TASK_META</span></tt></li>
  446. <li>Can now run <tt class="docutils literal"><span class="pre">python</span> <span class="pre">setup.py</span> <span class="pre">test</span></tt> to run the unittests from
  447. within the <tt class="docutils literal"><span class="pre">testproj</span></tt> project.</li>
  448. <li>Can set the AMQP exchange/routing key/queue using
  449. <tt class="docutils literal"><span class="pre">settings.CELERY_AMQP_EXCHANGE</span></tt>, <tt class="docutils literal"><span class="pre">settings.CELERY_AMQP_ROUTING_KEY</span></tt>,
  450. and <tt class="docutils literal"><span class="pre">settings.CELERY_AMQP_CONSUMER_QUEUE</span></tt>.</li>
  451. </ul>
  452. </div>
  453. <div class="section" id="id14">
  454. <h2>0.1.6 [2009-04-28 2:13 P.M CET]<a class="headerlink" href="#id14" title="Permalink to this headline">¶</a></h2>
  455. <blockquote>
  456. <ul class="simple">
  457. <li>Introducing <tt class="docutils literal"><span class="pre">TaskSet</span></tt>. A set of subtasks is executed and you can
  458. find out how many, or if all them, are done (excellent for progress bars and such)</li>
  459. <li>Now catches all exceptions when running <tt class="docutils literal"><span class="pre">Task.__call__</span></tt>, so the
  460. daemon doesn&#8217;t die. This does&#8217;t happen for pure functions yet, only
  461. <tt class="docutils literal"><span class="pre">Task</span></tt> classes.</li>
  462. <li><tt class="docutils literal"><span class="pre">autodiscover()</span></tt> now works with zipped eggs.</li>
  463. <li>celeryd: Now adds curernt working directory to <tt class="docutils literal"><span class="pre">sys.path</span></tt> for
  464. convenience.</li>
  465. <li>The <tt class="docutils literal"><span class="pre">run_every</span></tt> attribute of <tt class="docutils literal"><span class="pre">PeriodicTask</span></tt> classes can now be a
  466. <tt class="docutils literal"><span class="pre">datetime.timedelta()</span></tt> object.</li>
  467. <li>celeryd: You can now set the <tt class="docutils literal"><span class="pre">DJANGO_PROJECT_DIR</span></tt> variable
  468. for <tt class="docutils literal"><span class="pre">celeryd</span></tt> and it will add that to <tt class="docutils literal"><span class="pre">sys.path</span></tt> for easy launching.</li>
  469. <li>Can now check if a task has been executed or not via HTTP.</li>
  470. </ul>
  471. <p>You can do this by including the celery <tt class="docutils literal"><span class="pre">urls.py</span></tt> into your project,</p>
  472. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="n">url</span><span class="p">(</span><span class="s">r&#39;^celery/$&#39;</span><span class="p">,</span> <span class="n">include</span><span class="p">(</span><span class="s">&quot;celery.urls&quot;</span><span class="p">))</span>
  473. </pre></div>
  474. </div>
  475. <p>then visiting the following url,:</p>
  476. <div class="highlight-python"><pre>http://mysite/celery/$task_id/done/</pre>
  477. </div>
  478. <p>this will return a JSON dictionary like e.g:</p>
  479. <div class="highlight-python"><pre>&gt;&gt;&gt; {"task": {"id": $task_id, "executed": true}}</pre>
  480. </div>
  481. <ul class="simple">
  482. <li><tt class="docutils literal"><span class="pre">delay_task</span></tt> now returns string id, not <tt class="docutils literal"><span class="pre">uuid.UUID</span></tt> instance.</li>
  483. <li>Now has <tt class="docutils literal"><span class="pre">PeriodicTasks</span></tt>, to have <tt class="docutils literal"><span class="pre">cron</span></tt> like functionality.</li>
  484. <li>Project changed name from <tt class="docutils literal"><span class="pre">crunchy</span></tt> to <tt class="docutils literal"><span class="pre">celery</span></tt>. The details of
  485. the name change request is in <tt class="docutils literal"><span class="pre">docs/name_change_request.txt</span></tt>.</li>
  486. </ul>
  487. </blockquote>
  488. </div>
  489. <div class="section" id="a-m-cet">
  490. <h2>0.1.0 [2009-04-24 11:28 A.M CET]<a class="headerlink" href="#a-m-cet" title="Permalink to this headline">¶</a></h2>
  491. <ul class="simple">
  492. <li>Initial release</li>
  493. </ul>
  494. </div>
  495. </div>
  496. </div>
  497. </div>
  498. </div>
  499. </div>
  500. <div class="sidebar">
  501. <h3>Contents</h3>
  502. <ul class="current">
  503. <li class="toctree-l1"><a class="reference external" href="introduction.html">celery - Distributed Task Queue for Django.</a></li>
  504. <li class="toctree-l1"><a class="reference external" href="faq.html">Frequently Asked Questions</a></li>
  505. <li class="toctree-l1"><a class="reference external" href="reference/index.html">Module API Reference</a></li>
  506. <li class="toctree-l1 current"><a class="current reference external" href="">Change history</a><ul>
  507. <li class="toctree-l2"><a class="reference external" href="#x-x-x-xxxx-xx-xx-xx-xx-p-m-cet">x.x.x [xxxx-xx-xx xx:xx P.M CET]</a></li>
  508. <li class="toctree-l2"><a class="reference external" href="#p-m-cet">0.3.7 [2008-06-16 11:41 P.M CET]</a></li>
  509. <li class="toctree-l2"><a class="reference external" href="#id1">0.3.3 [2009-06-08 01:07 P.M CET]</a></li>
  510. <li class="toctree-l2"><a class="reference external" href="#id2">0.3.2 [2009-06-08 01:07 P.M CET]</a></li>
  511. <li class="toctree-l2"><a class="reference external" href="#id3">0.3.1 [2009-06-08 01:07 P.M CET]</a></li>
  512. <li class="toctree-l2"><a class="reference external" href="#id4">0.3.0 [2009-06-08 12:41 P.M CET]</a></li>
  513. <li class="toctree-l2"><a class="reference external" href="#id5">0.2.0 [2009-05-20 05:14 P.M CET]</a></li>
  514. <li class="toctree-l2"><a class="reference external" href="#pre3-2009-05-20-05-14-p-m-cet">0.2.0-pre3 [2009-05-20 05:14 P.M CET]</a></li>
  515. <li class="toctree-l2"><a class="reference external" href="#pre2-2009-05-20-01-56-p-m-cet">0.2.0-pre2 [2009-05-20 01:56 P.M CET]</a></li>
  516. <li class="toctree-l2"><a class="reference external" href="#pre1-2009-05-20-12-33-p-m-cet">0.2.0-pre1 [2009-05-20 12:33 P.M CET]</a></li>
  517. <li class="toctree-l2"><a class="reference external" href="#id6">0.1.15 [2009-05-19 04:13 P.M CET]</a></li>
  518. <li class="toctree-l2"><a class="reference external" href="#id7">0.1.14 [2009-05-19 01:08 P.M CET]</a></li>
  519. <li class="toctree-l2"><a class="reference external" href="#id8">0.1.13 [2009-05-19 12:36 P.M CET]</a></li>
  520. <li class="toctree-l2"><a class="reference external" href="#id9">0.1.12 [2009-05-18 04:38 P.M CET]</a></li>
  521. <li class="toctree-l2"><a class="reference external" href="#id10">0.1.11 [2009-05-12 02:08 P.M CET]</a></li>
  522. <li class="toctree-l2"><a class="reference external" href="#id11">0.1.10 [2009-05-11 12:46 P.M CET]</a></li>
  523. <li class="toctree-l2"><a class="reference external" href="#id12">0.1.8 [2009-05-07 12:27 P.M CET]</a></li>
  524. <li class="toctree-l2"><a class="reference external" href="#id13">0.1.7 [2009-04-30 1:50 P.M CET]</a></li>
  525. <li class="toctree-l2"><a class="reference external" href="#id14">0.1.6 [2009-04-28 2:13 P.M CET]</a></li>
  526. <li class="toctree-l2"><a class="reference external" href="#a-m-cet">0.1.0 [2009-04-24 11:28 A.M CET]</a></li>
  527. </ul>
  528. </li>
  529. </ul>
  530. <h3 style="margin-top: 1.5em;">Search</h3>
  531. <form class="search" action="search.html" method="get">
  532. <input type="text" name="q" size="18" />
  533. <input type="submit" value="Go" />
  534. <input type="hidden" name="check_keywords" value="yes" />
  535. <input type="hidden" name="area" value="default" />
  536. </form>
  537. <p class="searchtip" style="font-size: 90%">
  538. Enter search terms or a module, class or function name.
  539. </p>
  540. </div>
  541. <div class="clearer"></div>
  542. </div>
  543. </div>
  544. <div class="footer-wrapper">
  545. <div class="footer">
  546. <div class="left">
  547. <a href="genindex.html" title="General Index"
  548. >index</a> |
  549. <a href="modindex.html" title="Global Module Index"
  550. >modules</a> |
  551. <a href="reference/celery.bin.celeryd.html" title="Celery Worker Daemon - celery.bin.celeryd"
  552. >previous</a>
  553. <br/>
  554. <a href="sources/changelog.txt"
  555. rel="nofollow">Show Source</a>
  556. </div>
  557. <div class="right">
  558. &copy; Copyright 2009, Ask Solem.<br/>
  559. Created using <a href="http://sphinx.pocoo.org/">Sphinx</a> 0.6.1.
  560. </div>
  561. <div class="clearer"></div>
  562. </div>
  563. </div>
  564. </body>
  565. </html>