Home Explore Help
Sign In
yangck
/
celery
1
0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Tree: d5873c9d20
Branches Tags
celery
/
faq.html

faq.html 14 KB
History Raw

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216 
  1. <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
    2. 

  2.   "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
    3. 

  3. 

  4. <html xmlns="http://www.w3.org/1999/xhtml">
    5. 

  5.   <head>
    6. 

  6.     <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
    7. 

  7.     
    8. 

  8.     <title>Frequently Asked Questions &mdash; Celery v0.3.0 (unstable) documentation</title>
    9. 

  9.     <link rel="stylesheet" href="static/agogo.css" type="text/css" />
    10. 

  10.     <link rel="stylesheet" href="static/pygments.css" type="text/css" />
    11. 

  11.     <script type="text/javascript">
    12. 

  12.       var DOCUMENTATION_OPTIONS = {
    13. 

  13.       URL_ROOT:    '',
    14. 

  14.       VERSION:     '0.3.0 (unstable)',
    15. 

  15.       COLLAPSE_MODINDEX: false,
    16. 

  16.       FILE_SUFFIX: '.html',
    17. 

  17.       HAS_SOURCE:  true
    18. 

  18.       };
    19. 

  19.     </script>
    20. 

  20.     <script type="text/javascript" src="static/jquery.js"></script>
    21. 

  21.     <script type="text/javascript" src="static/doctools.js"></script>
    22. 

  22.     <link rel="top" title="Celery v0.3.0 (unstable) documentation" href="index.html" />
    23. 

  23.     <link rel="next" title="Module API Reference" href="reference/index.html" />
    24. 

  24.     <link rel="prev" title="celery - Distributed Task Queue for Django." href="introduction.html" /> 
    25. 

  25.   </head>
    26. 

  26.   <body>
    27. 

  27. 

  28.     <div class="header-wrapper">
    29. 

  29.       <div class="header">
    30. 

  30. 	<h1><a href="index.html">Celery v0.3.0 (unstable) documentation</a></h1>
    31. 

  31. 	<div class="rel">
    32. 

  32.           <a href="genindex.html" title="General Index"
    33. 

  33.              accesskey="I">index</a> |
    34. 

  34.           <a href="modindex.html" title="Global Module Index"
    35. 

  35.              accesskey="M">modules</a> |
    36. 

  36.           <a href="reference/index.html" title="Module API Reference"
    37. 

  37.              accesskey="N">next</a> |
    38. 

  38.           <a href="introduction.html" title="celery - Distributed Task Queue for Django."
    39. 

  39.              accesskey="P">previous</a>
    40. 

  40. 	</div>
    41. 

  41.       </div>
    42. 

  42.     </div>
    43. 

  43. 

  44.     <div class="content-wrapper">
    45. 

  45.       <div class="content">
    46. 

  46. 	<div class="document">
    47. 

  47. 	  <div class="documentwrapper">
    48. 

  48. 	    <div class="bodywrapper">
    49. 

  49. 	      <div class="body">
    50. 

  50. 		
    51. 

  51.   <div class="section" id="frequently-asked-questions">
    52. 

  52. <h1>Frequently Asked Questions<a class="headerlink" href="#frequently-asked-questions" title="Permalink to this headline">¶</a></h1>
    53. 

  53. <div class="section" id="questions">
    54. 

  54. <h2>Questions<a class="headerlink" href="#questions" title="Permalink to this headline">¶</a></h2>
    55. 

  55. <div class="section" id="mysql-is-throwing-deadlock-errors-what-can-i-do">
    56. 

  56. <h3>MySQL is throwing deadlock errors, what can I do?<a class="headerlink" href="#mysql-is-throwing-deadlock-errors-what-can-i-do" title="Permalink to this headline">¶</a></h3>
    57. 

  57. <p><strong>Answer:</strong> MySQL has default isolation level set to <tt class="docutils literal"><span class="pre">REPEATABLE-READ</span></tt>,
    58. 

  58. if you don&#8217;t really need that, set it to <tt class="docutils literal"><span class="pre">READ-COMMITTED</span></tt>.
    59. 

  59. You can do that by adding the following to your <tt class="docutils literal"><span class="pre">my.cnf</span></tt>:</p>
    60. 

  60. <div class="highlight-python"><div class="highlight"><pre><span class="p">[</span><span class="n">mysqld</span><span class="p">]</span>
    61. 

  61. <span class="n">transaction</span><span class="o">-</span><span class="n">isolation</span> <span class="o">=</span> <span class="n">READ</span><span class="o">-</span><span class="n">COMMITTED</span>
    62. 

  62. </pre></div>
    63. 

  63. </div>
    64. 

  64. <p>For more information about InnoDBs transaction model see <a class="reference external" href="http://dev.mysql.com/doc/refman/5.1/en/innodb-transaction-model.html">MySQL - The InnoDB
    65. 

  65. Transaction Model and Locking</a> in the MySQL user manual.</p>
    66. 

  66. <p>(Thanks to Honza Kral and Anton Tsigularov for this solution)</p>
    67. 

  67. </div>
    68. 

  68. <div class="section" id="celeryd-is-not-doing-anything-just-hanging">
    69. 

  69. <h3>celeryd is not doing anything, just hanging<a class="headerlink" href="#celeryd-is-not-doing-anything-just-hanging" title="Permalink to this headline">¶</a></h3>
    70. 

  70. <p><strong>Answer:</strong> See <a class="reference internal" href="#mysql-is-throwing-deadlock-errors-what-can-i-do">MySQL is throwing deadlock errors, what can I do?</a>.</p>
    71. 

  71. </div>
    72. 

  72. <div class="section" id="i-m-having-integrityerror-duplicate-key-errors-why">
    73. 

  73. <h3>I&#8217;m having <tt class="docutils literal"><span class="pre">IntegrityError:</span> <span class="pre">Duplicate</span> <span class="pre">Key</span></tt> errors. Why?<a class="headerlink" href="#i-m-having-integrityerror-duplicate-key-errors-why" title="Permalink to this headline">¶</a></h3>
    74. 

  74. <p><strong>Answer:</strong> See <a class="reference internal" href="#mysql-is-throwing-deadlock-errors-what-can-i-do">MySQL is throwing deadlock errors, what can I do?</a>.
    75. 

  75. Thanks to howsthedotcom.</p>
    76. 

  76. </div>
    77. 

  77. <div class="section" id="my-periodic-tasks-won-t-run">
    78. 

  78. <h3>My Periodic Tasks won&#8217;t run<a class="headerlink" href="#my-periodic-tasks-won-t-run" title="Permalink to this headline">¶</a></h3>
    79. 

  79. <p><strong>Answer:</strong> Did you register the task in the applications <tt class="docutils literal"><span class="pre">tasks.py</span></tt> module?
    80. 

  80. (or in some other module Django loads by default, like <tt class="docutils literal"><span class="pre">models.py</span></tt>?).</p>
    81. 

  81. <p>You can find out if the celery daemon is able to run the task by executing the
    82. 

  82. periodic task manually:</p>
    83. 

  83. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="kn">from</span> <span class="nn">myapp.tasks</span> <span class="kn">import</span> <span class="n">MyPeriodicTask</span>
    84. 

  84. <span class="gp">&gt;&gt;&gt; </span><span class="n">MyPeriodicTask</span><span class="o">.</span><span class="n">delay</span><span class="p">()</span>
    85. 

  85. </pre></div>
    86. 

  86. </div>
    87. 

  87. <p>Watch celery daemons logfile (or output if not running as a daemon), to see
    88. 

  88. if it&#8217;s able to find the task, or if some other error is happening.</p>
    89. 

  89. </div>
    90. 

  90. <div class="section" id="can-i-send-some-tasks-to-only-some-servers">
    91. 

  91. <h3>Can I send some tasks to only some servers?<a class="headerlink" href="#can-i-send-some-tasks-to-only-some-servers" title="Permalink to this headline">¶</a></h3>
    92. 

  92. <p>As of now there is only one use-case that works like this, and that is
    93. 

  93. tasks of type <tt class="docutils literal"><span class="pre">A</span></tt> can be sent to servers <tt class="docutils literal"><span class="pre">x</span></tt> and <tt class="docutils literal"><span class="pre">y</span></tt>, while tasks
    94. 

  94. of type <tt class="docutils literal"><span class="pre">B</span></tt> can be sent to server <tt class="docutils literal"><span class="pre">z</span></tt>. One server can&#8217;t handle more than
    95. 

  95. one routing_key, but this is coming in a later release.</p>
    96. 

  96. <p>Say you have two servers, <tt class="docutils literal"><span class="pre">x</span></tt>, and <tt class="docutils literal"><span class="pre">y</span></tt> that handles regular tasks,
    97. 

  97. and one server <tt class="docutils literal"><span class="pre">z</span></tt>, that only handles feed related tasks, you can use this
    98. 

  98. configuration:</p>
    99. 

  99. <blockquote>
    100. 

  100. <ul class="simple">
    101. 

  101. <li>Servers <tt class="docutils literal"><span class="pre">x</span></tt> and <tt class="docutils literal"><span class="pre">y</span></tt>: settings.py:</li>
    102. 

  102. </ul>
    103. 

  103. <div class="highlight-python"><div class="highlight"><pre><span class="n">AMQP_SERVER</span> <span class="o">=</span> <span class="s">&quot;rabbit&quot;</span>
    104. 

  104. <span class="n">AMQP_PORT</span> <span class="o">=</span> <span class="mf">5678</span>
    105. 

  105. <span class="n">AMQP_USER</span> <span class="o">=</span> <span class="s">&quot;myapp&quot;</span>
    106. 

  106. <span class="n">AMQP_PASSWORD</span> <span class="o">=</span> <span class="s">&quot;secret&quot;</span>
    107. 

  107. <span class="n">AMQP_VHOST</span> <span class="o">=</span> <span class="s">&quot;myapp&quot;</span>
    108. 

  108. 

  109. <span class="n">CELERY_AMQP_CONSUMER_QUEUE</span> <span class="o">=</span> <span class="s">&quot;regular_tasks&quot;</span>
    110. 

  110. <span class="n">CELERY_AMQP_EXCHANGE</span> <span class="o">=</span> <span class="s">&quot;tasks&quot;</span>
    111. 

  111. <span class="n">CELERY_AMQP_PUBLISHER_ROUTING_KEY</span> <span class="o">=</span> <span class="s">&quot;task.regular&quot;</span>
    112. 

  112. <span class="n">CELERY_AMQP_CONSUMER_ROUTING_KEY</span> <span class="o">=</span> <span class="s">&quot;task.#&quot;</span>
    113. 

  113. <span class="n">CELERY_AMQP_EXCHANGE_TYPE</span> <span class="o">=</span> <span class="s">&quot;topic&quot;</span>
    114. 

  114. </pre></div>
    115. 

  115. </div>
    116. 

  116. <ul class="simple">
    117. 

  117. <li>Server <tt class="docutils literal"><span class="pre">z</span></tt>: settings.py:</li>
    118. 

  118. </ul>
    119. 

  119. <div class="highlight-python"><div class="highlight"><pre><span class="n">AMQP_SERVER</span> <span class="o">=</span> <span class="s">&quot;rabbit&quot;</span>
    120. 

  120. <span class="n">AMQP_PORT</span> <span class="o">=</span> <span class="mf">5678</span>
    121. 

  121. <span class="n">AMQP_USER</span> <span class="o">=</span> <span class="s">&quot;myapp&quot;</span>
    122. 

  122. <span class="n">AMQP_PASSWORD</span> <span class="o">=</span> <span class="s">&quot;secret&quot;</span>
    123. 

  123. <span class="n">AMQP_VHOST</span> <span class="o">=</span> <span class="s">&quot;myapp&quot;</span>
    124. 

  124. 

  125. <span class="n">CELERY_AMQP_CONSUMER_QUEUE</span> <span class="o">=</span> <span class="s">&quot;feed_tasks&quot;</span>
    126. 

  126. <span class="n">CELERY_AMQP_EXCHANGE</span> <span class="o">=</span> <span class="s">&quot;tasks&quot;</span>
    127. 

  127. <span class="n">CELERY_AMQP_PUBLISHER_ROUTING_KEY</span> <span class="o">=</span> <span class="s">&quot;task.regular&quot;</span>
    128. 

  128. <span class="n">CELERY_AMQP_CONSUMER_ROUTING_KEY</span> <span class="o">=</span> <span class="s">&quot;task.feed.#&quot;</span>
    129. 

  129. <span class="n">CELERY_AMQP_EXCHANGE_TYPE</span> <span class="o">=</span> <span class="s">&quot;topic&quot;</span>
    130. 

  130. </pre></div>
    131. 

  131. </div>
    132. 

  132. </blockquote>
    133. 

  133. <p>Now to make a Task run on the <tt class="docutils literal"><span class="pre">z</span></tt> server you need to set its
    134. 

  134. <tt class="docutils literal"><span class="pre">routing_key</span></tt> attribute so it starts with the words <tt class="docutils literal"><span class="pre">&quot;task.feed.&quot;</span></tt>:</p>
    135. 

  135. <div class="highlight-python"><div class="highlight"><pre><span class="kn">from</span> <span class="nn">feedaggregator.models</span> <span class="kn">import</span> <span class="n">Feed</span>
    136. 

  136. <span class="kn">from</span> <span class="nn">celery.task</span> <span class="kn">import</span> <span class="n">Task</span>
    137. 

  137. 

  138. <span class="k">class</span> <span class="nc">FeedImportTask</span><span class="p">(</span><span class="n">Task</span><span class="p">):</span>
    139. 

  139.     <span class="n">name</span> <span class="o">=</span> <span class="s">&quot;import_feed&quot;</span>
    140. 

  140.     <span class="n">routing_key</span> <span class="o">=</span> <span class="s">&quot;task.feed.importer&quot;</span>
    141. 

  141. 

  142.     <span class="k">def</span> <span class="nf">run</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">feed_url</span><span class="p">):</span>
    143. 

  143.         <span class="c"># something importing the feed</span>
    144. 

  144.         <span class="n">Feed</span><span class="o">.</span><span class="n">objects</span><span class="o">.</span><span class="n">import_feed</span><span class="p">(</span><span class="n">feed_url</span><span class="p">)</span>
    145. 

  145. </pre></div>
    146. 

  146. </div>
    147. 

  147. <p>You can also override this using the <tt class="docutils literal"><span class="pre">routing_key</span></tt> argument to
    148. 

  148. <a title="celery.task.apply_async" class="reference external" href="reference/celery.task.html#celery.task.apply_async"><tt class="xref docutils literal"><span class="pre">celery.task.apply_async()</span></tt></a>:</p>
    149. 

  149. <div class="highlight-python"><div class="highlight"><pre><span class="gp">&gt;&gt;&gt; </span><span class="kn">from</span> <span class="nn">celery.task</span> <span class="kn">import</span> <span class="n">apply_async</span>
    150. 

  150. <span class="gp">&gt;&gt;&gt; </span><span class="kn">from</span> <span class="nn">myapp.tasks</span> <span class="kn">import</span> <span class="n">RefreshFeedTask</span>
    151. 

  151. <span class="gp">&gt;&gt;&gt; </span><span class="n">apply_async</span><span class="p">(</span><span class="n">RefreshFeedTask</span><span class="p">,</span> <span class="n">args</span><span class="o">=</span><span class="p">[</span><span class="s">&quot;http://cnn.com/rss&quot;</span><span class="p">],</span>
    152. 

  152. <span class="gp">... </span>            <span class="n">routing_key</span><span class="o">=</span><span class="s">&quot;task.feed.importer&quot;</span><span class="p">)</span>
    153. 

  153. </pre></div>
    154. 

  154. </div>
    155. 

  155. </div>
    156. 

  156. </div>
    157. 

  157. </div>
    158. 

  158. 

  159. 

  160. 	      </div>
    161. 

  161. 	    </div>
    162. 

  162. 	  </div>
    163. 

  163. 	</div>
    164. 

  164. 	<div class="sidebar">
    165. 

  165. 	  <h3>Contents</h3>
    166. 

  166. 	  <ul class="current">
    167. 

  167. <li class="toctree-l1"><a class="reference external" href="introduction.html">celery - Distributed Task Queue for Django.</a></li>
    168. 

  168. <li class="toctree-l1 current"><a class="current reference external" href="">Frequently Asked Questions</a><ul>
    169. 

  169. <li class="toctree-l2"><a class="reference external" href="#questions">Questions</a></li>
    170. 

  170. </ul>
    171. 

  171. </li>
    172. 

  172. <li class="toctree-l1"><a class="reference external" href="reference/index.html">Module API Reference</a></li>
    173. 

  173. <li class="toctree-l1"><a class="reference external" href="changelog.html">Change history</a></li>
    174. 

  174. </ul>
    175. 

  175. 

  176. 	  <h3 style="margin-top: 1.5em;">Search</h3>
    177. 

  177. 	  <form class="search" action="search.html" method="get">
    178. 

  178.             <input type="text" name="q" size="18" />
    179. 

  179.             <input type="submit" value="Go" />
    180. 

  180.             <input type="hidden" name="check_keywords" value="yes" />
    181. 

  181.             <input type="hidden" name="area" value="default" />
    182. 

  182.           </form>
    183. 

  183.           <p class="searchtip" style="font-size: 90%">
    184. 

  184.             Enter search terms or a module, class or function name.
    185. 

  185.           </p>
    186. 

  186. 	</div>
    187. 

  187. 	<div class="clearer"></div>
    188. 

  188.       </div>
    189. 

  189.     </div>
    190. 

  190. 

  191.     <div class="footer-wrapper">
    192. 

  192.       <div class="footer">
    193. 

  193. 	<div class="left">
    194. 

  194.           <a href="genindex.html" title="General Index"
    195. 

  195.              >index</a> |
    196. 

  196.           <a href="modindex.html" title="Global Module Index"
    197. 

  197.              >modules</a> |
    198. 

  198.           <a href="reference/index.html" title="Module API Reference"
    199. 

  199.              >next</a> |
    200. 

  200.           <a href="introduction.html" title="celery - Distributed Task Queue for Django."
    201. 

  201.              >previous</a>
    202. 

  202.             <br/>
    203. 

  203.             <a href="sources/faq.txt"
    204. 

  204.                rel="nofollow">Show Source</a>
    205. 

  205. 	</div>
    206. 

  206. 

  207. 	<div class="right">
    208. 

  208. 	  &copy; Copyright 2009, Ask Solem.<br/>
    209. 

  209. 	  Created using <a href="http://sphinx.pocoo.org/">Sphinx</a> 0.6.1.
    210. 

  210. 	</div>
    211. 

  211. 	<div class="clearer"></div>
    212. 

  212.       </div>
    213. 

  213.     </div>
    214. 

  214. 

  215.   </body>
    216. 

  216. </html>
    217.