celery.pool.html 10 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210
  1. <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
  2. "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
  3. <html xmlns="http://www.w3.org/1999/xhtml">
  4. <head>
  5. <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
  6. <title>Task Pool - celery.pool &mdash; Celery v0.3.20 (unstable) documentation</title>
  7. <link rel="stylesheet" href="../static/nature.css" type="text/css" />
  8. <link rel="stylesheet" href="../static/pygments.css" type="text/css" />
  9. <script type="text/javascript">
  10. var DOCUMENTATION_OPTIONS = {
  11. URL_ROOT: '../',
  12. VERSION: '0.3.20 (unstable)',
  13. COLLAPSE_MODINDEX: false,
  14. FILE_SUFFIX: '.html',
  15. HAS_SOURCE: true
  16. };
  17. </script>
  18. <script type="text/javascript" src="../static/jquery.js"></script>
  19. <script type="text/javascript" src="../static/doctools.js"></script>
  20. <link rel="top" title="Celery v0.3.20 (unstable) documentation" href="../index.html" />
  21. <link rel="up" title="Module API Reference" href="index.html" />
  22. <link rel="next" title="Process Supervisor - celery.supervisor" href="celery.supervisor.html" />
  23. <link rel="prev" title="Worker Controller Threads - celery.worker.controllers" href="celery.worker.controllers.html" />
  24. </head>
  25. <body>
  26. <div class="related">
  27. <h3>Navigation</h3>
  28. <ul>
  29. <li class="right" style="margin-right: 10px">
  30. <a href="../genindex.html" title="General Index"
  31. accesskey="I">index</a></li>
  32. <li class="right" >
  33. <a href="../modindex.html" title="Global Module Index"
  34. accesskey="M">modules</a> |</li>
  35. <li class="right" >
  36. <a href="celery.supervisor.html" title="Process Supervisor - celery.supervisor"
  37. accesskey="N">next</a> |</li>
  38. <li class="right" >
  39. <a href="celery.worker.controllers.html" title="Worker Controller Threads - celery.worker.controllers"
  40. accesskey="P">previous</a> |</li>
  41. <li><a href="../index.html">Celery v0.3.20 (unstable) documentation</a> &raquo;</li>
  42. <li><a href="index.html" accesskey="U">Module API Reference</a> &raquo;</li>
  43. </ul>
  44. </div>
  45. <div class="document">
  46. <div class="documentwrapper">
  47. <div class="bodywrapper">
  48. <div class="body">
  49. <div class="section" id="module-celery.pool">
  50. <h1>Task Pool - celery.pool<a class="headerlink" href="#module-celery.pool" title="Permalink to this headline">¶</a></h1>
  51. <p>Process Pools.</p>
  52. <dl class="class">
  53. <dt id="celery.pool.TaskPool">
  54. <em class="property">
  55. class </em><tt class="descclassname">celery.pool.</tt><tt class="descname">TaskPool</tt><big>(</big><em>limit</em>, <em>logger=None</em><big>)</big><a class="headerlink" href="#celery.pool.TaskPool" title="Permalink to this definition">¶</a></dt>
  56. <dd><p>Pool of running child processes, which starts waiting for the
  57. processes to finish when the queue limit has been reached.</p>
  58. <table class="docutils field-list" frame="void" rules="none">
  59. <col class="field-name" />
  60. <col class="field-body" />
  61. <tbody valign="top">
  62. <tr class="field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first last simple">
  63. <li><em>limit</em> &#8211; see <a title="celery.pool.TaskPool.limit" class="reference internal" href="#celery.pool.TaskPool.limit"><tt class="xref docutils literal"><span class="pre">limit</span></tt></a> attribute.</li>
  64. <li><em>logger</em> &#8211; see <a title="celery.pool.TaskPool.logger" class="reference internal" href="#celery.pool.TaskPool.logger"><tt class="xref docutils literal"><span class="pre">logger</span></tt></a> attribute.</li>
  65. </ul>
  66. </td>
  67. </tr>
  68. </tbody>
  69. </table>
  70. <dl class="attribute">
  71. <dt id="celery.pool.TaskPool.limit">
  72. <tt class="descname">limit</tt><a class="headerlink" href="#celery.pool.TaskPool.limit" title="Permalink to this definition">¶</a></dt>
  73. <dd>The number of processes that can run simultaneously until
  74. we start collecting results.</dd></dl>
  75. <dl class="attribute">
  76. <dt id="celery.pool.TaskPool.logger">
  77. <tt class="descname">logger</tt><a class="headerlink" href="#celery.pool.TaskPool.logger" title="Permalink to this definition">¶</a></dt>
  78. <dd>The logger used for debugging.</dd></dl>
  79. <dl class="method">
  80. <dt id="celery.pool.TaskPool.apply_async">
  81. <tt class="descname">apply_async</tt><big>(</big><em>target</em>, <em>args=None</em>, <em>kwargs=None</em>, <em>callbacks=None</em>, <em>errbacks=None</em>, <em>on_acknowledge=None</em>, <em>meta=None</em><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.apply_async" title="Permalink to this definition">¶</a></dt>
  82. <dd><p>Equivalent of the :func:<tt class="docutils literal"><span class="pre">apply</span></tt> built-in function.</p>
  83. <p>All <tt class="docutils literal"><span class="pre">callbacks</span></tt> and <tt class="docutils literal"><span class="pre">errbacks</span></tt> should complete immediately since
  84. otherwise the thread which handles the result will get blocked.</p>
  85. </dd></dl>
  86. <dl class="method">
  87. <dt id="celery.pool.TaskPool.full">
  88. <tt class="descname">full</tt><big>(</big><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.full" title="Permalink to this definition">¶</a></dt>
  89. <dd><p>Is the pool full?</p>
  90. <table class="docutils field-list" frame="void" rules="none">
  91. <col class="field-name" />
  92. <col class="field-body" />
  93. <tbody valign="top">
  94. <tr class="field"><th class="field-name">Returns:</th><td class="field-body"><tt class="xref docutils literal"><span class="pre">True</span></tt> if the maximum number of concurrent processes
  95. has been reached.</td>
  96. </tr>
  97. </tbody>
  98. </table>
  99. </dd></dl>
  100. <dl class="method">
  101. <dt id="celery.pool.TaskPool.get_worker_pids">
  102. <tt class="descname">get_worker_pids</tt><big>(</big><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.get_worker_pids" title="Permalink to this definition">¶</a></dt>
  103. <dd>Returns the process id&#8217;s of all the pool workers.</dd></dl>
  104. <dl class="method">
  105. <dt id="celery.pool.TaskPool.on_ready">
  106. <tt class="descname">on_ready</tt><big>(</big><em>callbacks</em>, <em>errbacks</em>, <em>meta</em>, <em>ret_value</em><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.on_ready" title="Permalink to this definition">¶</a></dt>
  107. <dd>What to do when a worker task is ready and its return value has
  108. been collected.</dd></dl>
  109. <dl class="method">
  110. <dt id="celery.pool.TaskPool.on_return">
  111. <tt class="descname">on_return</tt><big>(</big><em>tid</em>, <em>callbacks</em>, <em>errbacks</em>, <em>meta</em>, <em>ret_value</em><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.on_return" title="Permalink to this definition">¶</a></dt>
  112. <dd>What to do when the process returns.</dd></dl>
  113. <dl class="method">
  114. <dt id="celery.pool.TaskPool.reap">
  115. <tt class="descname">reap</tt><big>(</big><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.reap" title="Permalink to this definition">¶</a></dt>
  116. <dd>Reap finished tasks.</dd></dl>
  117. <dl class="method">
  118. <dt id="celery.pool.TaskPool.start">
  119. <tt class="descname">start</tt><big>(</big><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.start" title="Permalink to this definition">¶</a></dt>
  120. <dd><p>Run the task pool.</p>
  121. <p>Will pre-fork all workers so they&#8217;re ready to accept tasks.</p>
  122. </dd></dl>
  123. <dl class="method">
  124. <dt id="celery.pool.TaskPool.stop">
  125. <tt class="descname">stop</tt><big>(</big><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.stop" title="Permalink to this definition">¶</a></dt>
  126. <dd>Terminate the pool.</dd></dl>
  127. <dl class="method">
  128. <dt id="celery.pool.TaskPool.wait_for_result">
  129. <tt class="descname">wait_for_result</tt><big>(</big><big>)</big><a class="headerlink" href="#celery.pool.TaskPool.wait_for_result" title="Permalink to this definition">¶</a></dt>
  130. <dd><p>Waits for the first process in the pool to finish.</p>
  131. <p>This operation is blocking.</p>
  132. </dd></dl>
  133. </dd></dl>
  134. </div>
  135. </div>
  136. </div>
  137. </div>
  138. <div class="sphinxsidebar">
  139. <div class="sphinxsidebarwrapper">
  140. <h4>Previous topic</h4>
  141. <p class="topless"><a href="celery.worker.controllers.html"
  142. title="previous chapter">Worker Controller Threads - celery.worker.controllers</a></p>
  143. <h4>Next topic</h4>
  144. <p class="topless"><a href="celery.supervisor.html"
  145. title="next chapter">Process Supervisor - celery.supervisor</a></p>
  146. <h3>This Page</h3>
  147. <ul class="this-page-menu">
  148. <li><a href="../sources/reference/celery.pool.txt"
  149. rel="nofollow">Show Source</a></li>
  150. </ul>
  151. <div id="searchbox" style="display: none">
  152. <h3>Quick search</h3>
  153. <form class="search" action="../search.html" method="get">
  154. <input type="text" name="q" size="18" />
  155. <input type="submit" value="Go" />
  156. <input type="hidden" name="check_keywords" value="yes" />
  157. <input type="hidden" name="area" value="default" />
  158. </form>
  159. <p class="searchtip" style="font-size: 90%">
  160. Enter search terms or a module, class or function name.
  161. </p>
  162. </div>
  163. <script type="text/javascript">$('#searchbox').show(0);</script>
  164. </div>
  165. </div>
  166. <div class="clearer"></div>
  167. </div>
  168. <div class="related">
  169. <h3>Navigation</h3>
  170. <ul>
  171. <li class="right" style="margin-right: 10px">
  172. <a href="../genindex.html" title="General Index"
  173. >index</a></li>
  174. <li class="right" >
  175. <a href="../modindex.html" title="Global Module Index"
  176. >modules</a> |</li>
  177. <li class="right" >
  178. <a href="celery.supervisor.html" title="Process Supervisor - celery.supervisor"
  179. >next</a> |</li>
  180. <li class="right" >
  181. <a href="celery.worker.controllers.html" title="Worker Controller Threads - celery.worker.controllers"
  182. >previous</a> |</li>
  183. <li><a href="../index.html">Celery v0.3.20 (unstable) documentation</a> &raquo;</li>
  184. <li><a href="index.html" >Module API Reference</a> &raquo;</li>
  185. </ul>
  186. </div>
  187. <div class="footer">
  188. &copy; Copyright 2009, Ask Solem.
  189. Created using <a href="http://sphinx.pocoo.org/">Sphinx</a> 0.6.2.
  190. </div>
  191. </body>
  192. </html>