celery.datastructures.html 13 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229
  1. <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
  2. "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
  3. <html xmlns="http://www.w3.org/1999/xhtml">
  4. <head>
  5. <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
  6. <title>Datastructures - celery.datastructures &mdash; Celery v0.2.0 documentation</title>
  7. <link rel="stylesheet" href="../static/agogo.css" type="text/css" />
  8. <link rel="stylesheet" href="../static/pygments.css" type="text/css" />
  9. <script type="text/javascript">
  10. var DOCUMENTATION_OPTIONS = {
  11. URL_ROOT: '../',
  12. VERSION: '0.2.0',
  13. COLLAPSE_MODINDEX: false,
  14. FILE_SUFFIX: '.html',
  15. HAS_SOURCE: true
  16. };
  17. </script>
  18. <script type="text/javascript" src="../static/jquery.js"></script>
  19. <script type="text/javascript" src="../static/doctools.js"></script>
  20. <link rel="top" title="Celery v0.2.0 documentation" href="../index.html" />
  21. <link rel="up" title="Module API Reference" href="index.html" />
  22. <link rel="next" title="Logging - celery.log" href="celery.log.html" />
  23. <link rel="prev" title="Configuration - celery.conf" href="celery.conf.html" />
  24. </head>
  25. <body>
  26. <div class="header-wrapper">
  27. <div class="header">
  28. <h1><a href="../index.html">Celery v0.2.0 documentation</a></h1>
  29. <div class="rel">
  30. <a href="../genindex.html" title="General Index"
  31. accesskey="I">index</a> |
  32. <a href="../modindex.html" title="Global Module Index"
  33. accesskey="M">modules</a> |
  34. <a href="celery.log.html" title="Logging - celery.log"
  35. accesskey="N">next</a> |
  36. <a href="celery.conf.html" title="Configuration - celery.conf"
  37. accesskey="P">previous</a>
  38. </div>
  39. </div>
  40. </div>
  41. <div class="content-wrapper">
  42. <div class="content">
  43. <div class="document">
  44. <div class="documentwrapper">
  45. <div class="bodywrapper">
  46. <div class="body">
  47. <div class="section" id="module-celery.datastructures">
  48. <h1>Datastructures - celery.datastructures<a class="headerlink" href="#module-celery.datastructures" title="Permalink to this headline">¶</a></h1>
  49. <p>Custom Datastructures</p>
  50. <dl class="class">
  51. <dt id="celery.datastructures.PositionQueue">
  52. <em class="property">
  53. class </em><tt class="descclassname">celery.datastructures.</tt><tt class="descname">PositionQueue</tt><big>(</big><em>length</em><big>)</big><a class="headerlink" href="#celery.datastructures.PositionQueue" title="Permalink to this definition">¶</a></dt>
  54. <dd><p>A positional queue of a specific length, with slots that are either
  55. filled or unfilled. When all of the positions are filled, the queue
  56. is considered <a title="celery.datastructures.PositionQueue.full" class="reference internal" href="#celery.datastructures.PositionQueue.full"><tt class="xref docutils literal"><span class="pre">full()</span></tt></a>.</p>
  57. <table class="docutils field-list" frame="void" rules="none">
  58. <col class="field-name" />
  59. <col class="field-body" />
  60. <tbody valign="top">
  61. <tr class="field"><th class="field-name">Parameter:</th><td class="field-body"><em>length</em> &#8211; see <a title="celery.datastructures.PositionQueue.length" class="reference internal" href="#celery.datastructures.PositionQueue.length"><tt class="xref docutils literal"><span class="pre">length</span></tt></a>.</td>
  62. </tr>
  63. </tbody>
  64. </table>
  65. <dl class="attribute">
  66. <dt id="celery.datastructures.PositionQueue.length">
  67. <tt class="descname">length</tt><a class="headerlink" href="#celery.datastructures.PositionQueue.length" title="Permalink to this definition">¶</a></dt>
  68. <dd>The number of items required for the queue to be considered full.</dd></dl>
  69. <dl class="class">
  70. <dt id="celery.datastructures.PositionQueue.UnfilledPosition">
  71. <em class="property">
  72. class </em><tt class="descname">UnfilledPosition</tt><big>(</big><em>position</em><big>)</big><a class="headerlink" href="#celery.datastructures.PositionQueue.UnfilledPosition" title="Permalink to this definition">¶</a></dt>
  73. <dd>Describes an unfilled slot.</dd></dl>
  74. <dl class="attribute">
  75. <dt id="celery.datastructures.PositionQueue.filled">
  76. <tt class="descclassname">PositionQueue.</tt><tt class="descname">filled</tt><a class="headerlink" href="#celery.datastructures.PositionQueue.filled" title="Permalink to this definition">¶</a></dt>
  77. <dd>Returns the filled slots as a list.</dd></dl>
  78. <dl class="method">
  79. <dt id="celery.datastructures.PositionQueue.full">
  80. <tt class="descclassname">PositionQueue.</tt><tt class="descname">full</tt><big>(</big><big>)</big><a class="headerlink" href="#celery.datastructures.PositionQueue.full" title="Permalink to this definition">¶</a></dt>
  81. <dd>Returns <tt class="xref docutils literal"><span class="pre">True</span></tt> if all of the slots has been filled.</dd></dl>
  82. </dd></dl>
  83. <dl class="class">
  84. <dt id="celery.datastructures.TaskProcessQueue">
  85. <em class="property">
  86. class </em><tt class="descclassname">celery.datastructures.</tt><tt class="descname">TaskProcessQueue</tt><big>(</big><em>limit</em>, <em>logger=None</em>, <em>done_msg=None</em><big>)</big><a class="headerlink" href="#celery.datastructures.TaskProcessQueue" title="Permalink to this definition">¶</a></dt>
  87. <dd><p>Queue of running child processes, which starts waiting for the
  88. processes to finish when the queue limit has been reached.</p>
  89. <table class="docutils field-list" frame="void" rules="none">
  90. <col class="field-name" />
  91. <col class="field-body" />
  92. <tbody valign="top">
  93. <tr class="field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first last simple">
  94. <li><em>limit</em> &#8211; see <a title="celery.datastructures.TaskProcessQueue.limit" class="reference internal" href="#celery.datastructures.TaskProcessQueue.limit"><tt class="xref docutils literal"><span class="pre">limit</span></tt></a> attribute.</li>
  95. <li><em>logger</em> &#8211; see <a title="celery.datastructures.TaskProcessQueue.logger" class="reference internal" href="#celery.datastructures.TaskProcessQueue.logger"><tt class="xref docutils literal"><span class="pre">logger</span></tt></a> attribute.</li>
  96. <li><em>done_msg</em> &#8211; see <a title="celery.datastructures.TaskProcessQueue.done_msg" class="reference internal" href="#celery.datastructures.TaskProcessQueue.done_msg"><tt class="xref docutils literal"><span class="pre">done_msg</span></tt></a> attribute.</li>
  97. </ul>
  98. </td>
  99. </tr>
  100. </tbody>
  101. </table>
  102. <dl class="attribute">
  103. <dt id="celery.datastructures.TaskProcessQueue.limit">
  104. <tt class="descname">limit</tt><a class="headerlink" href="#celery.datastructures.TaskProcessQueue.limit" title="Permalink to this definition">¶</a></dt>
  105. <dd>The number of processes that can run simultaneously until
  106. we start collecting results.</dd></dl>
  107. <dl class="attribute">
  108. <dt id="celery.datastructures.TaskProcessQueue.logger">
  109. <tt class="descname">logger</tt><a class="headerlink" href="#celery.datastructures.TaskProcessQueue.logger" title="Permalink to this definition">¶</a></dt>
  110. <dd>The logger used to print the <a title="celery.datastructures.TaskProcessQueue.done_msg" class="reference internal" href="#celery.datastructures.TaskProcessQueue.done_msg"><tt class="xref docutils literal"><span class="pre">done_msg</span></tt></a>.</dd></dl>
  111. <dl class="attribute">
  112. <dt id="celery.datastructures.TaskProcessQueue.done_msg">
  113. <tt class="descname">done_msg</tt><a class="headerlink" href="#celery.datastructures.TaskProcessQueue.done_msg" title="Permalink to this definition">¶</a></dt>
  114. <dd>Message logged when a tasks result has been collected.
  115. The message is logged with loglevel <tt class="xref docutils literal"><span class="pre">logging.INFO</span></tt>.</dd></dl>
  116. <dl class="method">
  117. <dt id="celery.datastructures.TaskProcessQueue.add">
  118. <tt class="descname">add</tt><big>(</big><em>result</em>, <em>task_name</em>, <em>task_id</em><big>)</big><a class="headerlink" href="#celery.datastructures.TaskProcessQueue.add" title="Permalink to this definition">¶</a></dt>
  119. <dd><p>Add a process to the queue.</p>
  120. <p>If the queue is full, it will start to collect return values from
  121. the tasks executed. When all return values has been collected,
  122. it deletes the current queue and is ready to accept new processes.</p>
  123. <table class="docutils field-list" frame="void" rules="none">
  124. <col class="field-name" />
  125. <col class="field-body" />
  126. <tbody valign="top">
  127. <tr class="field"><th class="field-name">Parameters:</th><td class="field-body"><ul class="first last simple">
  128. <li><em>result</em> &#8211; A <tt class="xref docutils literal"><span class="pre">multiprocessing.AsyncResult</span></tt> instance, as
  129. returned by <tt class="xref docutils literal"><span class="pre">multiprocessing.Pool.apply_async()</span></tt>.</li>
  130. <li><em>task_name</em> &#8211; Name of the task executed.</li>
  131. <li><em>task_id</em> &#8211; Id of the task executed.</li>
  132. </ul>
  133. </td>
  134. </tr>
  135. </tbody>
  136. </table>
  137. </dd></dl>
  138. </dd></dl>
  139. </div>
  140. </div>
  141. </div>
  142. </div>
  143. </div>
  144. <div class="sidebar">
  145. <h3>Contents</h3>
  146. <ul class="current">
  147. <li class="toctree-l1"><a class="reference external" href="../introduction.html">celery - Distributed Task Queue for Django.</a></li>
  148. <li class="toctree-l1 current"><a class="reference external" href="index.html">Module API Reference</a><ul class="current">
  149. <li class="toctree-l2"><a class="reference external" href="celery.task.html">Tasks - celery.task</a></li>
  150. <li class="toctree-l2"><a class="reference external" href="celery.result.html">Task Result - celery.result</a></li>
  151. <li class="toctree-l2"><a class="reference external" href="celery.registry.html">Task Registry - celery.registry</a></li>
  152. <li class="toctree-l2"><a class="reference external" href="celery.discovery.html">Task Discovery - celery.discovery</a></li>
  153. <li class="toctree-l2"><a class="reference external" href="celery.worker.html">Multiprocessing Worker - celery.worker</a></li>
  154. <li class="toctree-l2"><a class="reference external" href="celery.backends.html">Backends - celery.backends</a></li>
  155. <li class="toctree-l2"><a class="reference external" href="celery.backends.base.html">Backend: Base - celery.backends.base</a></li>
  156. <li class="toctree-l2"><a class="reference external" href="celery.backends.database.html">Backend: Database - celery.backends.database</a></li>
  157. <li class="toctree-l2"><a class="reference external" href="celery.backends.cache.html">Backend: Cache - celery.backends.cache</a></li>
  158. <li class="toctree-l2"><a class="reference external" href="celery.backends.tyrant.html">Backend: Tokyo Tyrant - celery.backends.tyrant</a></li>
  159. <li class="toctree-l2"><a class="reference external" href="celery.conf.html">Configuration - celery.conf</a></li>
  160. <li class="toctree-l2 current"><a class="current reference external" href="">Datastructures - celery.datastructures</a></li>
  161. <li class="toctree-l2"><a class="reference external" href="celery.log.html">Logging - celery.log</a></li>
  162. <li class="toctree-l2"><a class="reference external" href="celery.managers.html">Django Model Managers - celery.managers</a></li>
  163. <li class="toctree-l2"><a class="reference external" href="celery.models.html">Django Models - celery.models</a></li>
  164. <li class="toctree-l2"><a class="reference external" href="celery.messaging.html">Messaging - celery.messaging</a></li>
  165. <li class="toctree-l2"><a class="reference external" href="celery.platform.html">Platform Specific - celery.platform</a></li>
  166. <li class="toctree-l2"><a class="reference external" href="celery.timer.html">Timers - celery.timer</a></li>
  167. <li class="toctree-l2"><a class="reference external" href="celery.bin.celeryd.html">Celery Worker Daemon - celery.bin.celeryd</a></li>
  168. </ul>
  169. </li>
  170. </ul>
  171. <h3 style="margin-top: 1.5em;">Search</h3>
  172. <form class="search" action="../search.html" method="get">
  173. <input type="text" name="q" size="18" />
  174. <input type="submit" value="Go" />
  175. <input type="hidden" name="check_keywords" value="yes" />
  176. <input type="hidden" name="area" value="default" />
  177. </form>
  178. <p class="searchtip" style="font-size: 90%">
  179. Enter search terms or a module, class or function name.
  180. </p>
  181. </div>
  182. <div class="clearer"></div>
  183. </div>
  184. </div>
  185. <div class="footer-wrapper">
  186. <div class="footer">
  187. <div class="left">
  188. <a href="../genindex.html" title="General Index"
  189. >index</a> |
  190. <a href="../modindex.html" title="Global Module Index"
  191. >modules</a> |
  192. <a href="celery.log.html" title="Logging - celery.log"
  193. >next</a> |
  194. <a href="celery.conf.html" title="Configuration - celery.conf"
  195. >previous</a>
  196. <br/>
  197. <a href="../sources/reference/celery.datastructures.txt"
  198. rel="nofollow">Show Source</a>
  199. </div>
  200. <div class="right">
  201. &copy; Copyright 2009, Ask Solem.<br/>
  202. Created using <a href="http://sphinx.pocoo.org/">Sphinx</a> 0.6.1.
  203. </div>
  204. <div class="clearer"></div>
  205. </div>
  206. </div>
  207. </body>
  208. </html>