Skip to content

Commit

Permalink
deploy: 9debc20
Browse files Browse the repository at this point in the history
  • Loading branch information
brifordwylie committed Mar 3, 2025
1 parent fcea782 commit fc6cd80
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 9 deletions.
16 changes: 8 additions & 8 deletions core_classes/artifacts/endpoint_core/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -5448,15 +5448,15 @@ <h2 id="workbench.core.artifacts.endpoint_core.EndpointCore" class="doc doc-head
</span><span id="__span-0-456"><a id="__codelineno-0-456" name="__codelineno-0-456"></a> <span class="n">deserializer</span><span class="o">=</span><span class="n">CSVDeserializer</span><span class="p">(),</span>
</span><span id="__span-0-457"><a id="__codelineno-0-457" name="__codelineno-0-457"></a> <span class="p">)</span>
</span><span id="__span-0-458"><a id="__codelineno-0-458" name="__codelineno-0-458"></a>
</span><span id="__span-0-459"><a id="__codelineno-0-459" name="__codelineno-0-459"></a> <span class="c1"># Now split up the dataframe into 500 row chunks, send those chunks to our</span>
</span><span id="__span-0-459"><a id="__codelineno-0-459" name="__codelineno-0-459"></a> <span class="c1"># Now split up the dataframe into 100 row chunks, send those chunks to our</span>
</span><span id="__span-0-460"><a id="__codelineno-0-460" name="__codelineno-0-460"></a> <span class="c1"># endpoint (with error handling) and stitch all the chunks back together</span>
</span><span id="__span-0-461"><a id="__codelineno-0-461" name="__codelineno-0-461"></a> <span class="n">df_list</span> <span class="o">=</span> <span class="p">[]</span>
</span><span id="__span-0-462"><a id="__codelineno-0-462" name="__codelineno-0-462"></a> <span class="n">total_rows</span> <span class="o">=</span> <span class="nb">len</span><span class="p">(</span><span class="n">eval_df</span><span class="p">)</span>
</span><span id="__span-0-463"><a id="__codelineno-0-463" name="__codelineno-0-463"></a> <span class="k">for</span> <span class="n">index</span> <span class="ow">in</span> <span class="nb">range</span><span class="p">(</span><span class="mi">0</span><span class="p">,</span> <span class="nb">len</span><span class="p">(</span><span class="n">eval_df</span><span class="p">),</span> <span class="mi">500</span><span class="p">):</span>
</span><span id="__span-0-464"><a id="__codelineno-0-464" name="__codelineno-0-464"></a> <span class="bp">self</span><span class="o">.</span><span class="n">log</span><span class="o">.</span><span class="n">info</span><span class="p">(</span><span class="sa">f</span><span class="s2">&quot;Processing </span><span class="si">{</span><span class="n">index</span><span class="si">}</span><span class="s2">:</span><span class="si">{</span><span class="nb">min</span><span class="p">(</span><span class="n">index</span><span class="o">+</span><span class="mi">500</span><span class="p">,</span><span class="w"> </span><span class="n">total_rows</span><span class="p">)</span><span class="si">}</span><span class="s2"> out of </span><span class="si">{</span><span class="n">total_rows</span><span class="si">}</span><span class="s2"> rows...&quot;</span><span class="p">)</span>
</span><span id="__span-0-463"><a id="__codelineno-0-463" name="__codelineno-0-463"></a> <span class="k">for</span> <span class="n">index</span> <span class="ow">in</span> <span class="nb">range</span><span class="p">(</span><span class="mi">0</span><span class="p">,</span> <span class="nb">len</span><span class="p">(</span><span class="n">eval_df</span><span class="p">),</span> <span class="mi">100</span><span class="p">):</span>
</span><span id="__span-0-464"><a id="__codelineno-0-464" name="__codelineno-0-464"></a> <span class="bp">self</span><span class="o">.</span><span class="n">log</span><span class="o">.</span><span class="n">info</span><span class="p">(</span><span class="sa">f</span><span class="s2">&quot;Processing </span><span class="si">{</span><span class="n">index</span><span class="si">}</span><span class="s2">:</span><span class="si">{</span><span class="nb">min</span><span class="p">(</span><span class="n">index</span><span class="o">+</span><span class="mi">100</span><span class="p">,</span><span class="w"> </span><span class="n">total_rows</span><span class="p">)</span><span class="si">}</span><span class="s2"> out of </span><span class="si">{</span><span class="n">total_rows</span><span class="si">}</span><span class="s2"> rows...&quot;</span><span class="p">)</span>
</span><span id="__span-0-465"><a id="__codelineno-0-465" name="__codelineno-0-465"></a>
</span><span id="__span-0-466"><a id="__codelineno-0-466" name="__codelineno-0-466"></a> <span class="c1"># Compute partial DataFrames, add them to a list, and concatenate at the end</span>
</span><span id="__span-0-467"><a id="__codelineno-0-467" name="__codelineno-0-467"></a> <span class="n">partial_df</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">_endpoint_error_handling</span><span class="p">(</span><span class="n">predictor</span><span class="p">,</span> <span class="n">eval_df</span><span class="p">[</span><span class="n">index</span> <span class="p">:</span> <span class="n">index</span> <span class="o">+</span> <span class="mi">500</span><span class="p">])</span>
</span><span id="__span-0-467"><a id="__codelineno-0-467" name="__codelineno-0-467"></a> <span class="n">partial_df</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">_endpoint_error_handling</span><span class="p">(</span><span class="n">predictor</span><span class="p">,</span> <span class="n">eval_df</span><span class="p">[</span><span class="n">index</span> <span class="p">:</span> <span class="n">index</span> <span class="o">+</span> <span class="mi">100</span><span class="p">])</span>
</span><span id="__span-0-468"><a id="__codelineno-0-468" name="__codelineno-0-468"></a> <span class="n">df_list</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">partial_df</span><span class="p">)</span>
</span><span id="__span-0-469"><a id="__codelineno-0-469" name="__codelineno-0-469"></a>
</span><span id="__span-0-470"><a id="__codelineno-0-470" name="__codelineno-0-470"></a> <span class="c1"># Concatenate the dataframes</span>
Expand Down Expand Up @@ -6771,15 +6771,15 @@ <h3 id="workbench.core.artifacts.endpoint_core.EndpointCore._predict" class="doc
</span><span id="__span-0-456"><a id="__codelineno-0-456" name="__codelineno-0-456"></a> <span class="n">deserializer</span><span class="o">=</span><span class="n">CSVDeserializer</span><span class="p">(),</span>
</span><span id="__span-0-457"><a id="__codelineno-0-457" name="__codelineno-0-457"></a> <span class="p">)</span>
</span><span id="__span-0-458"><a id="__codelineno-0-458" name="__codelineno-0-458"></a>
</span><span id="__span-0-459"><a id="__codelineno-0-459" name="__codelineno-0-459"></a> <span class="c1"># Now split up the dataframe into 500 row chunks, send those chunks to our</span>
</span><span id="__span-0-459"><a id="__codelineno-0-459" name="__codelineno-0-459"></a> <span class="c1"># Now split up the dataframe into 100 row chunks, send those chunks to our</span>
</span><span id="__span-0-460"><a id="__codelineno-0-460" name="__codelineno-0-460"></a> <span class="c1"># endpoint (with error handling) and stitch all the chunks back together</span>
</span><span id="__span-0-461"><a id="__codelineno-0-461" name="__codelineno-0-461"></a> <span class="n">df_list</span> <span class="o">=</span> <span class="p">[]</span>
</span><span id="__span-0-462"><a id="__codelineno-0-462" name="__codelineno-0-462"></a> <span class="n">total_rows</span> <span class="o">=</span> <span class="nb">len</span><span class="p">(</span><span class="n">eval_df</span><span class="p">)</span>
</span><span id="__span-0-463"><a id="__codelineno-0-463" name="__codelineno-0-463"></a> <span class="k">for</span> <span class="n">index</span> <span class="ow">in</span> <span class="nb">range</span><span class="p">(</span><span class="mi">0</span><span class="p">,</span> <span class="nb">len</span><span class="p">(</span><span class="n">eval_df</span><span class="p">),</span> <span class="mi">500</span><span class="p">):</span>
</span><span id="__span-0-464"><a id="__codelineno-0-464" name="__codelineno-0-464"></a> <span class="bp">self</span><span class="o">.</span><span class="n">log</span><span class="o">.</span><span class="n">info</span><span class="p">(</span><span class="sa">f</span><span class="s2">&quot;Processing </span><span class="si">{</span><span class="n">index</span><span class="si">}</span><span class="s2">:</span><span class="si">{</span><span class="nb">min</span><span class="p">(</span><span class="n">index</span><span class="o">+</span><span class="mi">500</span><span class="p">,</span><span class="w"> </span><span class="n">total_rows</span><span class="p">)</span><span class="si">}</span><span class="s2"> out of </span><span class="si">{</span><span class="n">total_rows</span><span class="si">}</span><span class="s2"> rows...&quot;</span><span class="p">)</span>
</span><span id="__span-0-463"><a id="__codelineno-0-463" name="__codelineno-0-463"></a> <span class="k">for</span> <span class="n">index</span> <span class="ow">in</span> <span class="nb">range</span><span class="p">(</span><span class="mi">0</span><span class="p">,</span> <span class="nb">len</span><span class="p">(</span><span class="n">eval_df</span><span class="p">),</span> <span class="mi">100</span><span class="p">):</span>
</span><span id="__span-0-464"><a id="__codelineno-0-464" name="__codelineno-0-464"></a> <span class="bp">self</span><span class="o">.</span><span class="n">log</span><span class="o">.</span><span class="n">info</span><span class="p">(</span><span class="sa">f</span><span class="s2">&quot;Processing </span><span class="si">{</span><span class="n">index</span><span class="si">}</span><span class="s2">:</span><span class="si">{</span><span class="nb">min</span><span class="p">(</span><span class="n">index</span><span class="o">+</span><span class="mi">100</span><span class="p">,</span><span class="w"> </span><span class="n">total_rows</span><span class="p">)</span><span class="si">}</span><span class="s2"> out of </span><span class="si">{</span><span class="n">total_rows</span><span class="si">}</span><span class="s2"> rows...&quot;</span><span class="p">)</span>
</span><span id="__span-0-465"><a id="__codelineno-0-465" name="__codelineno-0-465"></a>
</span><span id="__span-0-466"><a id="__codelineno-0-466" name="__codelineno-0-466"></a> <span class="c1"># Compute partial DataFrames, add them to a list, and concatenate at the end</span>
</span><span id="__span-0-467"><a id="__codelineno-0-467" name="__codelineno-0-467"></a> <span class="n">partial_df</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">_endpoint_error_handling</span><span class="p">(</span><span class="n">predictor</span><span class="p">,</span> <span class="n">eval_df</span><span class="p">[</span><span class="n">index</span> <span class="p">:</span> <span class="n">index</span> <span class="o">+</span> <span class="mi">500</span><span class="p">])</span>
</span><span id="__span-0-467"><a id="__codelineno-0-467" name="__codelineno-0-467"></a> <span class="n">partial_df</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">_endpoint_error_handling</span><span class="p">(</span><span class="n">predictor</span><span class="p">,</span> <span class="n">eval_df</span><span class="p">[</span><span class="n">index</span> <span class="p">:</span> <span class="n">index</span> <span class="o">+</span> <span class="mi">100</span><span class="p">])</span>
</span><span id="__span-0-468"><a id="__codelineno-0-468" name="__codelineno-0-468"></a> <span class="n">df_list</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">partial_df</span><span class="p">)</span>
</span><span id="__span-0-469"><a id="__codelineno-0-469" name="__codelineno-0-469"></a>
</span><span id="__span-0-470"><a id="__codelineno-0-470" name="__codelineno-0-470"></a> <span class="c1"># Concatenate the dataframes</span>
Expand Down
2 changes: 1 addition & 1 deletion search/search_index.json

Large diffs are not rendered by default.

0 comments on commit fc6cd80

Please sign in to comment.