-
Notifications
You must be signed in to change notification settings - Fork 27
/
README.tmpl
449 lines (346 loc) · 19.5 KB
/
README.tmpl
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
![Example]({{ content_url }}/header.png)
<h2 align="center">Python Traceback (Error Message) Printing Variables</h2>
<p align="center">Very simple to use, but versatile when needed. Try for debug and keep for production.</p>
<p align="center">
<a href="{{ repo_url }}/actions"><img alt="Actions Status" src="{{ repo_url }}/workflows/tests/badge.svg"></a>
<a href="{{ repo_url }}/blob/master/.github/workflows/master-test.yml#L59"><img title="code tests coverage is 100%" alt="code tests coverage is 100%" src="https://img.shields.io/badge/coverage-100%25-brightgreen.svg"></a>
<a href="{{ code_url }}/LICENSE"><img alt="License: MIT" src="https://img.shields.io/github/license/{{ user_repo_name }}?color=informational"></a>
<a href="https://pepy.tech/project/traceback-with-variables"><img alt="Downloads" src="https://static.pepy.tech/badge/traceback-with-variables"></a>
<a href="{{ pypi_url }}"><img alt="PyPI" src="https://img.shields.io/pypi/v/{{ package_name }}"></a>
<a href="https://anaconda.org/conda-forge/{{ package_name }}"><img src="https://img.shields.io/conda/vn/conda-forge/{{ package_name }}"></a>
<a href="{{ pypi_url }}"><img alt="PyPI" src="https://img.shields.io/badge/python-3.6+-blue.svg"></a>
<a href="https://superuser.com/questions/413073/windows-console-with-ansi-colors-handling"><img title="windows, mac, linux etc." alt="Platform" src="https://img.shields.io/badge/platform-all-blue.svg"></a>
<a href="{{ lib_code_url }}/override.py#L9"><img title="type hints everywhere" alt="Annotations coverage" src="https://img.shields.io/badge/type--hints-100%25-blueviolet.svg"></a>
<a href="{{ lib_code_url }}/override.py#L8"><img title="no obscure objects, only transparent functions and data classes" alt="No-OOP" src="https://img.shields.io/badge/no OOP-100%25-blueviolet.svg"></a>
<a href="{{ code_url }}/setup.py"><img alt="Dependencies" src="https://img.shields.io/badge/dependencies-0-blueviolet.svg"></a>
<a href="https://colab.research.google.com/github/{{ user_repo_name }}/blob/master/examples/colab.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/></a>
<a href="{{ gitter_url }}"><img alt="Gitter" src="https://img.shields.io/gitter/room/{{ user_name }}/{{ package_name }}?color=blueviolet"></a>
<!--
<a href="{{ pypi_url }}"><img alt="pip Downloads" src="https://static.pepy.tech/personalized-badge/{{ package_name }}?period=total&units=none&left_color=grey&right_color=orange&left_text=pip downloads"></a>
<a href="https://anaconda.org/conda-forge/{{ package_name }}/"><img alt="conda-forge Downloads" src="https://img.shields.io/conda/dn/conda-forge/{{ package_name }}?color=orange&label=conda%20downloads"></a>
-->
</p>
<br/>
> “It is useless work that darkens the heart.”
> <em>– Ursula K. Le Guin</em>
Tired of useless job of putting all your variables into debug exception messages? Just stop it.
Automate it and clean your code. Once and for all.
---
_Contents:_ **[Installation](#installation)** | **[🚀 Quick Start](#-quick-start)**
| **[Colors](#colors)**
| **[How does it save my time?](#how-does-it-save-my-time)** |
**[Examples and recipes](#examples-and-recipes)** | **[Reference](#reference)**
| **[FAQ](#faq)**
---
> :warning: **I'm open to update this module to meet new use cases and to make using it easier and fun**: so any proposal or advice or warning is very welcome and will be taken into account of course. When I started it I wanted to make a tool meeting all standard use cases. I think in this particular domain this is rather achievable, so I'll try. Note `next_version` branch also. Have fun!
---
### Installation
```
pip install traceback-with-variables=={{ version }}
```
```
conda install -c conda-forge traceback-with-variables
```
to use shorter `tb` alias in interactive mode call this once:
```
python3 -c 'from traceback_with_variables.tb_alias import create_tb_alias as c; c()'
```
### 🚀 Quick Start
Using without code editing, <a href="{{ examples_code_url }}/external_script.sh">running your script/command/module</a>:
```
traceback-with-variables tested_script.py ...srcipt's args...
```
<a href="{{ examples_code_url }}/simple.py">Simplest usage</a>, for the whole program:
```python
from {{ import_name }} import activate_by_import
```
or just (if you added an alias by the above command)
```python
import tb.a
```
<a href="{{ examples_code_url }}/print_for_function.py">Decorator</a>, for a single function:
```python
@prints_exc
# def main(): or def some_func(...):
```
<a href="{{ examples_code_url }}/print_for_code_block.py">Context</a>, for a single code block:
```python
with printing_exc():
```
<a href="{{ examples_code_url }}/work_with_traceback_lines.py">Work with traceback lines</a> in a custom manner:
```python
lines = list(iter_exc_lines(e))
```
<a href="{{ examples_code_url }}/print_cur_tb.py">No exception but you want to print the stack anyway?</a>:
```python
print_cur_tb()
```
Using a logger [<a href="{{ examples_code_url }}/log_for_function.py">with a decorator</a>, <a href="{{ examples_code_url }}/log_for_code_block.py">with a context</a>]:
```python
with printing_exc(file_=LoggerAsFile(logger)):
# or
@prints_exc(file_=LoggerAsFile(logger)):
```
<a href="{{ examples_code_url }}/print_traceback.py">Print traceback</a> in interactive mode after an exception:
```
>>> print_exc()
```
<a href="{{ examples_code_url }}/format_customized.py">Customize</a> any of the previous examples:
```python
fmt.max_value_str_len = 10000
fmt.skip_files_except = 'my_project'
```
### Colors
![Example]({{ content_url }}/color_schemes.png)
### How does it save my time?
* Turn a code totally covered by debug formatting from this:
```diff
def main():
sizes_str = sys.argv[1]
h1, w1, h2, w2 = map(int, sizes_str.split())
- try:
return get_avg_ratio([h1, w1], [h2, w2])
- except:
- logger.error(f'something happened :(, variables = {locals()[:1000]}')
- raise
- # or
- raise MyToolException(f'something happened :(, variables = {locals()[:1000]}')
def get_avg_ratio(size1, size2):
- try:
return mean(get_ratio(h, w) for h, w in [size1, size2])
- except:
- logger.error(f'something happened :(, size1 = {size1}, size2 = {size2}')
- raise
- # or
- raise MyToolException(f'something happened :(, size1 = {size1}, size2 = {size2}')
def get_ratio(height, width):
- try:
return height / width
- except:
- logger.error(f'something happened :(, width = {width}, height = {height}')
- raise
- # or
- raise MyToolException(f'something happened :(, width = {width}, height = {height}')
```
into this (zero debug code):
```diff
+ from {{ import_name }} import activate_by_import
def main():
sizes_str = sys.argv[1]
h1, w1, h2, w2 = map(int, sizes_str.split())
return get_avg_ratio([h1, w1], [h2, w2])
def get_avg_ratio(size1, size2):
return mean(get_ratio(h, w) for h, w in [size1, size2])
def get_ratio(height, width):
return height / width
```
And obtain total debug info spending 0 lines of code:
```
Traceback with variables (most recent call last):
File "./temp.py", line 7, in main
return get_avg_ratio([h1, w1], [h2, w2])
sizes_str = '300 200 300 0'
h1 = 300
w1 = 200
h2 = 300
w2 = 0
File "./temp.py", line 10, in get_avg_ratio
return mean([get_ratio(h, w) for h, w in [size1, size2]])
size1 = [300, 200]
size2 = [300, 0]
File "./temp.py", line 10, in <listcomp>
return mean([get_ratio(h, w) for h, w in [size1, size2]])
.0 = <tuple_iterator object at 0x7ff61e35b820>
h = 300
w = 0
File "./temp.py", line 13, in get_ratio
return height / width
height = 300
width = 0
builtins.ZeroDivisionError: division by zero
```
* Automate your logging too:
```python
logger = logging.getLogger('main')
def main():
...
with printing_exc(file_=LoggerAsFile(logger))
...
```
```
2020-03-30 18:24:31 main ERROR Traceback with variables (most recent call last):
2020-03-30 18:24:31 main ERROR File "./temp.py", line 7, in main
2020-03-30 18:24:31 main ERROR return get_avg_ratio([h1, w1], [h2, w2])
2020-03-30 18:24:31 main ERROR sizes_str = '300 200 300 0'
2020-03-30 18:24:31 main ERROR h1 = 300
2020-03-30 18:24:31 main ERROR w1 = 200
2020-03-30 18:24:31 main ERROR h2 = 300
2020-03-30 18:24:31 main ERROR w2 = 0
2020-03-30 18:24:31 main ERROR File "./temp.py", line 10, in get_avg_ratio
2020-03-30 18:24:31 main ERROR return mean([get_ratio(h, w) for h, w in [size1, size2]])
2020-03-30 18:24:31 main ERROR size1 = [300, 200]
2020-03-30 18:24:31 main ERROR size2 = [300, 0]
2020-03-30 18:24:31 main ERROR File "./temp.py", line 10, in <listcomp>
2020-03-30 18:24:31 main ERROR return mean([get_ratio(h, w) for h, w in [size1, size2]])
2020-03-30 18:24:31 main ERROR .0 = <tuple_iterator object at 0x7ff412acb820>
2020-03-30 18:24:31 main ERROR h = 300
2020-03-30 18:24:31 main ERROR w = 0
2020-03-30 18:24:31 main ERROR File "./temp.py", line 13, in get_ratio
2020-03-30 18:24:31 main ERROR return height / width
2020-03-30 18:24:31 main ERROR height = 300
2020-03-30 18:24:31 main ERROR width = 0
2020-03-30 18:24:31 main ERROR builtins.ZeroDivisionError: division by zero
```
* Free your exceptions of unnecessary information load:
```python
def make_a_cake(sugar, eggs, milk, flour, salt, water):
is_sweet = sugar > salt
is_vegan = not (eggs or milk)
is_huge = (sugar + eggs + milk + flour + salt + water > 10000)
if not (is_sweet or is_vegan or is_huge):
raise ValueError('This is unacceptable, look why!')
...
```
* — Should I use it after debugging is over, i.e. *in production*?
Yes, of course! That way it might save you even more time (watch out for sensitive data
like passwords and tokens in you logs, use skip_files_except to hide code from libs AND custom_var_printers to hide own locals). Note: you can deploy more serious frameworks, e.g. `Sentry`
<br/>
* Stop this tedious practice in production:
step 1: Notice some exception in a production service. \
step 2: Add more printouts, logging, and exception messages. \
step 3: Rerun the service. \
step 4: Wait till (hopefully) the bug repeats. \
step 5: Examine the printouts and possibly add some more info (then go back to step 2). \
step 6: Erase all recently added printouts, logging and exception messages. \
step 7: Go back to step 1 once bugs appear.
### Examples and recipes
* <a href="{{ examples_code_url }}/external_script.sh">run python code without changes: a script, a module, a commnad</a>
* <a href="{{ examples_code_url }}/simple.py">simple usage</a>
* <a href="{{ examples_code_url }}/simple_jupyter.py">simple usage in Jupyter or IPython</a>
* <a href="{{ examples_code_url }}/print_cur_tb.py">print current stack, when there's no exception</a>
* <a href="{{ examples_code_url }}/interactive_print_last_exception.py">print last exception in Python console</a>
* <a href="{{ examples_code_url }}/change_global_printer.py">manually change global printer</a>
* <a href="{{ examples_code_url }}/change_global_printer_in_jupyter.py">manually change global printer in Jupyter or IPython</a>
* <a href="{{ examples_code_url }}/print_for_function.py">working with a function</a>
* <a href="{{ examples_code_url }}/log_for_function.py">working with a function, logging</a>
* <a href="{{ examples_code_url }}/print_for_code_block.py">working with a code block</a>
* <a href="{{ examples_code_url }}/log_for_code_block.py">working with a code block, logging</a>
* <a href="{{ examples_code_url }}/work_with_traceback_lines.py">get traceback lines for custom things</a>
* <a href="{{ examples_code_url }}/flask.py">using with `flask`</a>
* <a href="{{ examples_code_url }}/format_customized.py">customize the output</a>
### Reference
#### All functions have `fmt=` argument, a `Format` object with fields:
* `max_value_str_len` max length of each variable string, -1 to disable, default=1000
* `objects_details` depth of details of objects inspection
* `ellipsis_rel_pos` when truncating long strings where to put the "...", from 0.0 to 1.0, default=0.7
* `max_exc_str_len` max length of exception, should variable print fail, -1 to disable, default=10000
* `before` number of code lines before the raising line, default=0
* `after` number of code lines after the raising line, default=0
* `ellipsis_` string to denote long strings truncation, default=`...`
* `skip_files_except` use to print only certain files; list of regexes, ignored if empty, default=None
* `brief_files_except` use to print variables only in certain files; list of regexes, ignored if empty, default=None
* `custom_var_printers` list of pairs of (filter, printer); filter is a name fragment, a type or a function or a list thereof; printer returns `None` to skip a var
* `color_scheme` is `None` or one of <a href="{{ lib_code_url }}/color.py">`ColorSchemes`</a>: `.none` , `.common`, `.nice`, `.synthwave`. `None` is for auto-detect
---
#### <a href="{{ lib_code_url }}/activate_by_import.py">`activate_by_import`</a>
Just import it. No arguments, for real quick use in regular Python.
```python
from {{ import_name }} import activate_by_import
```
---
#### <a href="{{ lib_code_url }}/activate_in_ipython_by_import.py">`activate_in_ipython_by_import`</a>
Just import it. No arguments, for real quick use in Jupyter or IPython.
```python
from {{ import_name }} import activate_in_ipython_by_import
```
---
#### <a href="{{ lib_code_url }}/global_hooks.py">`global_print_exc`</a>
Call once in the beginning of your program, to change how traceback after an uncaught exception looks.
```python
def main():
override_print_exc(...)
```
---
#### <a href="{{ lib_code_url }}/global_hooks.py">`global_print_exc_in_ipython`</a>
Call once in the beginning of your program, to change how traceback after an uncaught exception looks.
```python
def main():
override_print_exc(...)
```
---
#### <a href="{{ lib_code_url }}/print.py">`print_exc`</a>
Prints traceback for a given/current/last (first being not `None` in the priority list) exception to a file, default=`sys.stderr`. Convenient for manual console or Jupyter sessions or custom try/except blocks. Note that it can be called with a given exception value or it can auto discover current exception in an `except:` block or it can auto descover last exception value (long) after `try/catch` block.
```python
print_exc()
```
---
#### <a href="{{ lib_code_url }}/print.py">`print_cur_tb`</a>
Prints current traceback when no exception is raised.
```python
print_cur_tb()
```
---
#### <a href="{{ lib_code_url }}/print.py">`prints_exc`</a>
Function decorator, used for logging or simple printing of scoped tracebacks with variables. I.e. traceback is shorter as it includes only frames inside the function call. Program exiting due to unhandled exception still prints a usual traceback.
```python
@prints_exc
def f(...):
@prints_exc(...)
def f(...):
```
---
#### <a href="{{ lib_code_url }}/print.py">`printing_exc`</a>
Context manager (i.e. `with ...`), used for logging or simple printing of scoped tracebacks with variables. I.e. traceback is shorter as it includes only frames inside the `with` scope. Program exiting due to unhandled exception still prints a usual traceback.
```python
with printing_exc(...):
```
---
#### <a href="{{ lib_code_url }}/print.py">`LoggerAsFile`</a>
A logger-to-file wrapper, to pass a logger to print tools as a file.
---
#### <a href="{{ lib_code_url }}/core.py">`iter_exc_lines`</a>
Iterates the lines, which are usually printed one-by-one in terminal.
---
#### <a href="{{ lib_code_url }}/core.py">`format_exc`</a>
Like `iter_exc_lines` but returns a single string.
---
#### <a href="{{ lib_code_url }}/core.py">`iter_cur_tb_lines`</a>
Like `iter_exc_lines` but doesn't need an exception and prints upper frames..
---
#### <a href="{{ lib_code_url }}/core.py">`format_cur_tb`</a>
Like `iter_cur_tb_lines` but returns a single string.
---
### FAQ
* In Windows console crash messages have no colors.
The default Windows console/terminal cannot print [so called *ansi*] colors, but this is
<a href="https://superuser.com/questions/413073/windows-console-with-ansi-colors-handling">fixable</a>
, especially with modern Windows versions. Therefore colors are disabled by default,
but you can enable them and check if it works in your case.
You can force enable colors by passing `--color-scheme common` (for complete list of colors pass `--help`) console argument.
* Windows console prints junk symbols when colors are enabled.
The default Windows console/terminal cannot print [so called *ansi*] colors, but this is
<a href="https://superuser.com/questions/413073/windows-console-with-ansi-colors-handling">fixable</a>
, especially with modern Windows versions. If for some reason the colors are wrongly enabled by default,
you can force disable colors by passing `--color-scheme none` console argument.
* Bash tools like grep sometimes fail to digest the output when used with pipes (`|`) because of colors.
Please disable colors by passing `--color-scheme none` console argument.
The choice for keeping colors in piped output was made to allow convenient usage of `head`, `tail`, file redirection etc.
In cases like `| grep` it might have issues, in which case you can disable colors.
* Output redirected to a file in `> output.txt` manner has no colors when I `cat` it.
This is considered a rare use case, so colors are disabled by default when outputting to a file.
But you can force enable colors by passing `--color-scheme common` (for complete list of colors pass `--help`) console argument.
* `activate_by_import` or `global_print_exc` don't work in Jupyter or IPython as if not called at all.
In Jupyter or IPython you should use `activate_in_ipython_by_import` or `global_print_exc_in_ipython`. IPython handles exceptions differently than regular Python.
* The server framework (`flask`, `streamlit` etc.) still shows usual tracebacks.
In such frameworks tracebacks are printed not while exiting the program (the program continues running), hence you should override exception handling in a manner
proper for the given framework. Please address the `flask` example.
* How do I reduce output? I don't need all files or all variables.
Use `skip_files_except`, `brief_files_except`, `custom_var_printers` to cut excess output.
* I have ideas about good colors.
Please fork, add a new `ColorScheme` to <a href="{{ lib_code_url }}/color.py">`ColorSchemes`</a>
and create a Pull Request to `next_version` branch. <a href="https://en.wikipedia.org/wiki/ANSI_escape_code">Choose the color codes</a> and visually
test it like `python3 -m traceback_with_variables.main --color-scheme {its name} examples/for_readme_image.py`.
* My code doesn't work.
Please <a href="{{ gitter_url }}">post your case</a>. You are very welcome!
* Other questions or requests to elaborate answers.
Please <a href="{{ gitter_url }}">post your question or request</a>. You are very welcome!