line_profiler

I've used Scalene at various times in the past few years, and always liked using it when I want to dig deeper compared to cProfile/profile. You might also want to look at: 1] https://github.com/joerick/pyinstrument 2] https://github.com/benfred/py-spy 3] https://github.com/P403n1x87/austin 4] https://github.com/bloomberg/memray 5] https://github.com/pyutils/line_profiler

I'm the co-author of High Performance Python, Micha and I are working on the 3rd ed (for 2025). Lots of bits of the book came from my past conference talks, they're available here (and the public talks will generally be on youtube): https://speakerdeck.com/ianozsvald Mostly that content has a scientific focus but the obvious thing that carries over to any part of Python is _profiling_ to figure out what's slow. Top tools I'd recommend are: * https://pypi.org/project/scalene/ combined cpu+memory+gpu profiling * https://github.com/gaogaotiantian/viztracer get a timeline of execution vs call-stack (great to discover what's happening deep inside pandas) * my https://pypi.org/project/ipython-memory-usage/ if you're in Jupyter Notebooks (built on https://github.com/pythonprofilers/memory_profiler which sadly is unmaintained) * https://github.co

LineProfiler is the best tool to learn how to write performant Python and do code optimization. https://github.com/pyutils/line_profiler You can literally see the hot spot of your code, then you can grind different algorithms or change the whole architecture to make it faster. For example replace short for loops to list comprehensions, vectorize all numpy operations (only vectorize partially do not help the issue), using 'not any()' instead or 'all()' for boolean, etc. Doing this for like 2 weeks, basically you can automatically recognize most bad code patterns at a glance.

Does line_profiler not work anymore? https://github.com/pyutils/line_profiler