Tootfinder

#Python Friday #224: Better HTTP Status Codes for #FastAPI
https://impro…

Python Friday #224: Better HTTP Status Codes for FastAPI - Improve & Repeat
FastAPI let us set the proper HTTP status codes for our responses. Let see how we can set the status code explicitly.

If you are learning Python, I'm making a clicker-style game (but that doesn't threaten the lifespan of your mouse) at 1400 BST (1300 UTC).
Live coding: Cookie clicker, but without clicking (or cookies) #python #...
https://

No, #Python, this really is a gotcha, and a stupid one at that.
https://docs.python-guide.org/writing/gotchas/#mutable-default-arguments

Common Gotchas — The Hitchhiker's Guide to Python

Now in #Python discussion forums: #Apple apparently has some broken auto-review that rejects everything including Python, because of — apparently — `itms-services://` occurring inside Python's standard library (in tests).
#GAFAM

Before I start churning out my pre-PyCon releases, how about a build-and-inspect-python-package that adds GitHub-style build provenance attestations by just adding one setting (and one permission)!? #python
https://…

Release v2.5.0 · hynek/build-and-inspect-python-package
Added New input: attest-build-provenance-github generates signed build provenance attestations for workflow artifacts. #122

Whow, #Python leads the current Tiobe Index by a wide margin: https://python-basics-tutorial.readthedocs.io/en/latest/intro.html

Missing: a :python: #Python package to make flowcharts with #pythonRich, i.e. to draw arrows between (auto-arranged) renderables.
https://g…

GitHub - Textualize/rich: Rich is a Python library for rich text and beautiful formatting in the terminal.
Rich is a Python library for rich text and beautiful formatting in the terminal. - Textualize/rich

#Python's many command-line utilities
https://www.pythonmorsels.com/cli-tools/

El gran problema de #python es el puto indentado. Si llegas a combinar tabulación y espacios todo se vuelve un caos 😫

So, looks like the way the Python `requests` module parses string arrays into parameters was very different than what the NWS API was looking for so I was only getting `Severe` watches and warnings and none of the `Extreme` ones. It's already been a busy morning...lol. #python #weather

I've added `dev-python/legacy-cgi` to #Gentoo, as a "forward-port" of the removed #Python `cgi` (and `cgitb`) module to Python 3.13. That said, it's only a stop-gap solution to make semi-dead packages work and not something you should rely on, so it's marked as deprecated immediately after being added.
Also, ideally please avoid keeping it installed in your dev environments. Once installed, all `import cgi` statements will suddenly start working, so you're going to miss Python 3.13 incompatibility issues (and therefore miss the dependency on this package).

Czasem ludzie się mnie pytają, dlaczego stabilizuję paczki Pythona w #Gentoo po dwóch tygodniach, zamiast typowych czterech.
Odpowiedź jest prosta: oczekiwać, że testy w paczkach Pythona nadal będą działać cztery tygodnie po wydaniu to trochę dużo.
#Python

Video tutorials for modern ideas and open source tools. #python

Code. Simply. Clearly. Calmly.
Short and simple video lessons that start from scratch. Tools and thoughts that might make your professional life more enjoyable.

Note to self: Between #QGIS versions 3.34.5 and 3.34.6, the packaging for the #Windows version of QGIS changed from #Python 3.9 to Python 3.12.
Will have to test if/how

Oslandia / QGIS / QDuckDB · GitLab
Documentation: https://oslandia.gitlab.io/qgis/qduckdb/

#Python Friday #231: Split a #FastAPI Application Into Manageable Parts
https://

Why should folks doing #Development use test-driven development?
I wrote a #Python utility to help me collect and manage systems from a variety of platforms. Originally it started as a one-off so I wasn't concerned about tests, but the code continued to grow as …

There is a new version, 0.4.8 of aiocoap, the asynchronous #Python library for #CoAP.
Nothing fancy in terms of features, but some improvements on error handling, type annotations (#mypy has joined CI) and platfor…

Technically, a large part of what amounts to #Gentoo #Python 3.13 porting could be automated. In fact, we already have most of the pieces — tooling to find next candidates, update PYTHON_COMPAT, run tests. Why do I do it semi-manually then?
Well, for a start it gives me an opportunity to look into the ebuilds. Look for old issues, improve code, sometimes discover we ought to have removed something a long time ago. At the same time, looking at build logs also sometimes makes me notice incorrectly working tests (particularly, tests not failing correctly on failure).
Not to mention it gives me a bit of purpose when the damn fever prevents me from doing anything requiring more focus.

If anyone wants to come hang out with me later, I am giving a short "Crafting Intelligent Python Apps with Retrieval-Augmented Generation" talk online at 12:30 (Milwaukee time)
#AI #RAG #Python

Teaching #Python folks the joys of clear and explicit object type definitions. An interesting experience...
#Programming

Kann man in #Python eigentlich Variablen z.B. mit #Redis oder anderen Key-Value-Stores ersetzen und dabei so wenig Code wie möglich verändern?
Sodass die Variablen sozusagen auf allen Servern in Echtzeit den gleichen Wert haben?

Ah, things I found interesting...
- Figuring out if there are `NaN` numbers in a Python list: `any(i != i for i in float_list)`.
- Replacing single newlines while ignoring double newlines: `"\n\n".join([i.replace("\n", ' ') for i in cool_string.split("\n\n")])`
#python

Wait, what? Building #Linux now (e.g. since [1], which is in 6.10-rc1) requires #python[2]? At least when building the msm graphics driver? Uhh, interesting. 🧐
[1]

Note to self: Between #QGIS versions 3.34.5 and 3.34.6, the packaging for the #Windows version of QGIS changed from #Python 3.9 to Python 3.12.
Will have to test if/how

Oslandia / QGIS / QDuckDB · GitLab
Documentation: https://oslandia.gitlab.io/qgis/qduckdb/

Great, #IPython finally fixed #PyTest 8 compatibility.
Oh, wait… they've just fixed one trivial issue and declared it fixed, without actually testing at all or looking at the bugs already reported. Quality work!
#Gentoo #Python

#Python Friday #228: HTTP Basic #Authentication in #FastAPI #security

Python Friday #228: HTTP Basic Authentication in FastAPI - Improve & Repeat
The HTTP basic authentication is a good entry point on how to restrict access to a FastAPI endpoint while everything works in the browser.

Ćwiczenie na dziś: ile paczek #Gentoo uda się sportować do Pythona 3.13 w czasie, który potrzeba na zbudowaniu paczek binarnych dla nowych jąder.
Następne w kolejce jest ćwiczenie trudnego `git rebase`.
#Python

🧮 50x faster conda environment solving with "sharded" repodata
(… nice to see that Python packaging systems are finally discovering that cache matters!)
https://prefix.dev/blog/sharded_repodata

The available open source libraries for generating human models (MakeHuman, ManuelBastioniLab) appear to be written in #Python. I need something like this, but I'm working primarily in #Clojure. I'm wondering whether it would be easier to load one of the existing libraries into Jython and try to …

Kann man #Python eigentlich auf einem alten #Android Handy laufen lassen?
Bestimmt, oder? 🤔
Und Cron-Jobs?
Bestimmt, oder? 🤔

One thing that #python has on #ruby is that - to my eyes - I can write a mess of spaghetti code without running it in python and think "I think this is going to work."
Of course, running it is key...

Come for wisdom on tox & Nox – stay for unrelated gems that will improve your life! #python #video
https://youtu.be/ImBvrDvK-1U

If anyone is still wondering whether #setuptools is a good #PEP517 build system, let me point out that right now it vendors… (checks notes) 12 packages, including two different versions of more-itertools.
Of these packages, 5 use setuptools and 1 uses hatchling. Ironically, it's the packages maintained by setuptools upstream that use the former and therefore introduce cyclic dependencies. Third parties seem to be more concerned that their packages are used by setuptools and therefore should use minimal build systems to avoid the cyclic dependency problem.
In other news, setuptools finally acknowledged the cyclic bootstrap problem with `wheel`, and started vendoring it.
#Gentoo #Python

I think I have finally™️ (for the third or so time) found myself a solution for :python: #Python development on :nixos: #NixOS that allows me to just work with #pythonPoetry et. al. as on other distros.

fhs.nix · main · Yann Büchau / 📦 Yanns NixOS Config · GitLab
My NixOS Config

BeeTeeDubs, I'm going live in ten with a #LiveCoding #Python Tutorial drawing flags with turtle graphics.
Really it's about abstraction and decomposition.
#ComputerScience

#Python Friday #230: Fix the PydanticJsonSchemaWarning in #FastAPI
https://

Severe Thunderstorm Watch here in Charleston, SC, which means it's time to breakout the NWS program...now using `webfsd` to serve the generated images. I am skipping a few types of events, but it's nice to have a real-time thread of watches/warnings as they come in. #weather #python

#Python
As I'm working on my #networking diagnostic script which relies on my OS abstraction layer for system information I built a number of years back, I decided it would make more sense to formally port this API up to pypi as a standalone library. (It doesn…

These is one of these days when it occurs to you: "hey, packages using #Python and #RustLang, may have *both* Python and Cargo-level tests." And then you spend a lot of time going over all Rust-enabled dev-python/* packages and adding `cargo_src_test` where appropriate.
As it turns out, many of them did. Most of these don't actually link to libpython, so I suppose it's fine to test them once. Pydantic-core does, so I test per-impl (but also can't test on PyPy). Cryptography has Rust-level tests that don't even build (they fail at linking).
#Gentoo

Po kolejnej rundzie portów do Pythona 3.13 w #Gentoo, przychodzi mi do głowy ten mem z wielką, zatłoczoną autostradą, tyle że z komentarz:
Tylko jeszcze jeden microframework! Obiecuję wam, jeszcze jeden microframework i wszystkie problemy zostaną rozwiązane!
#Python

I'm close to having @… sorted out. With a new API comes slightly different data points. #python

Time for your daily dose of #RustLang complaints. Yep, the ecosystem is doing great.
#UV depends on tokio-tar library. Tokio-tar is broken on #PowerPC, doesn't have a bug tracker (!) and seems to be quite dead, with a bunch of PRs ignored since 2022 (last activity mid-2023). Nevertheless, I've filed a PR to fix PowerPC, with little hope that it'll be merged, released and that we could get UV working on PowerPC.
On top of that, it seems that tokio-tar was forked in early 2021 from async-tar. It doesn't seem to have synced the few commits from 2021, and async-tar is dead since late 2021. But at least it has a bug tracker to keep track of how dead it is.
Rewriting stuff in Rust is great. Maintaining it afterwards for the sake of reverse dependencies isn't.
#Gentoo #Python

#Python Friday #225: Set a Response Header With #FastAPI
https://improvean…

Hübscher Kommentar im #Quellcode:
# Erstelle eine schöne XML-Struktur
#python 🤪

Made it safely to #PyDataLondon tutorials! Now attending Adam Hill's one on #Prefect #python #pydata

Hrmm, this might be a slight issue...pretty sure the map shouldn't be "generic white box"... #python

One more thing about porting #Gentoo packages to a new #Python version is that every time you discover how many *new* packages are now abandoned and broken. However, the rate at which packages are abandoned is not what's most the most terrifying thing — it's how many other packages still use these packages, years after the last commit, years after distro developers had to start patching them to have them work at all.
I'm talking of clint (2015), I'm talking of passlib (2020, though author reappeared recently), WebOb (2021), Genshi (2022). I'm talking of Bottle whose author doesn't seem to be able to accept `cgi` removal from stdlib. I'm talking of Aesara that used to be a fork of Theano, and that apparently has been forked again. I'm talking of HttpBin that was abandoned in 2018, then revived by PSF, but it's far from being well-maintained right now.
The world has moved on, apparently.

Just stumbled on this now that I have a server with an actual GPU. Host a jupyter server with GPU access.
docker run --gpus all -it --rm -p 10000:8888 -v "${PWD}":/home/jovyan/work quay.io/jupyter/datascience-notebook:2024-04-29
#Docker #AI #Python #NVIDIA

#HomeLab #Python #Linux
Making progress on this network diagnostic script.
Thus far it reports:
Interface...
* name
* type
* status

My final act before vacation is done: structlog 24.2.0! #Python
Enjoy a bunch of bug fixes, better Logfmt support, and some optimizations!
https://github.com/hynek/structlog/rel

Release 24.2.0 · hynek/structlog
Highlights Overdue, and mostly bug fixes & optimizations! See y'all after my vacation. 🌴 Full changelog below! Special Thanks This release would not be possible without my generous sponsors! Thank ...

I'm close to having @… sorted out. With a new API comes slightly different data points. #python

Can one pre-build a buildFHSUserEnv in configuration.nix and then have a command like 'fhs' that yanks you into a shell with all your environment.systemPackages in an FHS layout?
All my tries have given me either infinite recursion errors or other problems.
Seems like a way out of the #Python development misery on

Essentially, distro developers are firefighters, putting out fires made by careless upstreams.
What I've wasted time on, today:
- making the non-standalone test suite of #Hatchling (sigh) work without #UV again, so that a critical build dependency of a growing number of #Python packages could be tested everywhere
#PassLib not to break random stuff via printing warnings when using newer #BCrypt versions
#ImageIO work using an offline copy of test data, rather than cloning its git repository at the beginning of tests
#Gentoo

Went ahead and posted the code for the NWS weather stuff to GitHub for ya @… however I'm not vouching for its quality. #python #programming

Wczoraj dodałem Pythona 3.13.0b1 do #Gentoo, razem ze wsparciem na poziomie eclass oraz pierwszą partią portów (z PyTestem włącznie).
Na razie tylko dla amd64, bo musimy przetestować mpdecimal.
#Python

Sometimes people ask me why I stabilize #Gentoo #Python packages after 2 weeks, rather than following the usual standard of 4 weeks.
The answer is simple: expecting tests in these packages to still pass whole 4 weeks after the release is a bit much.

Alright, I've got the maps being generated and shared via a quick `python -m http.server` command and being fronted by my `nginx` server. Everything looks good from outside the network. Now we wait for the next watch/warning to pop. #programming #python

Can one pre-build a buildFHSUserEnv in configuration.nix and then have a command like 'fhs' that yanks you into a shell with all your environment.systemPackages in an FHS layout?
All my tries have given me either infinite recursion errors or other problems.
Seems like a way out of the #Python development misery on

Today's exercise: checking how many #Gentoo packages can be ported to #Python 3.13, while new kernel binary packages are building.
Then I'm going to have a hard exercise in rebasing.

Ran the NWS updates script overnight, didn't see any errors and the image directory has a ton of images in it which makes me happy. Still have a bit more cleanup to do, but a really good sign. #weather #python

Today's exercise: checking how many #Gentoo packages can be ported to #Python 3.13, while new kernel binary packages are building.
Then I'm going to have a hard exercise in rebasing.

@… Every time you run the script, it gets the JSON feed from the Kopp’s website, builds a collection in a #ChromaDB vector database, populates it with what today is, what today’s flavor is, and what tomorrow’s flavor is, and then uses that for the embedding. I wasn’t expecting to need to tell it what today’s date is.
#Ollama #Python

What would cause :git: #git to shell out at 'git -C repo fetch --all'?
I call git via #Python's subprocess module (no, not with shell=True) and it apparently shells out to my default :fish_shell: #fishShell

Alright, time to see if all the changes worked. Of course, to test it I'll need nature to provide some severe storms which seems kinda wrong... #python #weather

After another round of #Python 3.13 porting in #Gentoo, I'm imagining that huge crowded highway meme, except it's saying:
Just one more microframework! I promise you, one more microframework and all problems will be solved!

What I could do: Continue working on my flat so that I might eventually have a desk again, with luxuries such as an external screen or an actual keyboard.
What I am doing: Being hunched over my laptop, abusing #Python with the little knowledge I can gather from the back of my brain to write a small application to share my vast collection of reaction

Started cleaning up the code a bit and documenting everything before I post it. There are still a few issues, but the app runs solidly enough to process the NWS API messages at a regular interval. #python #weather

For a project that's supposed to avoid the vices of C, #CPython sure crashes a lot.
This time I was bisecting a regression in 3.13.0b2 that causes the interpreter crash when `freezegun` is imported. And no, not because freezegun was doing something hacky. Just some crazy internal extension state thingy.
#Gentoo #Python

#Python Friday #227: Hash a Password With #Bcrypt #security #FastAPI

By the way, if you find my #Python 3.13 porting or other #Gentoo work helpful, please consider donating to my cat food fund.
#donation

# !/usr/bin/env python3
# small_universe_test.py
import pandas as pd
const lightyear = 9461000000000000
const size = 930000000000 * lightyear # 8798730000000000000000000000
# largest number on some registers is 9223372036854775807 or 18446744073709551615
universe = sphere(radius=size,x=0,y=0,z=0,t=0)
pd.Series(universe, filling_function)
pd.Plot()
#cosmology #astrophysics #python

#CPython 3.13 has some new fun flags for #Gentoo ricers.
USE=jit − enable to get Just-in-Time compiler and make stuff faster. Note that you're also going to see random segfaults, etc.
USE=gil − disable to get rid of Global Interpreter Lock and get a freethreading #Python. Expect some random breakage, race conditions, etc.

When someone reports a crash bug and the release fixing it only mentions "improving performance".
Well, I guess unaligned writes may degrade performance. Having #RustLang extension crash #Python ain't important after all.
#Gentoo

I just scheduled two @… Open Space sessions. If you are interested in AI and RAG, I am going to be presenting "Crafting Intelligent Python Apps with Retrieval-Augmented Generation" on May 31 and June 28 (in case you can't make the first date).
#ThatConference #AI #LLM #RAG #Python

#UV is truly the future of #Python packaging.
Except that its test suite relies on specific version of random packages happening to be the newest in #PyPI (and some other random third-party package index) at any given time. Which means that the test suite already fails *a few hours* after a release.
Oh, and upstream does drive-by updates to these broken assumptions while making other changes.
So… how are we supposed to mark any version stable in #Gentoo if we can't even hope for any single version to pass tests for a few days?
Also, that test is actually meaningless now, due to test assumptions no longer matching.
#RustLang

Making progress on the push notifications. Targeting Discord at the moment, but I think that the maps really help out with the information. Not satisfied with the formatting, but I'm not sure how much I want to dedicate to it. #programming #python

#UV is truly the future of #Python packaging.
Except that its test suite relies on specific version of random packages happening to be the newest in #PyPI (and some other random third-party package index) at any given time. Which means that the test suite already fails *a few hours* after a release.
Oh, and upstream does drive-by updates to these broken assumptions while making other changes.
So… how are we supposed to mark any version stable in #Gentoo if we can't even hope for any single version to pass tests for a few days?
Also, that test is actually meaningless now, due to test assumptions no longer matching.
#RustLang

#Python Friday #226: Fine-Tune the #OpenAPI Documentation in #FastAPI

Python Friday #226: Fine-Tune the OpenAPI Documentation in FastAPI - Improve & Repeat
FastAPI does a great job in creating an OpenAPI documentation for us. With a few little tweaks we can make it even better.

How about tests that fail in a completely nondescript way if your hostname is 12 characters long? I mean, the bash prompt gets into output and breaks matching in one environment, and doesn't in an environment with a shorter hostname.
As it turns out, it was caused by putting a wrong path to bashrc override while adding zsh support to #ArgComplete. I guess most people didn't get a long enough bash prompt to hit the failure.
#Gentoo #Python

Okay, after a few hours of troubleshooting I've got the county and warning polygons rendering correctly. So much profanity, but it works. Aspect ratio and zoom levels also seem to work. Next up: linking the messages with the images. #programming #python

I've added #Python 3.13.0b1 to #Gentoo yesterday, along with the initial eclass support and a few baseline ports (up to PyTest).
It's amd64-only for the time being, since we need to keyword mpdecimal.

In the past, many NumPy-based projects built their wheels against `oldest-supported-numpy` package to ensure the best ABI compatibility between multiple #NumPy versions.
Then NumPy 2 came and reversed that — now you need to build against NumPy 2 rather than 1.x, to gain ABI compatibility with both versions.
That said, if you want to maintain support for #Python 3.8, then you have to hack even more:
#Gentoo

Well, we know that some upstreams are hostile to downstream testing.
However, how about they actually encrypt tests, so that only their CI can run them?
#Gentoo #Python

Please don't use #Mercurial. It's not well-maintained software.
People like to point out that Mercurial works great for a few BigTech corporations. That's great for them. The side effect is that the development is focused on these corporations, and if you find a bug that doesn't affect them, you better be ready to provide a fix yourself.
#Python 3. The first release with Python 3 was made *two months* before Python 2 went EOL.
#RustLang. Funny thing is, Mercurial with Rust extensions enabled still doesn't work on Python 3.12. Apparently, they've chosen to use some NIH Python/Rust bridge rather than PyO3.
#Gentoo

Here's my newest optimization idea for #Gentoo #Python: for pure Python packages and packages using the stable #CPython API, let's reuse previously built wheels if they're compatible instead of building them separately for each Python implementation.
This is mostly a major gain for the lot of packages using #setuptools when you're using multiple PYTHON_TARGETS, since calling into that build system has a significant cost. However, it also saves some actual compiling in the packages using the stable API (particularly, Rust packages).
https://github.com/gentoo/gentoo/pull/36672
https://bugs.gentoo.org/931689

It took me almost 3 hours but #PipX 1.6.0 is now in #Gentoo, with an updated test shim that makes it possible to test using fake wheels and is only 70 KiB (vs. upstream that uses ~160 MiB for every single implementation).
What's more important, this time it isn't a handmade proof-of-concept anymore but a proper script with instructions that can be used to easily deal with future releases.
#Python

I’m rewriting @… to use a new API (because the old one doesn't work right anymore), rewriting it to be in #Python instead of #Node, and moving it from #Pipedream to a local #Docker container on my homelab machine.
You can probably expect a few articles on @… about this.

#Python Friday #229: #OAuth2 and #JWT to Protect a #FastAPI Application

Python Friday #229: OAuth2 and JWT to Protect a FastAPI Application - Improve & Repeat
OAuth2 and JWT based authentication needs a bit of code to use with FastAPI. Let us explore how we can secure our endpoints.

#Homelab #Linux #Networking
So if you are looking for a #Python

Of course, there's a #PEP517 backend for #SCons, one of the most horrible build systems ever made by humankind.
Of course, it managed not to implement PEP517 correctly.
#Gentoo #Python

You know what's great about #Python stable ABI? That you can take a binary package of, say, cryptography, and it will work on CPython 3.13, even though it's been built with older CPython version.
You know what's not so great about #PyO3? That you won't be able to build this package using Python 3.13 because it's going to reject it as "too new". Even if the package in question is only using the stable ABI compatible with CPython 3.9. Sigh.
So, of course, everything on #Gentoo will be blocked, until individual packages update their dependencies to use PyO3 new enough to support 3.13.
#RustLang

Just hit my first JIT-related #CPython 3.13 test failure. Curious enough, it doesn't seem that the `gc.collect()` hack works, the way it does for #PyPy.
#Gentoo #Python

So I'm bumping a package and the test suite fails with suspicious timestamp-related failures. So I do the obvious thing, and set TZ=UTC. It still fails. I do a quick math, and the timestamp difference looks weird — 8 hours.
I clone the repo to try to reproduce the problem. While that, I check how upstream runs tests and notice a comment:
# system should be in "America/Los_Angeles" timezone for all tests to pass
Well, okay. Then I make a bet that kloczek has already filed a bug about tests passing without actually bothering to try to figure it out. Of course he did:
#Python #Gentoo #PLD

Does #setuptools maintainer think it is a good idea to use setuptools as a #PEP517 build system?
Yep, he probably does. And to prove it, he installs `docs` straight into `site-packages`.
#Gentoo #Python

The most recent #Django releases, 5.0.5 and 4.2.12 are broken. Most likely they were done on #Windows, and that obviously is sufficient to break stuff.
[UPDATE: 5.0.6 and 4.2.13 are good. Thanks a lot!]
So far, we've noticed the following issues:
1. The directory is named lowercase `django-X.Y.Z` instead of capital-case `Django-X.Y.Z` (the filename remains capital-case).
2. All files have CRLF line endings instead of LF.
3. All files that should have the executable bit, have lost it.
As a result, the releases don't pass their own tests.
I hope to report this upstream, but their Trac is down now. So you can't even download the releases right now.
#Gentoo #Python

This function has a certain XKCD#221 vibe to it. Perhaps the package originates from Debian? (remember CVE-2008-0166?)
#Python #Gentoo #WTF