Use Python to control your docker containers! Here is a walkthrough how to get started. It is based on a test of three popular packages for handling tabular data.
Git Repo: https://github.com/martinkarlssonio/polars-pandas-spark
If you would like to read on the data aspect of this test there's a separate story for that!
medium.com/@martinkarlsson.io/pandas-spark-and-polars-when-to-use-which-f4e85d909c6f
Walk through of the code
Below image illustrates the overall idea with the code. The main.py code build image and starts, controls and monitors 12 Docker Containers.
Control your images and containers
The star in this solution is the Docker Python package. In a requirements.txt (installed with pip) we specify the docker package.