https://docs.docker.com/engine/security/rootless/#expose-docker-api-socket-through-tcp この辺試してみるかな

Run the Docker daemon as a non-root user (Rootless mode)

Run the Docker daemon as a non-root user (Rootless mode)