Own your shop's intelligence. Or die.
Three months running Gemma 4:31B locally on a Jetson AGX Orin 64GB. Tied into Supabase, image and video analysis, web, and Telegram. What I built. What surprised me. And why every shop owner needs to start now.
Edge AI on the workbench. Your tools. Your data. Your knowledge.
Over the last few months, we've been running Gemma 4:31B locally on an NVIDIA Jetson AGX Orin 64GB setup tied into our real workflows.
It was not easy to get running. The Orin image was dust on arrival. Took a lot of work to get it online. I did it tho. Did not have to rely on any of the gurus we have building out DPM. They are so busy with the build that I did not want to bother them with a side project.
The side project turned into the future.
I gave it access to:
- Supabase, our project database
- Video and image analysis
- Web access
- Telegram for team communication
And a few other tools I built with code to handle loads and AI switching for more complex issues. It has the ability to use a paid model when it needs to. I have not had to switch. Gemma is killing it.
Now the entire team can interact with it throughout the day.
What surprised me most.
It's not the "AI magic." It's the practicality.
After the initial hardware and setup cost, the system runs essentially free compared to constant API usage. More importantly, it becomes your system:
- Your workflows
- Your terminology
- Your projects
- Your institutional knowledge
It learns how your company operates every single day.
Where this is going for the trades.
I think every mechanical contractor, fabrication shop, and field operations team will eventually have their own private small language model:
- Running locally
- Connected to company systems
- Trained on company processes
- Preserving operational knowledge
- Assisting project managers, foremen, estimators, and operations teams
The companies that build internal AI memory first are going to have a massive advantage.
We're still early. But seeing a private AI system remember context, understand our workflows, analyze images and video, and assist the team in real time has been eye-opening.
This is not a "chatbot." You are building a digital operations partner for the business.
If you lead a shop, you need to be using this.
If you don't, you will be left behind.
24 hours a day. Don't do that.
Never forget anything ever again. Code and storage do not forget. Own your AI.
If you want one, I can help you set it up. Or we can do it for you.
Hardware, image, model selection, integrations to your existing systems. We have done the work to make it run.
You need to do this.