Otto Ops LLC
Email

Paul Otto

Platform engineer, AI/ML engineer and founder of Otto Ops LLC

Aurora, Colorado
info@ottoops.com
github.com/potto007

Summary

I'm a data, infrastructure and software architect with more than 30 years of hands-on work, and for most of it I also ran what I designed. I lead platform teams and still read the code and the logs. Today I work on Kubernetes platforms for defense systems, and I train and serve domain-adapted open-weight models on local hardware.

Experience

Principal Platform Engineer

Jul 2026 to present

Amplify Federal

  • Provide platform engineering support for Second Front and Forterra.
  • Build and maintain cloud infrastructure, Kubernetes platforms and deployment pipelines for their engineering teams.
  • Improve observability, reliability and security across their environments.

Principal AI/ML Engineer and Founder

Mar 2014 to present

Otto Ops LLC, Aurora, Colorado

  • Built an end-to-end LLM fine-tuning pipeline with teacher-student trajectory generation, SFT, DPO, continued pretraining, SLERP merging, GGUF export and automated benchmark evaluation.
  • Built a 4-bit QLoRA training harness for Gemma 4's fused-expert mixture-of-experts layers that fine-tunes a 19B-parameter model on one 32 GB consumer GPU.
  • Developed a recursive language model (RLM and SRLM) training and inference framework with multi-trajectory generation, uncertainty-guided selection, context-length routing and map-reduce orchestration.
  • Run self-hosted inference on llama.cpp in router mode with Flash Attention and a quantized KV cache. Prometheus, Grafana, Loki and Alertmanager watch it, and VRAM watchdogs catch spills to system memory during overnight training runs.
  • From 2014 to 2017, consulted on big data pipelines and DevOps for enterprise clients. I built and ran big data infrastructure across three on-premise data centers, set up DevOps process and tooling for an advanced data analytics organization, and wrote and taught a Puppet curriculum on site for a Fortune 50 customer.

Co-Founder and CTO

May 2026 to present

ClearBridge Revenue Integrity Partners, Denver, Colorado

  • Build the cloud infrastructure, data architecture and automation for the company, including the ClearBridge Academy learning platform, built for HIPAA compliance.
  • Architected a retrieval knowledge base for behavioral health billing regulations on LightRAG, with Neo4j knowledge graphs, Milvus vector search, bge-m3 embeddings and entity extraction across 18 domain entity types.
  • Built the Academy's AI features, including Gemini TTS narration, Moshi speech recognition and GPU document processing with Docling and MinerU.

Principal Platform Engineer and Engineering Manager

Mar 2025 to Jul 2026

Clarity, Columbia, Maryland (remote)

  • Led a distributed team of platform engineers on military systems.
  • Lead engineer for the ADCP SRE organization at Kessel Run, US Air Force. Mentored military members, government civilians and contractors.
  • Designed and built observability platforms on Kubernetes with Elastic, deployed with ArgoCD, FluxV2 and Terraform.

Director of Engineering

Sep 2020 to Jan 2025

Raft, McLean, Virginia (remote)

  • Wrote and presented proposals to government evaluation boards that won two SBIRs and the Cloud CITI 2.0 contract, with both option periods.
  • Principal Architect and technical lead for Public Cloud ADCP at Kessel Run, US Air Force. Built Kessel Run's Zero Trust Network Architecture.
  • Served as the subject matter expert on PlatformOne deployment patterns for a small team that launched an open source bare-metal private cloud edge node at the Air Force Shadow Operations Center, a test case for globally distributed C2.
  • Led a growing team of software and systems engineers. Integrated Confluent Platform (Kafka), Istio and Kubernetes, deployed with Ansible, ArgoCD, FluxV2 and Terraform.

Senior Systems Architect

Apr 2017 to Sep 2020

Ticketmaster, Hollywood, California (remote)

  • Led engineering of the secrets management service in Q4 2019 that put Ticketmaster in CCPA compliance for January 2020.
  • Managed a high-priority AWS cost management project and coordinated its rollout with more than 20 teams worldwide.
  • Architected log usage metrics and chargeback services, and wrote the log usage tracking, metrics transmission and throttling code.
  • Moved development teams from on-premise to EC2, from EC2 to Tectonic Kubernetes, and from Kubernetes to AWS EKS. Field-tested EKS and rolled it out as Ticketmaster's primary platform.
  • Wrote backend services in Go and Python and mentored colleagues across the company in Go and cloud native practice.

Infrastructure and Data Services Architect

Dec 2012 to Jan 2014

TrackVia, Denver, Colorado

  • Architected data services on Galera (Percona XtraDB Cluster), MySQL 5.6, HAProxy with Keepalived, and Hadoop.
  • Architected the AWS infrastructure for TrackVia's new product, including VPC, EC2, CloudFormation, IAM, RDS, EMR and S3, automated with Boto, Ansible and Puppet.
  • Managed infrastructure, data services and production operations, and mentored engineers in operations and DevOps practice.

Senior MySQL Engineer and DBA

Mar 2011 to Dec 2012

GoDaddy, Denver, Colorado

  • Supported CentOS Linux and MySQL on more than 2,400 high-traffic servers, and automated operations with Bash, Perl, PHP and Python.
  • Planned upgrades across MySQL 4.0, 4.1, 5.0 and 5.1, and from MyISAM to InnoDB.
  • Led a team of MySQL engineers building an internal service to manage every MySQL asset, and set the department's git practices.

Earlier

  • Database Engineer, BeatportJan 2010 to Mar 2011
  • Software Engineer and Oracle DBA, Qwest CommunicationsFeb 2008 to Jan 2010
  • Software Engineer, MarketBizNov 2003 to May 2007
  • Armament Repair Section Sergeant, US ArmySep 1996 to Dec 2003
  • Software Engineer, Sedona SoftwareMay 1995 to Sep 1996
  • Software Developer, RCF Information SystemsJun 1994 to May 1995
  • Software Developer, Craftsman SoftwareMar 1993 to Jun 1994
  • Software Developer, EG&GMay 1992 to Sep 1992

Open source

  • Unridden, an Apache-2.0 decision API on Gemma 4 26B-A4B that runs prefill only and reads the answer from the label logits. It scored 0.931 accuracy on 1,286 questions across seven hand-written suites, at about 180 ms median per request on one RTX 5090.
  • live-vibe, a full-duplex voice plugin for Claude Code that runs on CUDA or Apple silicon.
  • prehend, a recursive language model harness with experience memory and self-reflective program search.

Skills

Model training
PyTorch, Hugging Face Transformers, TRL, PEFT, bitsandbytes, Liger-Kernel. SFT, DPO, QLoRA, continued pretraining, SLERP merging, mixture of experts, GGUF quantization.
AI infrastructure and retrieval
llama.cpp, CUDA, Flash Attention, KV cache tuning, LightRAG, Milvus, Neo4j, bge-m3, Model Context Protocol.
Platform
Kubernetes and EKS, Docker, Terraform, ArgoCD, FluxV2, Ansible, Puppet, Istio, Consul, Vault, Keycloak, AWS.
Observability
Prometheus, Grafana, Loki, Alertmanager, Elastic.
Data
MySQL, Galera and Percona XtraDB Cluster, Redis, Cassandra, Kafka, Spark, Hadoop, Druid.
Languages
Python, Go, Rust, Elixir, C, Java, Scala, SQL, Bash, Perl.

Education

  • MS, Organizational Leadership, IT specialization, Colorado State University Global Campus2013
  • BS, Business Administration, cum laude, California State University San Marcos2007
  • CompTIA Security+