- Model training
- PyTorch, Hugging Face Transformers, TRL, PEFT, bitsandbytes, Liger-Kernel. SFT, DPO, QLoRA, continued pretraining, SLERP merging, mixture of experts, GGUF quantization.
- AI infrastructure and retrieval
- llama.cpp, CUDA, Flash Attention, KV cache tuning, LightRAG, Milvus, Neo4j, bge-m3, Model Context Protocol.
- Platform
- Kubernetes and EKS, Docker, Terraform, ArgoCD, FluxV2, Ansible, Puppet, Istio, Consul, Vault, Keycloak, AWS.
- Observability
- Prometheus, Grafana, Loki, Alertmanager, Elastic.
- Data
- MySQL, Galera and Percona XtraDB Cluster, Redis, Cassandra, Kafka, Spark, Hadoop, Druid.
- Languages
- Python, Go, Rust, Elixir, C, Java, Scala, SQL, Bash, Perl.