Skip to content

Open to AI, Kubernetes, cloud and backend rolesUpwork Top Rated Plus

Rokibul HasanAI engineer and DevOps engineer

I build production AI systems and the infrastructure they run on: real-time voice agents, retrieval pipelines, self-hosted model serving, Kubernetes operators and multi-cluster platforms. Senior software engineer at AppsCode Inc., working on multi-cluster Kubernetes management and multi-tenant observability.

About

Two halves of the same job: AI systems, and the infrastructure under them.

I have spent the past few years in the Go and Kubernetes ecosystem building tooling that makes fleets of clusters manageable. At AppsCode I work on ACE: a single dashboard for public and private clusters, the operators behind its authentication and authorization, and a multi-tenant monitoring stack on OpenTelemetry, Thanos, ClickHouse and Perses.

The other half of my work is AI systems. The largest is a production voice agent: you call it, talk over it, and about a second after you stop you hear an answer in a cloned voice from a lip-synced avatar, grounded in access-filtered retrieval. I built the ingestion and retrieval pipeline, the agent, the model serving layer and the autoscaler under it.

Before that, the voice backend for a Unity game whose companion character reacts to the world you build. It shipped at roughly 1.5s to first audio, down from about 7s.

As a "Top Rated Plus" engineer on Upwork I have delivered backend and infrastructure work since 2021: Go and Python services, GitOps automation on OpenShift, multi-region deployments, and query tuning on PostgreSQL and ClickHouse. I also contribute upstream to the CNCF projects I depend on, including Open Cluster Management, Kyverno, K3s, vCluster and KubeVirt.

More about how I work

Rokibul Hasan
Dhaka, Bangladesh
Experience

Where I have worked

Senior Software Engineer

Jan 2023 – Present

AppsCode Inc.

Software Engineer, Jan 2023 to Dec 2024. Promoted to Senior Software Engineer, Jan 2025.

  • Built a centralized multi-cluster management solution for public and private Kubernetes clusters via the ACE Dashboard.
  • Developed Kubernetes operators and APIs to automate authentication and authorization with secure kubeconfig generation.
  • Designed and implemented a multi-tenant monitoring system using OpenTelemetry, Thanos, ClickHouse, and Perses.
  • Packaged ACE as a self-hosted service for deployment across vendor-managed and self-managed Kubernetes clusters.
  • Integrated high-impact features into the ACE API Server, enhancing platform capabilities and scalability.
  • Contributed to the deployment, maintenance and reliability of AppsCode production servers.

Senior Software Engineer (Top Rated Plus)

2021 – Present

Global Clients (Upwork)

  • Built a real-time voice AI agent: streaming speech-to-text, access-filtered hybrid retrieval over Qdrant, LLM generation and cloned-voice synthesis, delivering spoken replies 0.83–1.17s after end of turn, plus a lip-synced video avatar.
  • Designed the GPU serving layer behind it: pod-first routing with serverless overflow, per-endpoint circuit breakers, and an autoscaler that learns each pod's real concurrency, and benchmarked capacity at ~11.5 rps and ~25 concurrent users per pod at p95 ≤ 6s.
  • Built the voice backend for a Unity game with an LLM-powered companion character, cutting time-to-first-audio from ~7s to ~1.5s and removing 40-60% of inference calls with an event pre-classifier.
  • Delivered an infrastructure automation suite for enterprise OpenShift clusters using Ansible and ArgoCD for GitOps-driven continuous deployment.
  • Architected and deployed highly scalable backend systems for international clients using Go and Python.
  • Automated infrastructure provisioning and multi-region deployments using Kubernetes, Terraform, and GitHub Actions.
  • Optimized high-traffic databases (PostgreSQL, ClickHouse) for low-latency retrieval and real-time processing.
  • Maintain a 100% Job Success Score and 'Top Rated Plus' status for consistent high-quality delivery.

Full experience and the systems behind it

Selected work

Systems I have built, written up properly

Real-Time Voice AI Agent with RAG & Video Avatar

A voice agent you call and talk to: streaming speech-to-text, access-filtered hybrid retrieval, an LLM, cloned-voice synthesis and a lip-synced video avatar. About a second from the end of your sentence to hearing the reply, with barge-in.

  • LiveKit
  • pipecat
  • Whisper
  • Qdrant
  • vLLM
  • VoxCPM2
  • LiveAvatar
  • FastAPI
  • Kubernetes

AI Companion Game Backend

Voice backend for a Unity game whose companion character reacts to the world you build. Streaming faster-whisper, Llama 3.1 on vLLM and WebSocket TTS, with time-to-first-audio cut from about 7s to about 1.5s.

  • FastAPI
  • vLLM
  • Llama 3.1
  • faster-whisper
  • ElevenLabs
  • Firebase
  • Unity

Multi-Cluster Kubernetes Platform (ACE)

Centralized management for public and private Kubernetes clusters through a single dashboard: operators that automate authentication and authorization, secure kubeconfig generation, and a multi-tenant monitoring stack built on OpenTelemetry, Thanos, ClickHouse and Perses.

  • Go
  • Kubernetes
  • OCM
  • OpenTelemetry
  • Thanos
  • ClickHouse
  • Perses

Cluster Auth Manager

A Kubernetes operator built on Open Cluster Management that centralizes authentication and authorization across many clusters from a single hub.

  • Golang
  • Kubebuilder
  • OCM
  • Docker

Infrastructure Automation Suite

GitOps-driven automation for enterprise OpenShift clusters: Ansible playbooks for provisioning and configuration, ArgoCD for declarative state reconciliation and continuous deployment.

  • OpenShift
  • ArgoCD
  • Ansible
  • Kubernetes
  • Helm
  • GitOps

Cloud MarketPlace

Go service for a cloud application marketplace: asynchronous installs and uninstalls, billing, and a publisher/consumer workflow backed by PostgreSQL and Redis.

  • Go-Chi
  • PostgreSQL
  • Redis
  • GORM

All projects and case studies

Toolkit

What I work with

Languages

  • Golang
  • C/C++
  • Python
  • SQL

Frameworks & Libraries

  • Go-Chi
  • Echo
  • Macaron
  • FastAPI
  • Django
  • GORM
  • Kubebuilder

AI & ML

  • RAG
  • Qdrant
  • bge-m3
  • vLLM
  • Ministral
  • Whisper
  • VoxCPM2
  • LiveKit
  • pipecat
  • LiveAvatar
  • Voice Cloning
  • Voice Agents

AI engineering

Databases

  • PostgreSQL
  • Redis
  • MySQL
  • ClickHouse

Cloud & Infrastructure

  • Kubernetes
  • OpenShift
  • AWS
  • GCP
  • Azure
  • Docker
  • Helm
  • FluxCD
  • ArgoCD
  • Ansible

Kubernetes engineering

Observability & DevOps

  • OpenTelemetry
  • Thanos
  • Prometheus
  • Grafana
  • Perses
  • GitHub Actions
  • Nginx
  • Ingress

DevOps & platform work

Education

Academic foundation

B.Sc. in Computer Science & Engineering

2019 – 2023

East West University

  • Distributed systems and cloud infrastructure. CGPA 3.49/4.0.
  • Thesis: "Data Security in Cloud Computing using a Hybrid Algorithm Approach".
  • Published in IEEE Xplore: read the paper.
Competitive programming

1000+ problems, 200+ contests

1000+
Problems solved
Across all judges
1695
Codeforces
Max rating
1848
CodeChef
Max rating
6 star
HackerRank
Gold badge
Contact

Currently open to AI and infrastructure work.

If you are building something that has to stay up, or a model that has to answer fast enough for someone to keep talking, I am interested.