Dallas, Texas

Senior AI/ML Engineering Architect.
Pilot to production.

Senior AI/ML Engineering Architect at New York Life, leading GenAI application delivery, Databricks modernization, and enterprise AI search. Before that, AI/ML Solutions Architect at Ollion (2nd Watch) and Rackspace, and Senior Solutions Architect with AWS Professional Services. I build production LLM, RAG, and agentic systems for financial services, healthcare, insurance, and retail.

Dibongo Ngoh at AWS re:Invent in Las Vegas
16+ yrs

Enterprise delivery, from Oracle high-availability databases to production generative AI

50M+

Users served by enterprise generative AI initiatives at 99.9% uptime

80+

Models shipped to production on the Data as a Service product I built at 2nd Watch

21

Professional certifications across AWS, Databricks, Snowflake, Google Cloud, Kubernetes, and Oracle

Dibongo Ngoh presenting Data as a Service at the 2nd Watch booth, AWS re:Invent

Conference stages, client war rooms, and security review boards. I present where architecture decisions get made.

What I do

Generative & Agentic AI

LLM applications, retrieval-augmented generation, and multi-agent systems with evals, guardrails, and human review designed in from the start, so they survive real traffic and a security review.

Now: ClientMine and ProspectMine, New York Life's GenAI client-intelligence apps. Agent projects on GitHub

Data & AI Platforms

Lakehouse modernization on Databricks and Snowflake: Redshift migrations, medallion pipelines, Databricks Apps and Lakebase, Unity Catalog, and the identity and networking work that gets them through security review.

Recent: PRISM migration to Databricks Apps and the Redshift-to-Databricks program at New York Life.

LLMOps, MLOps & GPU Inference

Fine-tuning, model serving with vLLM and Triton on GPU fleets, prompt and eval registries, and AI governance mapped to NIST AI RMF, the EU AI Act, and SR 11-7 for regulated industries.

Built: QLoRA fine-tuning and vLLM serving on AWS, cutting inference cost 60% with model selection and caching. See the repos

Experience

Mar 2022 - Present

Senior AI/ML Engineering Architect

New York Life Insurance (TDAV)

Lead architecture, security review board readiness, and implementation planning for ClientMine 3.0 and ProspectMine, New York Life's GenAI client-intelligence applications, including the production deployment that put ClientMine live for the field. Production RAG applications handle 100K+ daily queries; multi-agent systems on LangGraph cut customer-service response time 75%. Led the PRISM migration to Databricks Apps, re-architected the IBF platform on Databricks, and architected the enterprise Glean AI search platform on AWS for a pilot spanning 9 business units and 8 data connectors.

Sep 2021 - Mar 2022

Solutions Delivery Architect - AI/ML

Ollion (formerly 2nd Watch)

Led a customer's migration from an on-prem warehouse and Hadoop estate to a cloud lakehouse with Terraform and orchestrated pipelines, cutting batch runtime from about 6 hours to 45 minutes and infrastructure cost about 30%. Built the Data as a Service product that let the AI/ML team ship 80+ models to production, and presented it at AWS re:Invent. Converted PyTorch models to TensorRT and ONNX runtimes serving 10,000+ QPS.

Mar 2020 - Aug 2021

Solutions Architect - AI/ML

Rackspace Technology

Built and productionized a demand-forecasting pipeline for a multi-location retailer, working directly with merchandising teams to fold forecasts into replenishment decisions. Designed and deployed a customer-churn model on AWS that flagged at-risk accounts ahead of cancellation, then helped the client's product team build retention programs from its output.

Jun 2019 - Mar 2020

Senior Cloud Delivery Architect - AI/ML

ActiveSkyGate LLC

Delivered end-to-end AI/ML solutions on Amazon SageMaker. Shipped TensorFlow Serving recommendation models that lifted click-through 12%, migrated scikit-learn pipelines to TensorFlow/Keras for 45% more throughput, and automated quantization and pruning that cut model memory 60% for mobile deployment.

Apr 2017 - May 2019

Senior Solutions Architect - AI/ML

Amazon Web Services (Professional Services)

Built end-to-end MLOps pipelines on Amazon EKS and Redshift, cutting model deployment time from weeks to hours. Created production FastAPI services serving 50+ AI models with auto-scaling, and built real-time ingestion with Apache Kafka for ML feature stores.

Mar 2016 - Mar 2017

Senior Database Software Engineer

Oracle

Led customer operations and projects for Database High Availability products serving 400,000+ customers. Deployed, tuned, and supported ODA and Exadata systems running Oracle 11g and 12c.

Jan 2015 - Mar 2016

Data/ML Engineer

SoundHound AI (Amelia, formerly IPsoft)

Designed conversational AI and chatbot frameworks, built NLP pipelines for document understanding and information extraction, and automated model training and evaluation in Python.

Jan 2013 - Dec 2014

AI Research / Data Engineer

Sodexo

Developed computer vision models for image classification and object detection in TensorFlow and PyTorch, and built processing pipelines for large image and text datasets.

Jan 2010 - Dec 2012

Data Analyst

Biodenta North America

Built enterprise applications in Python and SQL, ETL systems for data warehousing and BI, and API integrations.

Speaking

Data as a Service, presented at AWS re:Invent in Las Vegas from the 2nd Watch booth: how a data product let an AI/ML team ship 80+ models to production, built on S3, Lake Formation, Glue, Athena, EMR, Redshift, Aurora, and OpenSearch.

Conference talk

Data as a Service

Scalable data lakes on AWS as an internal product: one governed path from raw data to models in production.

AWS re:Invent · 2nd Watch booth

Bootcamp

DR CLOUD Gen & Agentic AI Bootcamp

A 16-module program from prompt engineering and RAG through agent architectures, MCP, multi-agent systems, and enterprise deployment on AWS, Azure, and GCP.

Curriculum and instruction · Next cohort January 2027

Training

AI Governance Analyst

AI risk and governance frameworks for analysts entering the field: NIST AI RMF, the EU AI Act, and SR 11-7 in practice.

Program design and instruction

Projects on GitHub

Open-source builds, deployed on AWS with Terraform and torn down afterwards to control cost. Every repo ships with real models and real infrastructure, no mocks.

More builds

  • DocuMind AI — agentic, multimodal RAG on AWS with Terraform, Bedrock, OpenSearch, and Lambda.
  • PolicyPilot — corrective RAG on Bedrock with Strands Agents, Agent Squad, OpenSearch Serverless, Step Functions, and Guardrails, in CDK and Terraform variants.
  • PolicyPilot-N — the same inference path re-platformed onto NVIDIA Triton, TensorRT-LLM, and NeMo Retriever NIMs, then vLLM on EKS.
  • VaultIQ — an MCP server for enterprise document Q&A.
  • Enterprise internal RAG — knowledge retrieval across Slack, Google Workspace, Confluence, and Jira.
  • Air-gapped GenAI on Azure — deployment architecture for a hospital scenario.

Credentials

Certifications

AWS Machine Learning - Specialty badgeAWS Machine Learning - Specialty
AWS Machine Learning Engineer - Associate badgeAWS Machine Learning Engineer - Associate
AWS AI Practitioner badgeAWS AI Practitioner
AWS Solutions Architect - Professional badgeAWS Solutions Architect - Professional
AWS Solutions Architect - Associate badgeAWS Solutions Architect - Associate
AWS Developer - Associate badgeAWS Developer - Associate
AWS SysOps Administrator - Associate badgeAWS SysOps Administrator - Associate
AWS Cloud Practitioner badgeAWS Cloud Practitioner
AWS Big Data - Specialty
AWS Business Professional
AWS Technical Professional
Databricks Data Engineer Professional
Databricks Lakehouse Fundamentals
Snowflake SnowPro Advanced Architect
Snowflake SnowPro Core badgeSnowflake SnowPro Core
Google Cloud Professional Data Engineer badgeGoogle Cloud Professional Data Engineer
CNCF Certified Kubernetes Administrator (CKA) badgeCNCF Certified Kubernetes Administrator (CKA)
HashiCorp Terraform Associate badgeHashiCorp Terraform Associate
Oracle Database 12c Administrator Professional badgeOracle Database 12c Administrator Professional
Oracle Database 11g Administrator Professional badgeOracle Database 11g Administrator Professional
Oracle Database 11g Administrator Associate badgeOracle Database 11g Administrator Associate

In progress

Anthropic Claude Certified Architect - Foundations (CCAR-F)In progress
Databricks Certified Generative AI Engineer AssociateIn progress
AWS Certified Generative AI Developer - ProfessionalIn progress
NVIDIA Generative AI LLM CertificationIn progress

Education

MBA - Information Systems

New Mexico Highlands University

2010 - 2013 · GPA 3.91

BSc - Accounting

University of Buea, Cameroon

2006 - 2009 · GPA 3.75

Let's talk

Enterprise AI/ML architecture, LLMOps, and AI governance.

dngoh365@gmail.com