Vanshaj Kakkar,
AI software engineer.

I build machine learning and LLM systems and take them all the way into production, working across Adelaide, Melbourne and Sydney. The model is usually the smallest part: around it sit the retrieval layer, the API, the database, the cloud it runs on and the cost of running it. I build those too.

70+

Projects worked on, solo and in teams

14

AI and machine learning systems built

2+

Years shipping AI into production

What that work breaks down into
Computer vision and OCRReading text and spotting objects in photos, in real products
Machine learning, end to endTraining, evaluating and shipping models, not just notebooks
On-device and edge AIModels that run on a phone or a small box with no internet
RetrievalFinding the right passage before the model answers
LLM applicationsAgents, tool use, streaming and choosing the right model per question
Multimodal systemsReading images and text together in one system
Speech and audioSpeech to text and text to speech inside live products
Privacy and AI securityKeeping personal data out of prompts, logs and third-party models
Cost engineeringMaking AI cheap enough to leave switched on
Cloud architectureAWS, from the deploy pipeline through to the monthly bill
Analytics and measurementEvent pipelines, and making the numbers trustworthy
Media and signal pipelinesVideo, audio and sensor data at volume
Delivered for Agri-tech Government departments National industry associations Large employers Education Media and events
LLM systems

Retrieval, prompt design, model routing and evaluation, including real-time voice and avatar agents running against a custom model.

ClaudeBedrockRAGpgvectorLiveAvatar
Machine learning

Computer vision models trained, evaluated and deployed to run on the device rather than in a data centre.

PyTorchYOLOTFLiteONNX
Data engineering

Pipelines that take messy event data and turn it into something you can actually query and trust.

PythonPostgreSQLMongoDBPandas
Getting it shipped

The APIs, cloud infrastructure and interfaces that turn a model into something people can use.

FastAPIAWSAzureGCPTypeScript
Work

What I've built

Systems that made it into real use, and the problem each one had to solve.

Artificial intelligence

LLM systems

A real-time avatar you can hold a conversation with

A talking avatar backed by Claude, with hybrid retrieval feeding it and speech going both ways. Answers stay grounded in a document set, and the system picks a model per question so quality holds without the cost running away.

PythonClaudeBedrockLiveAvatarWhisperRAG
Avatar systems

An illustrated character that talks back

The same idea delivered as an illustrated character rather than a photoreal one. The performance is assembled from pre-rendered art and cut-out layers driven by the conversation, so a client gets a character in their own house style without a live 3D pipeline behind it.

Illustrated artPre-renderedCut-out layers
Retrieval

An assistant that shows its sources

Ask a question in text, by voice or with a photo and get an answer grounded in an uploaded knowledge base, with real links back to where it came from rather than invented ones.

pgvectorHNSWFastAPIWhisperClaude
Machine learning

Diagnosis from a photograph, offline

Vision models that identify disease from a field photo and run on the phone itself, because the people using it have no signal. Built the dataset and annotation pipeline behind it, then the training, evaluation and on-device export.

PyTorchYOLOTFLiteONNXCoreML
Applied vision

Reading documents, and admitting the gaps

Extracts structured fields from a photographed document across four scripts and checks them against thirteen legal requirements. Two passes must agree before a field is confirmed, so it reports what it could not read instead of guessing.

Apple VisionML KitC#Swift
Edge AI

Inference on an accelerator at the edge

A camera and accelerator running detection continuously at the edge rather than round-tripping to a data centre, built as a persistent streaming service after the obvious approach turned out to be racing itself.

PythonHailoONNXLinux
Cost engineering

Making the model bill predictable

A router that picks the cheapest model capable of answering and escalates only when the question needs it, with every decision logged. Alongside it, spend caps that pause the expensive call while keeping search working.

BedrockDynamoDBTypeScript
AI platform

A media library that understands what is in it

A platform for images, video, audio and 3D models that captions, tags, groups faces and makes everything searchable by what is actually in the file rather than by who remembers the filename.

FastAPIBedrockAuroraS3CDK

Data science and analytics

Data engineering

Turning messy events into answers

Millions of behavioural events arriving from browsers, mobile apps and headsets. The pipeline deduplicates them, rebuilds the sessions behind them and makes the result queryable, feeding dashboards and written summaries.

PythonMongoDBAWS LambdaTypeScript
Data science

Estimating groundwater depth nationally

A national estimate of depth to groundwater at any location, built from 35,875 monitoring bores with readings spanning two decades. Every answer ships with a confidence value derived from how many bores are nearby and how far away they are, so the estimate carries its own reliability rather than pretending to be a measurement.

PythonPandasGeospatialCSV

Platform and engineering

Real time

A fleet of headsets in sync with no internet

A synchronised film running across a fleet of VR headsets on a moving bus, with no laptop, no server and usually no signal. One tablet is the whole brain, with native networking plugins written twice.

SwiftJavaWebSocketUnity
Cloud architecture

The infrastructure under all of it

The cloud estate behind these platforms: 38 serverless functions, 43 storage buckets and 19 edge distributions, defined as code across eight stacks in two regions. I ran the audit that mapped it, attributed the cost project by project, and cut the bill where the numbers justified it.

AWSCDKLambdaCloudFrontAurora
Serverless

A document intake portal in three days

Upload a document, get an AI summary, topics and tag suggestions, plus automatic detection of which existing document this one probably replaces. Scaffold to a passing end-to-end run in three days.

DynamoDBS3SESBedrockNext.js
Tools

A Mac app for 360 video metadata

A native macOS app that stamps spherical metadata onto video without re-encoding, built on a Google tool that had been unmaintained since 2018 and needed porting forward first.

SwiftSwiftUIPython

Alongside these I work on the real-time and device side when a project needs it: synchronised video across a fleet of headsets with no network, native plugins in Swift and Java, and headless build pipelines.

Education

Where the theory came from

The work above came first on this page for a reason. The study is what made it possible to reason about the models rather than only call them.

2023 Master of Data Science The University of Adelaide

Statistics, machine learning and the maths under the models. Where the training, evaluation and error analysis in the work above comes from.

2021 Bachelor of Information Technology, Cloud Computing Deakin University

Networking, distributed systems and cloud architecture. Where the other half comes from: the APIs, the deploy pipelines and the bill at the end of the month.

Award
  • Adelaide Graduate AwardThe University of Adelaide, 2023
Certifications
  • Cisco CCNARouting and Switching
  • Career Essentials in Data AnalysisMicrosoft and LinkedIn
Community
  • Mentor and student ambassadorStudy Adelaide, helping students move from study into technology work here
My agent

Ask this site about my work

Rather than describe what I build, I built it. This is my own agent, sitting at the bottom of every page. It answers from my projects, and it tells you plainly when it does not know something.

My CV

Ask and I will send it over

Send me a quick note and my CV will reach you shortly.

Get in touch

Hi. Ask me anything about what Vanshaj has built and I will answer from his own work.