_

> INITIALIZING ROOT ENVIRONMENT...

Aman Karki

>

C++ Core CUDA Python LLM Inference GraphRAG LLD & DSA

Software Engineer specializing in high-performance C++ systems, CUDA, and applied AI. Building LLM inference engines, vector databases, and dependency-graph systems from scratch -- each verified against real references, not assumed.

Deploy Framework

> ./inspect_modules.sh

01.

Languages

  • > C++20
  • > Python
  • > CUDA
  • > SQL
02.

Data Structures & Algorithms

  • > Graphs (BFS/DFS, Topological Sort)
  • > Dynamic Programming
  • > Hashing, Heaps, Two Pointers
03.

Low-Level Design & Systems

  • > OOP & SOLID Principles
  • > Multithreading (std::jthread)
  • > RAII & Smart Pointers
04.

AI, LLM & Agentic Systems

  • > LLM Inference & RAG
  • > GraphRAG & Vector Databases
  • > HNSW & INT8 Quantization
05.

Tools & DevOps

  • > CMake & Git
  • > GitHub Actions (CI/CD)
  • > Docker & FastAPI

> ./view_architectures.sh

Inference Engineer

verbum.cpp -- LLM Inference Engine

From Scratch in C++ & CUDA (Public)

A transformer inference engine written from scratch -- tokenizer, attention, KV-cache, sampling -- with no dependency on PyTorch or an existing runtime. The forward pass is verified against real HuggingFace output to a 3e-5 max logit deviation, a process that caught two real, non-crashing bugs before they shipped. Custom CUDA kernels hit 723 GFLOP/s, a 343x speedup over the CPU baseline.

C++20 CUDA Python pybind11
__global__ void matmul_tiled( const float* A, const float* B, float* C) { // shared-memory tiling, coalesced access __shared__ float tile[TILE][TILE]; // 723 GFLOP/s measured, 343x over naive CPU }

Lattice

Embedded Vector Database

An embedded vector database built from scratch in C++ -- a hand-implemented HNSW index, a write-ahead-logged storage engine, and scalar quantization. Benchmarked at 583µs p50 latency, 95.4% recall on SIFT -- roughly 3.5x faster than Qdrant's in-memory mode. Published to PyPI as pylattice-db.

class HNSWIndex { public: void insert(const Vector& v) { // probabilistic level assignment int level = assign_level(); greedy_search_and_link(v, level); } };

RAAG

Architectural Analytics Platform

A C++20 engine parses a repository in parallel via a std::jthread pool. A Python engine builds the dependency graph and computes real coupling, instability, and cohesion metrics. A GraphRAG-scoped engine limits AI refactoring suggestions to exactly the blast radius a change can reach. Its own CI gate blocks a pull request that pushes a module's instability past threshold. Published as a VS Code extension.

class ThreadPool { public: explicit ThreadPool(size_t n) { // Cooperative cancellation via jthread for (size_t i = 0; i < n; ++i) workers_.emplace_back( [this](std::stop_token st) { run(st); }); } };

> ./verify_experience.sh

llama.cpp (ggml-org)

CUDA Backend Contributions -- Open Source LLM Inference Engine, 128,000+ GitHub Stars

2x MERGED
MERGED

CUDA: i16/i32 Support for GGML_OP_DUP

Enabled i16 and i32 support for the GGML_OP_DUP tensor operation on CUDA, fixing a gate that was silently falling back to the CPU backend. Verified against the full backend test suite -- 16,097/16,097 tests, zero regressions -- on two Nvidia T4 GPUs. Reviewed and approved by the project's creator, Georgi Gerganov.

View PR #28897 ->
MERGED

CUDA: 1D Pooling Support (POOL_1D)

Implemented a CUDA kernel for one-dimensional pooling (average and max modes), closing a gap in GPU backend coverage. Verified across 216 test cases spanning all kernel size, stride, and padding combinations on two Nvidia T4 GPUs. Merged into master by the project's creator, Georgi Gerganov.

View PR #27573 ->

> ls -la /var/log/articles/

RAAG

Building a Parallel C++ Source Parser

jthread, stop_token, and the deadlock I didn't see coming.

> Read Transmission
RAAG

I Ran a Coupling Analyzer on nlohmann/json and fmt

It found a class doing 55 jobs.

> Read Transmission
RAAG

An AI Refactoring Tool That Can't See More Code Than the Dependency Graph Allows

Scoping AI-assisted refactoring to exactly the blast radius a change can reach.

> Read Transmission
Lattice

Building an HNSW Index From Scratch

The core algorithm behind an embedded vector database.

> Read Transmission
Lattice

Benchmarking Against Qdrant and Chroma

Real recall and latency numbers, including where it honestly loses.

> Read Transmission
Lattice

What I Learned Building a Storage Engine From Scratch

The design decisions that held up, and the ones I'd change.

> Read Transmission
verbum.cpp

What Actually Happens Inside a Transformer Forward Pass

Two subtle bugs that don't crash -- they just quietly produce wrong answers.

> Read Transmission
verbum.cpp

INT8 Quantization the Second Time Around

Catching myself about to publish the flashy number instead of the honest one.

> Read Transmission
verbum.cpp

Two From-Scratch Systems, and the Day They Talked

The demo where Lattice and verbum.cpp finally talk to each other.

> Read Transmission

> ./fetch_telemetry.sh

Execution Timeline

CURRENT

Software Engineer -- Independent Systems Work

Building three production-grade systems from scratch -- an LLM inference engine, an embedded vector database, and an AI-powered architectural analytics platform -- each independently verified and benchmarked.

FOUNDATIONAL

Low-Level Systems & GPU Programming

Deepened expertise in low-level C++ and CUDA -- custom GPU kernels, memory optimization, and systems-level performance work, culminating in a merged open-source CUDA contribution to llama.cpp.

ACADEMICS

B.Tech, Computer Science & Engineering

Cyber Security and Forensics specialization. Core focus on Systems Engineering, Data Structures, Algorithms, and Low-Level Design.
University of Petroleum and Energy Studies / 2024

Live Telemetry

Source: GitHub API
Commits (YTD): Fetching...
Public Repos: Fetching...
Current Focus: Fetching telemetry...
Activity Matrix (Last 14 Days)

> ./verify_credentials.sh

IBM / Coursera [VERIFIED]

IBM RAG and Agentic AI

Proficient in building advanced generative AI applications using RAG, agentic, and multimodal AI technologies.

View Credential ->
IBM / Coursera [VERIFIED]

IBM Full Stack Software Developer

Completed 15 courses covering cloud-native applications, DevOps, containers, Docker, Kubernetes, and microservices.

View Credential ->
IBM / Coursera [VERIFIED]

IBM DevOps and Software Engineering

Mastered entry-level DevOps practices, Agile/Scrum methodologies, Python automation, and CI/CD pipelines.

View Credential ->

> ./establish_connection.sh

root@amankarki:~
Connected to secure server at 127.0.0.1...
Welcome to AK::SYS Interactive Terminal.
Type 'help' to see available commands.
root@ak-sys:~$