CTO · Researcher · Educator

Portrait of Rui Santos Costa

Rui Santos Costa

Twelve years building systems at scale across Google, Amazon AWS, and Epic Games. Currently CTO at StrongMind, starting the PhD in Computer Science at Florida Atlantic University, and running typelets.com and virlow.com on the side. Research at the seam where streaming analytics meets privacy-preserving computation.

01 · About

Engineer in the morning, researcher at night.

I spent the last twelve years shipping infrastructure that real people depend on. Google Cloud's Speech Analysis Framework. An AWS ECR proxy serving millions of containers daily for Meta. The Epic Games Store Gifting Service at consumer scale. The common thread is turning a quietly hairy systems problem into a clean, observable, boring service.

The research half of my work asks the harder question. Can we keep that quiet, clean property when the data is sensitive and the workload is real-time? My current projects, MARS (a zero-wait pruning system for streaming OLAP) and EPOCH-ORAM (a single-server multi-user oblivious-RAM construction), chase that thread from two directions.

I also teach. As a Teaching Assistant at Stevens Institute for CPE 550: Computer Organization and Programming, I found I love explaining the low-level stuff (assembly, pipelines, the actual silicon) to students who arrive suspicious that any of it matters. It does.

02 · Experience

Twelve years, four flagship engineering orgs.

  1. 2026, Now StrongMind

    Chief Technology Officer

    Architecting backend services and cloud infrastructure supporting digital curriculum and student information systems across K-12 districts. Leading platform initiatives in API design, data pipelines, and learning-management integrations at nationwide scale.

  2. 2025, 2026 Epic Games

    Principal Software Development Engineer

    Architected and launched the Gifting Service for the Epic Games Store, serving millions of daily users. Led the design and rollout of a Cache Invalidation Service that reduced streaming costs and lifted hit efficiency, and spearheaded the rebuild of Achievements v2 on an agentic-AI architecture, modernizing the platform.

  3. 2022, 2025 Amazon AWS

    Principal Solutions Developer

    Designed a highly scalable AWS ECR proxy in Go for Meta that securely handles millions of containers daily, and built an MLOps framework for GxP-compliant healthcare deployments. Delivered the first public success story for generative AI in manufacturing at VW Production and Logistics, and led the gamified drone navigation system using edge-deployed LLMs, featured in 30+ sessions at AWS re:Invent 2023.

  4. 2016, 2022 Google

    Senior Software Engineer, ML Engineer

    Developed the Google Speech Analysis Framework, a core component of Google Cloud Contact Center Insights, and built developer-focused tools for Google Cloud ML services across NLP, Speech-to-Text, and Vision APIs. Authored and patented solutions for securely sharing pre-trained ML models at scale, and co-authored the Google Cloud Cookbook (O'Reilly Media).

  5. 2013, 2016 Alphaserve Technologies

    Director of Cloud Engineering

    Established the company's cloud consulting practice. Delivered hybrid-cloud, IaaS, and DRaaS solutions on AWS and Azure. Oversaw release and configuration systems for Unix and Linux SaaS environments.

  6. 2008, 2013 Presidio

    Data Center Practice Manager

    Led engineering teams on large-scale SAN and virtualization projects (EMC, VMware, Cisco) across enterprise sectors.

  7. 2004, 2008 Independent

    Software Engineering Consultant

    Designed scalable Java Spring applications and REST APIs for the real-estate industry. Championed Agile and system modernization.

03 · Research

The seam between performance and privacy.

Two independent research projects in progress, plus a PhD direction that ties them together.

Drafting for the VLDB Journal

MARS, Zero-Wait Pruning for Streaming Analytics

Cloud-native OLAP systems like Snowflake, BigQuery, and Athena hit a problem I call Pruning Lag. Queries must full-scan during the window between data ingestion and index availability. I designed MARS, a logarithmic-bucket routing scheme that achieves immediate pruning from the first ingested row with zero blocking, and proved it near-optimal (Theorem 4): its pruning effectiveness stays within a constant factor of an offline oracle. Along the way I argue for a Rebuild Barrier, the design principle that any distribution-aware scheme needs Ω(N) work before effective pruning, leaving a tight lower bound to future work. On cold Athena/S3 it scans up to ~30× fewer bytes (1795× in the extreme fare ≥ 500 case), which at Athena's $5/TB translates to a material, if data-dependent, cut in query cost (est.).

  • 4.6×Wall-clock speedup (in-memory, 10.6M rows)
  • 5–9×Speedup on cold object storage (Athena/S3)
  • 99.5%Bytes skipped (NYC taxi dataset)
Independent · 2026

EPOCH-ORAM, Multi-User ORAM Without a Position Map

Single-server multi-user Oblivious-RAM constructions have historically been stuck on a mutable position map. EPOCH-ORAM replaces per-access random leaf assignment with a PRF-based deterministic formula ℓ(b,e) = PRF(K, b, e) mod L, enabling coordination-free multi-user access via a shared key. The empirical result reframes the problem. Multi-user ORAM is a coordination problem, not a security problem.

  • 3.5×Overhead vs. single-user Path ORAM
  • 10⁶Blocks evaluated
  • fullObliviousness on single untrusted server
Research · 2025

STRATA, Multi-Column Segment Pruning for Parquet

Standard Parquet zone maps check columns independently, producing false positives on multi-column queries. STRATA tracks which value combinations actually co-occur within each segment via an existence bitset, then applies MARS-based numeric range pruning to skip segments that per-column statistics would miss. Written in Rust, exposing REST and Arrow Flight SQL interfaces. Research prototype backing the MARS and STRATA papers.

  • 98%Segments pruned on selective multi-column queries
  • RustParquet · Arrow Flight SQL · REST
PhD direction

Adaptive streaming analytics, with privacy as the second axis

My immediate doctoral work at FAU continues the MARS thread: streaming-analytics and big-data systems that prune and optimize adaptively as data arrives. The longer arc adds a second axis: can those same systems keep near-zero latency overhead when a privacy mechanism is in the loop, with formally verifiable guarantees, and can the optimizer's own decisions be made privacy-aware through magnitude-aware routing of sensitive data? Performance first, with privacy as a co-design objective rather than a bolt-on.

04 · Building

Products I run in production.

Side projects that turned into real services, running today on infrastructure I designed and operate.

typelets.com

Collaborative IDE for technical interviews and pair programming. Real-time multi-file editing on Yjs, sandboxed code execution in microVMs, problem library with starter files and hidden test cases, structured scoring rubrics, session recording, and built-in video.

virlow.com

Encrypted, privacy-first knowledge workspace for notes, files, and projects. Titles, notes, and files are encrypted on-device with AES-256-GCM before they ever sync, adaptive dashboards surface what's due and what changed, and an MCP integration lets an AI assistant work over your knowledge, with a local connector that never sends your master password to the server.

05 · Writing

Papers, books, and posts.

06 · Stack

What I reach for.

Languages

  • Python
  • Go
  • TypeScript
  • Java
  • C++
  • JavaScript
  • Assembly (x86/MIPS)

Cloud and Infra

  • AWS
  • Google Cloud
  • Azure
  • Kubernetes
  • Docker
  • Terraform
  • AWS CDK

AI and ML

  • PyTorch
  • scikit-learn
  • AWS Bedrock
  • Anthropic
  • Hugging Face
  • RAG architectures
  • LLM integration

Security and Crypto

  • HMAC, AES
  • ORAM constructions
  • PRF-based protocols
  • Lattice-based crypto

Web

  • React
  • Next.js
  • Spring Boot
  • GraphQL
  • Node.js

Data

  • SQL, NoSQL
  • BigQuery
  • Airflow
  • Streaming pipelines
07 · Contact

LinkedIn for engineering, email for research.

Open to academic collaboration, doctoral research conversations, and engineering work at the intersection of distributed systems, ML, and privacy. For research and collaboration, email is best: [email protected]. Not collecting cold pitches. Be specific.