Artificial Intelligence

Rahul Thomas, Teo Kitanovski, Micah Goldblum, Arka Pal

Dynamic Delayed Tree Expansion For Improved Multi-Path Speculative Decoding

Arka Pal, Louai Zahran, William Gvozdjak, Akilesh Potti, Micah Goldblum

Privacy-Preserving Mechanisms Enable Cheap Verifiable Inference of LLMs

Rahul Thomas, Arka Pal

Greedy Multi-Path Block Verification for Faster Decoding in Speculative Sampling

Rahul Thomas, Arka Pal

Global Resolution: Optimal Multi-Draft Speculative Sampling via Convex Minimization

Arka Pal, Teo Kitanovski, Arthur Liang, Akilesh Potti, Micah Goldblum

Incoherent Beliefs & Inconsistent Actions in Large Language Models

Rahul Thomas, Louai Zahran, Erica Choi, Micah Goldblum, Arka Pal

Cascade: Token-Sharded Private LLM Inference

Eva Zhang, Arka Pal, Akilesh Potti, Micah Goldblum

vTune: Verifiable Fine-Tuning for LLMs Through Backdooring

Micah Goldblum

Model and Data Watermarking