Redefining Machine Learning: A Device-First Approach to AI
Presented at MLCon Munich on 26.06.2025
Abstract
Large Language Models have revolutionized AI — but their centralized nature comes with real costs: concentration of knowledge, privacy risks, and latency. What if we could flip the script, bringing powerful AI directly onto devices with an open-source, developer-friendly machine learning framework?
In this talk, we’ll take you inside our journey of building such a framework in Kotlin Multiplatform — from scratch. We’ll start by exploring the limitations of today’s tools, then walk step-by-step through defining neural networks in Kotlin using a type-safe DSL, compiling them into compute graphs, and running lightweight models like convolutional nets and compact LLMs offline.
You’ll see how Kotlin’s strengths — coroutines, type safety, and multiplatform support — enable low-latency, privacy-first AI that runs directly on-device. With features like flexible tensor layouts and support for multiple file formats, the framework bridges the gap between mobile development and data science.
It’s open-source. It’s powerful. And you’re invited to help shape its future. Expect code, insights, and a hands-on look at how Kotlin is quietly redefining mobile AI.