We will develop a software program that interacts with human musicians to automatically co-author music in real time using machine learning. Our real-time interactive system contributes to and draws from already existing branches of study in music composition and computer science. From computer science, the system applies techniques from Music Information Retrieval (MIR) and Machine Learning to analyze and generate musical content. Within the domain of music composition, our piece aims to develop an interactive digital framework for gesture-based music improvisation.