.files

Generative Adversarial Network

Community list of startups working with AI in audio and music technology

Performs interactive audio synthesis using a previously trained auto encoder. VIsualizes hidden layer and allows for interaction with hidden units. W/ Andy Sarroff. See Andy's github (woodshop) for more interesting projects using Deep Learning and audio synthesis.

Audio and Music Analysis and Synthesis in Python

ARCHIVED: Contains historical course materials/Homework materials for the FREE MOOC course on "Creative Applications of Deep Learning w/ Tensorflow" #CADL

Testing

Caffe models in TensorFlow

CARPE is "Computational Algorithmic Representation and Processing of Eye-movements". It supports visualizations of film/eye-movements in columnar format, peak-through visualizations, heatmaps, optical flow analysis, gaze clustering, and many other visualization options. See http://thediemproject.wordpress.com for more details. Compuational and Algorithmic Representation and Processing of Eye-movements - OSX Version

CARPE is "Computational Algorithmic Representation and Processing of Eye-movements". It supports visualizations of film/eye-movements in columnar format, peak-through visualizations, heatmaps, optical flow analysis, gaze clustering, and many other visualization options. See http://thediemproject.wordpress.com for more details. Initial release of CARPE hosted for historical purposes. Includes many experimental addons for CARPE including dROIs, GMM, GPU-Flow, and others. See also CARPE and NSCARPE for more recent, stable versions not including the experimental addons.

openFrameworks projects from my course at Srishti's School of Art, Design and Technology's Center for Experimental Media: http://pkmital.com/home/teaching/cema-workshop/

Contrastive Language-Audio Pretraining

This Unreal Engine plugin integrates Convai API for conversational AI and environment perception and action-taking by the AI in Unreal Engine.

(unfinished) storing data in leveldb

Describing CycleGAN (excerpt from CADL course on Kadenze, Inc.)

Discrete Figures AI: Seq2Seq of Dance Data (Mikiko + Daito Manabe + Kyle McDonald)

Matlab scripts specific to the DIEM database

testing eeg encoding/decoding. this produces some gabor wavelets and co-registers the visualization and recording of eeg.

For streaming/logging emotiv eeg headset data

testing some encoding/decoding using EEG. this produces various animations that are co-registered with the recording of eeg.

Some basic tutorials I write to myself as I attempt to learn to work with the Ethereum blockchain

Example of serving a TensorFlow model with Flask and UWSGI

Uses cURL to download from Freesound.org

Does finger tracking, contour analysis, and different types of shape description for the hand contour using a 3D ROI around the hand-tracked by NITE middleware, using OpenCV 2.2, an OpenGL scene, and OpenNI.

LuminOrder: An OS X app to reorder a video in order of its frames' brightness levels.

Python audio and music signal processing library

Magenta: Music and Art Generation with Machine Intelligence

Multiscale Visualization ToolKit

Generative Sound Practice w/ OpenFrameworks

More projects are listed on my github