Link to this page location: #top
Link to this page location: #top

ai/ml in visuals

with vadim epstein

Link to this page location: #about

This author's course is targeted at practicing designers and media artists who work with modern digital imagery and wish to expand their creative palette to the current state of AI/ML progress.

We offer a practical and unique path to establish a solid ground for AI/ML experiments. The material represents a balanced combination of theory and custom open-source tools. The program cuts many corners of the usual presentation of AI/ML but does not trivialize the learning process, allowing you freedom in how you absorb the material.

Within 8 weeks, typically with two lessons per week, you will get the core theory of Visual AI/ML along with handy instruments – both locally installed and cloud-based – including GANs, Stable Diffusion, and other practical tools for image processing. After the fourth week, there is a spare week allocated for independent study, with the last week dedicated to your project.

Start

February 3rd

Duration

8 weeks

Your skill level

Beginner, Intermediate

Software

PyTorch/TouchDesigner

Commitment

2 lessons per week

End date

Soon

Format

Online, Curated

Who needs this

Motion Designers Media Artists 3D Artists VR / XR Producers NFT Artists Interactive Developers Musicians VJs AI/ML Enthusiasts Designers

Streamlined complexity

The course can be seen as a comprehensive guided tour that explains the principles and details of Neural Networks operations without delving into complex mathematical formulas or advanced programming. The architectures and their specifics are covered up and down – from the big picture to the low-level experiments.

Clear perspective

One of the most important aspects of the course is the holistic Creative Coding approach, which connects ’classic’ generative practices like TouchDesigner to modern AI/ML applications. While it may lack some hot niche topics like prompt engineering, it provides a uniform understanding of the area and its place in the modern high-tech artistry.

Creative origin

The author of the course is a recognized practicing artist, therefore the program is built upon an artistic perspective, exploring the aesthetic (and/or even semantic) aspects of the technology alongside its functional features. The course also goes beyond popular toolkits and includes a few lesser-known tricks and techniques introduced by the author.
In short, it’s by an artist and for artists.

Applied outcomes

Alongside developing general concepts, students will master specific tools – from DeepDream to GANs to Stable Diffusion – set up at their disposal. The course won’t compete with the army of Youtube tutorials focused on tweaking UIs; instead, it complements them with a view from the inside.

Absolutely, if:

you are ready for intensive, active, self-directed work

you actively assimilate diverse materials

you're eager to communicate w/ teachers and students

you are seeking distinctive AI/ML mastery

Maybe not, if:

you are looking for effortless step-by-step instructions

you are frightened by uncertainty in the work

you expect the teacher to hold your hand

you are looking for an easy way to master AI/ML

Absolutely, if:

Maybe not, if:

you are ready for intensive, active, self-directed work

you actively assimilate diverse materials

you're eager to communicate w/ teachers and students

you are seeking distinctive AI/ML mastery

you are looking for effortless step-by-step instructions

you are frightened by uncertainty in the work

you expect the teacher to hold your hand

you are looking for an easy way to master AI/ML

Link to this page location: #galery

1.1. Intro to the course
Python, Colab vs local, libraries and modules. Framework setup.
1.2. Introduction to the neural networks
Neuron, graph, loss function. Training as an optimization process. CPPN (image reproduction)

2.1. CNN: concept, features
Convolutions as graphics filters, how they process & store data.
2.2. Architectures & building principles
Style transfer, autoencoders, GAN. Features, iterative pipeline, network extensions.

3.1. Modern GANs
ProGAN, StyleGANs. Latent space - animation, blending, projection, special tricks.
3.2. StyleGAN2 training
Data preparation, training process. Augmentation.

4.1. Image transformations (image-to-image)
From pix2pix to StarGAN2. Applied methods overview.
4.2. Integration with TouchDesigner
OSC, NDI, built-in Python with TouchEngine

5.1. Multimodal synthesis with foundation models
CLIP, early iterative methods. CPPNs, Aphantasia, VQGAN.
5.2. Transformers & Diffusion models
Attention. Denoised & latent diffusion.

6.1. Stable Diffusion as the current generative tool #1
Architecture, use cases: txt2img, img2img, interpolations, video. Controlnet
6.2. SD finetuning. Other tools & libraries
Textual inversion, Custom diffusion, LoRA. Diffusers, ComfyUI.

Development of the own project with visual AI/ML methods

Link to this page location: #team

Vadim Epstein

Course Author

MEDIA ARTIST, DIRECTOR, EDUCATOR, CODER, VJ

Former IT consultant and casual theoretical physicist, combining serious technical background, strong corporate experience and vivid creative mind. Has worked in various fields such as net.art and science art since 1996, eventually focused on visual media with stochastic algo narratives.

As an artist and curator, had made visuals for hundreds of concerts, festivals, parties, and commercial events. The artworks have been exhibited worldwide in Montreal, Vancouver, Stuttgart, Paris, London, Moscow, Lille; highlighted on the conferences NeurIPS 2020 / 2021 / 2022, CVPR 2021; sold as NFT collections, etc.

Besides commercial and personal projects, has delivered numerous talks, workshops and training courses.

More info

Stanislav Glazov

Instructor for TouchDesigner integration

FOUNDER OF HOU2TOUCH, TEACHER

3D and audiovisual artist with over 22 years of experience in computer graphics and 20 years 
of teaching experience.

Worked in the production of the computer game Killer Tank, Pilot TV, on the first Russian animation projects in the Classic Studio, on the largest film projects in the German studios Trixter Film and Scanline CA as a technical director for pipeline, Character Animation, Cloth Simulation TD, RnD for VFX.

  • After 2010 - creation of an automated infographic visualization system for Kommersant TV, cooperation with the largest Russian companies - SilaSveta, Stereotaktik, Invisible, Raduga Design - on VideoMapping projects.
  • In 2013, he created his own generative design studio Licht.Pfad. Cooperation with WhiteVoid. Creation of AV Performances in partnership with Dasha Rush, Robert Lippok
  • Performances at all the iconic festivals of the planet: Berlin Atonal, Mutek Montreal, Ars     Electronica Linz, Unsound Festival in Krakow, Raster-Noton night in Berghain, Barbican London, Resonance Festival in Tokyo, Mira Festival Barcelona, L.E.V. Festival, Light Festival Lyon
  • Since 2016 - working on theater projects with Maxim Didenko, including the creation of media servers for various performances.


Link to this page location: #book

Minimum skills (heavily used throughout the course): general familiarity with command line (shell) operations and file paths. Get fluent with it in advance.
Programming skills will greatly help with exploring specific details of the used instruments.
Prerequisites are flexible: the more you know, the more you get.
The effectiveness of the course depends mostly on your learning skills and activity rather than on specific existing knowledge. Every student may have their own learning curve rather than following a fixed mandatory way.

Complete course program would require Windows computer with a decent Nvidia GPU with at least 6Gb VRAM (hard minimum is 1060, reasonable level 2070+).
Users with Macs would be able to use online Colab versions (no integration with TouchDesigner in this case).

Yes, a partial payment option is available: 50% before the start of the course and 50% one month after the start.

Yes, all practical topics have corresponding tasks to complete as homework. Most of them require you to repeat the actions from the lectures on your own. We recommend you execute them even if everything is clear in theory to ensure that you won’t face unexpected issues in your future work.
During the final week, you will have to develop your own project (with our assistance) as a kind of exam for the obtained knowledge.

10-12 hours per week should be sufficient to master the necessary concepts and skills. However, you may want to invest more time for more exhaustive explorations. Remember, the course program is open-ended: nearly all topics are not limited in scope and have lots of options for extra developments.

Link to this page location: #contacts