Ever wondered how to effectively integrate AI tools into your pipeline? With Machine Learning Operators for SideFX Houdini, Paul Ambrosiussen and Moritz Schwind are bringing the most popular machine learning techniques to your studio. Explore the latest iteration on their open source toolkit which amongst other things brings AI based segmentation, data analysis, generation and training to SideFX Houdini. They will demonstrate some of the core features and are eager to discuss opportunities for machine learning in a VFX / games context.
00:00 Presentation
02:16 Intro to MLOPs
03:00 Some Features
03:58 Training
12:04 Local & Distributed
14:51 Analysis Tools
18:20 Interlude: Stable Diffusion in two minutes
21:14 Interlude: Community Works
22:54 Measuring Prompt Similarity
24:53 Measuring Image Similarity
32:56 Why doesn’t it work?
34:10 UX Improvements
34:35 Future Plans
35:50 Community Examples
36:12 What We Are Looking For
37:14 Q&A
Moritz Schwind. Be it pixels, hardware, code or cameras - if it’s interesting, Moritz is gonna take it apart. And sometimes even reassemble it. In his spare time, he likes to dabble with code and create generative artwork. He claims his early exposure to QBasic is no help at all when working in Houdini, Blender, Processing or Arduino. But it might have been what started his fascination for the boundaries of code and art. When not wreaking havoc to any intriguing devices around him, he works as a freelance Technical and Art Director. His more recent areas of interest cover the use of scientific algorithms in generative design and the application of AI in creative fields. Together with Manuel Casasola Merkle he runs Entagma, a learning platform focused on generative design using mainly SideFX Houdini.
Paul Ambrosiussen is currently a Technical Artist at Bismuth Consultancy. He was the Lead of SideFX Labs prior to that. Paul finished his BASc in International Game Architecture and Design at NHTV University of Applied Sciences in Breda. Paul enjoys writing tools to support effective art-pipelines, and maintaining tool/workflow quality for the artists he is assisting. His goal is to help others create amazing things in a better, faster and more flexible way. He creates tutorials, gives live lectures, attends events, and presents custom workshops to customers.