On this episode, we’re joined by Soumith Chintala, VP/Fellow of Meta and Co-Creator of PyTorch. Soumith and his colleagues’ open-source framework impacted both the development process and the end-user experience of what would become PyTorch.
We discuss:
- The history of PyTorch’s development and TensorFlow’s impact on development decisions.
- How a symbolic execution model affects the implementation speed of an ML compiler.
- The strengths of different programming languages in various development stages.
- The importance of customer engagement as a measure of success instead of hard metrics.
- Why community-guided innovation offers an effective development roadmap.
- How PyTorch’s open-source nature cultivates an efficient development ecosystem.
- The role of community building in consolidating assets for more creative innovation.
- How to protect community values in an open-source development environment.
- The value of an intrinsic organizational motivation structure.
- The ongoing debate between open-source and closed-source products, especially as it relates to AI and machine learning.
⏳ Timestamps:
0:00 Intro
1:28 PyTorch’s development history
4:04 TensorFlow’s PyTorch influence
8:28 Symbolic vs. eager execution model comparison
20:36 Software development considering hardware capabilities
23:07 Open-source success metrics
27:11 Incorporating overlapping library functionality
32:35 Working in a community-driven setting
42:53 PyTorch retrospective analysis
43:54 Developer expertise impacting ML innovation
47:06 Future innovation and philosophical frameworks
50:36 Open-source vs. closed models
54:45 Soumith’s work in robotics
Resources:
- about.meta.com/
- pytorch.org/
Thanks for listening to the Gradient Dissent podcast, brought to you by Weights & Biases. If you enjoyed this episode, please leave a review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation.
#OCR #DeepLearning #AI #Modeling #ML #Meta #pytorch