(Ryan Collingwood) Garbage in, garbage out. We all know that, but it's hard to know what to do about it. Documenting everything is well-intentioned, but it's often too detailed or too tedious to be effective. So what's the solution?
Code.
Using code to spell out the expectations between data producers and data teams can help to ensure that everyone is on the same page and that the data is of the highest quality. This approach is ambitious, but it has the potential to change the way we collaborate and instil confidence in our data.
I'll share my experiences with this approach, including the challenges and the wins. I hope you'll join me in exploring this new way of working with data.
pretalx.com/pyconau-2023/talk...
python, pycon, australia, programming, conference, technical, pyconline, developers, panel, sessions, libraries, frameworks, community, sysadmins, students, education, data, science
Videos licensed as CC-BY-NC-SA 4.0
PyCon AU is the national conference for the Python programming community, bringing together professional, student and enthusiast developers, sysadmins and operations folk, students, educators, scientists, statisticians, and many others besides, all with a love for working with Python.
Licensed as CC BY-NC-SA - creativecommons.org/licenses/b...
Produced by Next Day Video Australia: nextdayvideo.com.au
Fri Aug 18 14:30:00 2023 at Hall C (Plenary)