You should change your blender vertex bake code to have all the coordinate system conversion in it those are wasted shader instructions. Anyway Great video =) *subscribed*

I thought the title was "pivot catching" and was expecting some fancy in-game bug-catching technique. I was pleasantly surprised with something much more interesting XD

I'd never actually thought of using vertex colors to store information like this.

best interactive foliage tutorial I ever watched

Comment so that KZfaq recommends such masterpieces

I would have thought this was just a simple case of instancing, like you'd do with particles. But this makes sense as well. I don't think there's any performance difference (either way it's just one draw command on the CPU and the vertex/fragment shaders run just as many times), but I suppose this way it's easier to design the tree in 3d software.

My today's best gift not only this trees but also increased my inspiration to continue learning python....

I had to check if I was dreaming when I saw that KZfaq had recommended a tech art video. Somehow it had happened, and I’m very happy that it did!

Seriously can’t express how truly helpful it is having the code explained step by step. Helps to better understand what I am actually doing

jeez man, very impressive for what seems to be a lower profile game engine. its you bro.

I've done something like this before with normals - storing the normal of the instancer in an attribute of the instanced object at the point it is emitted, and then using it for shading. It's a neat effect.

This channel is pure gold!

Something like this has never crossed my mind. I'm so glad this popped up in my recommended.

here comes the next great guy who know how to explain certain stuff. super nice quality

Insanely good content, Easely deserves 100x more views!

These are the freakin best code videos on the internet

Your channel is an absolute goldmine when it comes to doing cool stuff with procedural methods. Subbed.

Easiest subscription of my life. Fantastic video

best channel I never heard off

Awesome guide. Looking forward to more content

I always wondered how they did that leaves effect in AC! It's really cool behind the scene

Very neat stuff! Although a lot of the technical aspects went over my head, it was fascinating to see you break down how to achieve the wiggling leaves effect. It really deepens my appreciation for just how much thought & effort goes into little details in my favorite games :]

I don't know anything about this stuff but Holy crap this was interesting. Amazing vid

Wow this is some quality stuff. Subbed!

Hey! Awesome video. The quality is also amazing.

I love your weird programming channel. :)

This is really amazing. Love it!

Would love more videos like this! amazing!!

this is unfairly underrated!

i would have guessed it was done by a vertex displacement shader, didn't know about pivot caching!

That's what I call a good teacher. Thanks

A very cool tutorial and explanation! Thanks mate

Vraiment très compréhensible pour un néophyte et très bien monté, thanks a lot 👌

Fascinating stuff!

very nice youtube channel, things are well explained, thanks a lot i learned a lot, can't wait for new videos!

Very sweet tutorial! Thank you so much

Another great video! Great job! Waiting for more content from you ;)

great work and really well explained, thank you :)

This is really clever, thanks for sharing.

programmers are absolute wizards, so thankful for them as an artist lmao

this was an immediate subscribe. thank u for the video!!

Awesome! Thank you for video

i feel like you could do something similar by passing each vertex through some combination of sin(t), cos(t), tan(t) on the X, Y, and Z coordinates (with cofactors for things like wind speed and frequency). another idea which i've come up with for more advanced/realistic foliage (which might not look appropriate for the AC vibe) is assigning a texture where the R, G, and B channels are stats like flexibility (how much the vertex closest to each pixel can be displaced), sensitivity (a scalar multiplied by the offset for the vertex closest to each pixel), and time offset (given the offset be the sine of some time variable, the offset from the given time value. not super useful for foliage, but works for the wavy-ness in things like cloth and flags that would wave in the wind).

A LOT MORE content like this, PLEASE!!!

Quality content id say buddy

I think it's just some sine waves in a shader, I do it in my voxel engine, you're right that it isn't rigged and it is a separate mesh from the unanimated parts though. In my game, the sine wave is offset by the vertex position, so that vertices near each other undulate similarly. What you think is the "pivot" is just a vertex or two on each leaf that isn't being animated. I have to do this in my engine as well as the leaf vertices that connect to the tree can't animate, or else you'd see behind the mesh into the void. EDIT: a second later I realized that the leaves do kind of rotate a bit, so it's not per vertex it's per leaf so I guess they probably did do pivot caching like you say. Seems like a lot of manual work to define all the pivots, but I guess my way is easier for me partly because my mesh is already procedural and it's no extra work really to define it per vertex.

I'd love to know more about that thing where the horizon folds away really quickly. There was a similar effect in Cosmic Break and it's nostalgic for me.

Wow! Subscribed.

cool.. it'd be neat to link this with a weather system where wind fluctuates within different ranges, based on the current weather.. so on calm days, the leaves would range from barely any movement to just a little bit, where during a gusty day, they would have moderate movement with spikes of intense movement and on a stormy night, they might be moving rather violently for extended durations. Never played much Animal Crossing, so I don't know if they already do that.

This tutorial is very nice. Please consider to make a tutorial about this terrain system of animal crossing!

amaaaazing! Keep it going :)

Pog dude. Thx

Oh man, I just discovered your channel and you've got some truly wonderful videos on here. I hope you eventually continue.

this is an underrated gem of a video

Really good content. Keep up the great work ;) sub

Bro.... youre so smart bro...

I have seen a very similar effect on twitter that was done by wiggling the leaf texture back and forth, that seems easier to set up but looks maybe slightly worse

I believe the leaves were done in a shader

Dope

Seem you are loving to do this kind of work, you should consider using houdini

GOATED

Nice

noice noice immediate sub

5:36 this was a problem in Blender at the time. Now, with Geometry Nodes, it has been fixed. But this one was Blender's fault and couldn't have been fixed inside of Blender without modifying the source code.

How did I not find this chNnel before now? Really hope this guy makes more content

Silly idea, but I wonder if this could be used to create fascimile movement of a crowd e.g. watching an event - just enough so they don't look like statues, if you can't invest in actual idle animations for them. Especially in a more stylized artstyle.

may i suggest looking at the brenches of smaller trees in rdr2 ? i think its the same technique but its player intractable and i think it even updates some of the collision

Martin said that it is possible to store both position and rotation info using vertex colors. So, does that mean a vertex can be assigned multiple colors or is it somehow stored in a single vertex color? Is there a video which shows storing both?

Although blender will support floats for vertex colors having them stored as byte sRGB has benefits (memory+performance) note that the sRGB linear conversion does not match it from blender.

If you're saving the pivots, why not also save rotations? Then you can just draw them as particles at runtime. But this would be useful if there were mixed kinds of leaves or various meshes for the effect.

This is basically like pushMatrix() and popMatrix() for anyone familiar with Processing 3 or p5.js

I suspect the non-linear color space transformation happend at export from Blender due to the color space settings being set to sRGB.

Could something like this be used in Unreal Engine 5? Nanite is an amazing tool but it doesn't allow meshes to bend or change. meshes must be static, however static doesn't mean they can't move. One of the biggest complaints is that you couldn't simulate leaves moving because that normally bends the leaves' meshes/ triangles. So could this be used? to just pivot the leaves so it looks like the wind is blowing but still has nanite active on the foliage?

1:50 you could make great use of geometry nodes here to avoid particle systems.

next, let the GPU actually permanently modify the stored pivot cache and have it be affected by gameplay. You could have some input value for the wind/forces in the current area, let the GPU move all the leaves accordingly by modifying the pivot values, render out the pivot data texture to be read back on CPU and re-input to the GPU again. This way your leaves can blow off the tree and be affected by forces determined by the CPU (like wind or a player swinging a weapon near the leaves, etc), and the CPU doesn't need to do anything other than read and send the texture back to the GPU. This sort of compute shader work is tricky in Godot 3 as it's not really setup for it, but it can be done. Maybe it's easier in 4.

I feel it would realistically just be instanced meshes that are moved about by a vertex shader. Given that all the leaves are essentially the same mesh you could 'instance' the mesh. Pretty much you send the mesh and vertex data (so things like the position, normals, uv coords for each vertex) to the GPU once, but send the transform matrix (position, rotation, etc of each leaf) to the GPU for each individual leaf. Although this is more effective for larger meshes, it could still be done here. Then all you need to do is some sine wave magic in the vertex shader to move each vertex a little bit, and if you wanted a random look you could also use a RNG seeded to the leaf's position. The vertex shader would simply offset the income vertex positions by this randomized sine wave function. As a result you get the waving leaves with pretty much 0% CPU usage, which by extension means that you can use this for entire forests, though you probably don't want to use a trigonometric function like a sine wave for that if you want really good performance.

Solid video! Instasub!

What's the benefit of doing it this way rather than each leaf being it's own object, parented to the tree object, using object center as pivot, and z+ as forward vector? Is it for performance? or is there some other cool benefit I'm missing out on?

Wouldn't a very similar code work as animation directly in blender which could then be exported as one big jiggling frame-animated mesh to avoid all the conversion details? Seems like something Python and key framing that bpy could handle. Or does a game engine not import blender animations or maybe it's to manage control of the effect in the engine? What are some other approaches, if any (briefly of course lol I don't expect an essay) if you have time to indulge my curiosity? Thanks for your work, this channel was a great find.

Man, storing pivot data as color nice solution. How do you think the triangles on the ground were added? They don't overlap, and they dont seem to appear in raster, aka some hexagon, square, rectangle, or triangle tiling. How come they are so well spread out? Is it voronoi noise? Probably? Some sort of random points -> triangles with space between each other. How can that be done?

I don't know about vertex colors, cause then you're limited to the minimum and maximum values. You should try using a couple of uv coordinates, one for x and y and another for z (and whatever else you want to use, maybe a time offset? Idk) Of course I don't know what Godot has I'm more a unity girl

It'd be really cool if you could redo this tutorial but explain all the steps properly. Upon trying to do this myself, I feel like a bunch of extremely important steps get skipped. Still, great video and subbed!

3:43 Press 'P' with the object selected and click "Separate by loose parts"

any reason it was done in colors? and not something like Vector3? smart approach, nonetheless. great work :)

make an array from children objects (leaves) and a "for each" scripted animation with some randomized values seem 100 times easier than what you suggest. I doubt it's more performant though but should be okay... It would deserve a try

@Martin Donald why did you stop?

Is it possible to rotate them based on uv center?

Ha! That's a LOT of explanation for a much simpler technique (assuming you're not constrained to what blender can do). Firstly, no need to color the leaves - you can use their coordinate relative to the origin of the tree as an input to a randomization function (I use the product of the low order digits of the leaf's xyz coordinate) and add the time/frame number to it modulo some constant that gives them a frequency - and stuff that into a sin() function to turn it into a sinusoidal variation - providing smoothly varying random motion that's unique to each leaf...use that to make a translational and/or rotational component to add to the base position of the leaf - and you're done. About 5 lines of GLSL shader code. Doing that saves sending color data - which saves lots of time. Personally, I wouldn't store the leaf geometry at all. Treat each spherical leaf clump as a single point object and do 100% of the math for leaf generation in a tesselation shader. Parameterize the heck out of it...done.

godot gang

Goated video

Wasn't there a section about leaf colour... maybe it was a different video

I wish I could utilize this tutorials info but I just don't understand it...

Couldn't you do unary minus rather than multiply by -1?

3:23 misspelled colour

couldnt you just generate a bunch of random points, apply the rotation then generate the meshes using a geometry shader instead?

I don't understand how this speeds things up.

instead of a script, you could instead use material displacement with a random seeded from: instance-id, particle-id, or random per island

This was a good video. So good that it's surprising to some that this doesn't have more views. However, your thumbnail and title could use some more work. Well, a lot more work. I think that's where the problem lies with your view count. So here are some tips you didn't ask for but I am giving you anyways. My thought process when clicking on this video was: "I have no idea what this random video that popped into my recommendations is, but I don't play animal crossing so I don't really care. Except, shouldn't youtube know this? The fact that this popped in my recommendations means the algorithm thinks I'll like this, despite the video having such an unattractive title and thumbnail. You know what, might as well check it out then" When someone's thought process for clicking on the video probably should be more along the lines of: "Hey this video looks interesting, I'd like to know more" followed by an instinctive click because human brains are fueled by curiosity. Your title tells me nothing about what the video will be about, and the thumbnail doesn't add anything to that either. A title should make you curious or intrigued, and should give you at least a bit of information. What your title is telling me is that it's a video about animal crossing and pivot caching which is something I've never even heard of. I think your title doesn't tell me enough about what the video is about. And pivot caching is something viewers are more likely to learn after clicking on the video, so it'd be better to only mention it in the video itself (since it would add nothing to the title) What I might do for a title here is something along the lines of "Remaking The Wobbly Leaves In Animal Crossing". Tells you what the video is about, but on its own probably won't attract that many people who haven't played animal crossing. That's where the thumbnail comes in. Thumbnails are the best way to get someone's attention, since it's likely the first thing a viewer will look at. Your current thumbnail doesn't grab attention. It isn't visually interesting, and the text doesn't do that much for it either since "Pivot caching" is something the viewer has probably never heard of before. In this case, since wobbly leaves is an animation, it'll be a bit hard to make a thumbnail demonstrating that effect. I think I'd just show the tree you've made with some wobbly text saying "Wobbly Leaves". Text shouldn't be too big, because you need to see the tree. And no blurring the background image. Just makes it harder to see what's going on. You can still edit titles and thumbnails after uploading a video, so I'd try this and check your analytics for the video, and under reach, see if it improves the "Impressions click-through rate". This number basically shows how many people who the video has been shown to actually clicked on the video. For reference, of my 3 public videos, my lowest is 11% and my highest is 16% You can also completely ignore this comment I spent way too much time on if you don't really care about the views. But if you need/want more help, my discord is Rysea#9959

my brain: what did he say?

Instead of moving the mesh to the origin, rotating by your wind vector and returning it, why not just offset the wind vector by your pivot vector? Shouldn't that achieve the same thing.