No video

Faster than a regular database index

  Рет қаралды 19,892

PlanetScale

PlanetScale

Күн бұрын

👉 How I seed data: • How I add millions of ...
To learn more about PlanetScale, head to planetscale.co...!
💬 Follow PlanetScale on social media
• Twitter: / planetscale
• Discord: / discord
• TikTok: / planetscale
• Twitch: / planetscale
• LinkedIn: / planetscale

Пікірлер: 60
@avrukin
@avrukin 8 ай бұрын
One recommendation for the benchmark - choose the date randomly, ie have your start/start+1 be a random value in the range of values (min, max). The reason you want to do that is because doing a repeated benchmark on the same date, you are very likely hitting either cpu cache or other caching in the application tier, doing each one of the queries in the iteration loop with a random date is both more realistic in terms of actual user behavior as well as avoids the cache hit scenario.
@pietraderdetective8953
@pietraderdetective8953 8 ай бұрын
Yeah this is what I got in mind..also adding the number of repeated tests for the "faster method" while reducing the repeats for the "slow" method accentuates this issue --> makes the slow method slower and the fast method faster --> widening the gap. For better result, benchmarks should be done using the same repeat times.
@xcrap
@xcrap 8 ай бұрын
There's something satisfying in optimizing code, databases, etc. When you gain significant performance, it just feels right :)
@GringoDotDev
@GringoDotDev 8 ай бұрын
This is awesome! I'd love to see a video at some point talking about best practices for modeling time series data in MySQL
@ahmad-murery
@ahmad-murery 8 ай бұрын
Covering index is great but one must keep in mind adding only necessary columns to the composite index, otherwise the DB size will get bigger unnecessarily. But again, why the reversed index (email, created_at) was created for? I didn't get it🤔 Thanks Aaron!
@master74200
@master74200 8 ай бұрын
Not only will the size grow but insertion/updates will increase in time as well, as the indexes will need to be updated as well. The more you index, and the more indexes you have, the longer the writes will be.
@ahmad-murery
@ahmad-murery 8 ай бұрын
@@master74200 Exactly👍
@kyleareich
@kyleareich 8 ай бұрын
dude your videos are the best. I've learned so much from you. Specifically: your videos cover ONE topic very well, very clearly, and very thoroughly (is that a word)? Thanks for your work!! You're a great speaker/teacher as well.
@mikwit
@mikwit 7 ай бұрын
Would love a video on when to use bitmap indexes on low cardinality columns with dynamic multi-column searching (e.g. slicing and dicing data in a dashboard). I know it’s faster than b-tree indexes, but a video showing it would be awesome.
@Ratamir
@Ratamir 8 ай бұрын
Man, I dont usually write comments, but your videos are on the next level. They are just perfect. Amazing work! Great Job!
@nowendwell
@nowendwell 8 ай бұрын
That's a lot of 7s...
@PlanetScale
@PlanetScale 8 ай бұрын
I got caught in a loop there
@nowendwell
@nowendwell 8 ай бұрын
@@PlanetScale Loved it. When recursion goes wrong.
@Kane0123
@Kane0123 8 ай бұрын
A joke only for the dedicated few
@AlexCernat
@AlexCernat 8 ай бұрын
you should mentioned that PK is included in index only on SOME mysql/mariadb engines (i.e. innodb, maybe others); for myisam (well, who use myisam anymore?) and mostly other engines the PK is not included in the indexes in rest, great video (as usual), maybe developers should learn more about how a database work in order to not produce junk queries; but with ORMs nowadays, you mostly don't have control anymore about what is executed ...
@clixm
@clixm 8 ай бұрын
Wow, genius!! That benchmark tool is very useful too
@Lord2225
@Lord2225 8 ай бұрын
This benchmark might be very worng due to caching. Idk how mysql works but every db i worked with has few layers of caching and repeating one query over and over might benchmark only cache itself.
@rafaelamadigidalsanto113
@rafaelamadigidalsanto113 8 ай бұрын
Your videos are great. I love them. I have a suggestion for you. Could you make a video explaining how to optimize this type of query: select * from order as o join order_item as oi on oi.order_id = o.id where o.client_id = 123 and oi.product_id = 321; Even if we have an index on the column order.client_id and another one on the column order_item.product_id, this query could be slow if the filtered client_id and product_id appear in many rows. That's because the join implies a lot of index lookups on the other table. The only way I know to optimize this type of query is to create a materialized view with data from both tables and create a single index on both columns. This way, the database can filter both columns at the same time and won't have to perform separate index lookups. The problem is that MySQL doesn't have materialized views, as far as I know.
@zgetro
@zgetro 8 ай бұрын
But MySQL does have views. You can use that
@mikevanegmond
@mikevanegmond 8 ай бұрын
Hey Aaron, one thing I was curious about that might be right up your alley: What indexes should I use for a table that can be filtered on any column? Usually you would index fields commonly found in your where statement, but you can't just index every column right?
@TES-A5
@TES-A5 8 ай бұрын
Interesting that you mentioned PostgreSQL here and its ability to bring along extra columns with index. Even though it can do that, i was able to make my query faster after using indexes using the method you showed. It went from 450ms avg (single index) to 240ms avg (multiple indexes with ride along columns)
@kirayamato6128
@kirayamato6128 8 ай бұрын
get() method is different to select() cuz get() is for collection or object while select() is for db query. I think it's better to use select() instead of get()
@oOShaoOo
@oOShaoOo 8 ай бұрын
Really useful video, especially the information about the primary key within the compound index. Does that mean it is useless to create compound indexes containing the primary key (for example created_at+id) ?
@mihnearadu990
@mihnearadu990 8 ай бұрын
Hey Aaron, great video but I think you missed something here. I would tell everyone to not add index that they don’t need in their app. Multiple reasons why this is unadvisable but in the end it just ends up slowing the query back down. So in a table with 5Mil entries and 10-20 columns, you would not create a composite key ok created at and any other combination of column/columns you might need. Related to this, you can make a video showing people that mysql only uses only an index when performing searches and that it calculates automatically which index is best to use. ( and us such, calculating that for 20 indexes on a table will result in slowing stuff down )
@ucretsiztakipci6612
@ucretsiztakipci6612 8 ай бұрын
I wonder what would happen if we even add partition for year?
@reed6514
@reed6514 8 ай бұрын
Me too. My queries only deal with a few hundred rows so it doesn't matter for me lol, but it would be interesting to see.
@mahmoud-bakheet
@mahmoud-bakheet 8 ай бұрын
Alright so how we can apply this technique to the searching or filtering stuff ? I mean in a real application , is it mean we have to create different type of index?
@zgetro
@zgetro 8 ай бұрын
No, it totally based on your application needs. like for example from application requirements Search: i would use algolia. Reports: create Views or SP. Quey On Large single table: index or combin index. Quey on Join table with ORM: will use Ladacache Package for cache in redis
@alexandruciocan3128
@alexandruciocan3128 8 ай бұрын
In my big table, I noticed a better performance if I'm using the entire datetime for created_at, like: Where created_at >= '2023-12-03 00:00:00' and created_at
@sterben1941
@sterben1941 8 ай бұрын
The fastest way is to remove the card in the hobby plan
@LenWoodward
@LenWoodward 8 ай бұрын
I'm sure I've just missed it, but I'm not understanding why we had to create the inverse of that index
@reed6514
@reed6514 8 ай бұрын
I think he skipped over that...
@mrbigsmile3902
@mrbigsmile3902 7 ай бұрын
He created it to show with EXPLAIN that the planner chooses the other index. So the reverse isn't necessary
@peteraylin
@peteraylin 8 ай бұрын
As always, AWESOME!
@RajveerSingh-vf7pr
@RajveerSingh-vf7pr 8 ай бұрын
13:05 : holly
@Septumsempra8818
@Septumsempra8818 8 ай бұрын
Paginators. Please help with optimizing pagination which usually implements a count(*)
@nunosdonato
@nunosdonato 8 ай бұрын
dont do it :)
@Septumsempra8818
@Septumsempra8818 8 ай бұрын
@@nunosdonato please elaborate
@JanezNovak-fk4qr
@JanezNovak-fk4qr 8 ай бұрын
This is good stuff. Thank you.
@alexrix4063
@alexrix4063 8 ай бұрын
Video request 🙋🏻‍♂️have been hoping out for a while as it was mentioned on a previous video: geospatial indexes
@TES-A5
@TES-A5 8 ай бұрын
You should release your editor theme settings... The Aron Theme... Make it happen. 💙
@RaicaBogdan
@RaicaBogdan 8 ай бұрын
Those damn sevens!!! :)) haha , top notch info, thank you. I did not considered about these type of situations, I'm smarter than yesterday now. ✌
@AnthonyBullard
@AnthonyBullard 8 ай бұрын
PHP? I didn’t know you drove a Lamborghini
@veetaha
@veetaha 8 ай бұрын
Aha! I knew you knew some things about Postgres!
@20toninho
@20toninho 8 ай бұрын
amazing, loved this content ...
@RandomGeometryDashStuff
@RandomGeometryDashStuff 8 ай бұрын
is created_at stored as string?
@userasd360
@userasd360 8 ай бұрын
can you provide the data for the queries that you are using
@dragonwave2652
@dragonwave2652 8 ай бұрын
Hello, thank you for your videos. I am improving my queries
@MohammadAminZakeri
@MohammadAminZakeri 8 ай бұрын
A question : in mysql how to optimize count(*) on a table with more than 150m rows (I mean a large table) and surely I use where in it ?
@softwaredeveloper6791
@softwaredeveloper6791 8 ай бұрын
Is there a way to test repeatedly without having MySQL buffering give better results for subsequent queries? Change InnoDB settings?
@a-name-or-not-a-name
@a-name-or-not-a-name 7 ай бұрын
If you make your dataset much larger than available RAM then RDBMS would not be able to fully cache the data.
@viniciusataidedealbuquerqu2837
@viniciusataidedealbuquerqu2837 8 ай бұрын
that terminal font is beautiful. care to put it on the description for less people asking?
@csanadtemesvari9251
@csanadtemesvari9251 8 ай бұрын
If you ain't seeded, stay seated and watch this video!
@medicallabnapata9082
@medicallabnapata9082 8 ай бұрын
Amazing
@Dev-Siri
@Dev-Siri 8 ай бұрын
this is the fastest query for mysql to process: it takes 0.000000s and costs $0.00 to run.
@reed6514
@reed6514 8 ай бұрын
EXPLAIN your queries please. And show us your schema!
@reed6514
@reed6514 8 ай бұрын
8:43 thank you! I spoke too soon maybe.
@PlanetScale
@PlanetScale 8 ай бұрын
Ha, I appreciate the enthusiasm
RAND is too slow (in MySQL)
17:32
PlanetScale
Рет қаралды 13 М.
Easy database indexing strategies
36:03
PlanetScale
Рет қаралды 24 М.
Logo Matching Challenge with Alfredo Larin Family! 👍
00:36
BigSchool
Рет қаралды 16 МЛН
Алексей Щербаков разнес ВДВшников
00:47
Magic trick 🪄😁
00:13
Andrey Grechka
Рет қаралды 40 МЛН
ПОМОГЛА НАЗЫВАЕТСЯ😂
00:20
Chapitosiki
Рет қаралды 27 МЛН
That's It, I'm Done With Serverless*
23:58
Theo - t3․gg
Рет қаралды 199 М.
I loaded 100,000,000 rows into MySQL (fast)
18:27
PlanetScale
Рет қаралды 177 М.
Read the Room: Measuring Air Quality with Rust and Elixir
17:50
Code & Stuff
Рет қаралды 1,8 М.
You don't need NoSQL (use MySQL)
31:26
PlanetScale
Рет қаралды 74 М.
Working with time series data in MySQL
20:35
PlanetScale
Рет қаралды 21 М.
I've been using Redis wrong this whole time...
20:53
Dreams of Code
Рет қаралды 352 М.
Faster database indexes (straight from the docs)
13:28
PlanetScale
Рет қаралды 126 М.
Pagination in MySQL - offset vs. cursor
13:20
PlanetScale
Рет қаралды 56 М.
Logo Matching Challenge with Alfredo Larin Family! 👍
00:36
BigSchool
Рет қаралды 16 МЛН