No video

Graph Databases Will Change Your Freakin' Life (Best Intro Into Graph Databases)

  Рет қаралды 524,335

Coding Tech

Coding Tech

Күн бұрын

WTF is a graph database
- Euler and Graph Theory
- Math -- it's hard, let's skip it
- It's about data -- lots of it
- But let's zoom in and look at the basics
Relational model vs graph model
- How do we represent THINGS in DBs
- Relational vs Graph
- Nodes and Relationships
Why use a graph over a relational DB or other NoSQL?
- Very simple compared to RDBMS, and much more flexible
- The real power is in relationship-focused data (most NoSQL dbs don't treat relationships as first-order)
- As related-ness and amount of data increases, so does advantage of Graph DBs
- Much closer to our whiteboard model
EVENT: Nodevember 2016
SPEAKER: Ed Finkler
PERMISSIONS: The original video was published on Nodevember KZfaq channel with the Creative Commons Attribution license (reuse allowed).
ORIGINAL SOURCE: • Video

Пікірлер: 313
@iDreamOfOkra
@iDreamOfOkra 3 жыл бұрын
This is how all technical stuff should be taught. Great job!
@tylerlake5165
@tylerlake5165 6 жыл бұрын
Louis CK got really good at databases with all his down time...
@gwho
@gwho 3 жыл бұрын
Kind of sounds like him too!
@jearsh
@jearsh 3 жыл бұрын
this is an underappreciated comment
@bogeyer4673
@bogeyer4673 2 жыл бұрын
Best. Comment.
@SpartanDemiGod
@SpartanDemiGod 2 жыл бұрын
Lmao 🤣
@whotookthacookie
@whotookthacookie 2 жыл бұрын
Looool
@tangobayus
@tangobayus 6 жыл бұрын
One of the better presenters in the world because he has slides that people in the back can read and he actually talks about the content of the slides.
@high_fly_bird
@high_fly_bird 4 ай бұрын
His style and his natural understanding of the topic are such and inspiration for me!
@adamgm84
@adamgm84 6 жыл бұрын
"It uses math that I don't understand, but it works. It's pretty cool." LOL. I agree. I've been using graph DB for a couple years and they are incredible for studying relationships between data. I highly recommend taking a look at the APOC procedures for Neo4j, because you will get a bumload of algorithms. I also can't recommend enough to read about the anti-patterns. Neo4j wrote great material about it. They will be fairly intuitive for you, like don't store giant blobs as node properties. I also totally recommend looking at some of the machine learning stuff for this. It's zany what you can do once you start doing like decision trees and shortest path analysis using APOC procedures.
@JaylaScousa
@JaylaScousa 6 жыл бұрын
The delivery of this presentation was excellent. Thanks for the insight into graph dbs.
@EmberQuill
@EmberQuill 6 жыл бұрын
I feel like he only barely touched on the actual advantages of graph databases. The queries he showed off can be done in a relational database without any real performance issues. I think what really separates Graph databases from relational databases is their extensibility and how they treat relationships themselves as entirely separate entities. I'm an RDBMS amateur and have no experience with Graph databases so I could be way off, but it sounds like graph databases can be extremely easy to extend beyond their initially-defined schema without really needing much, if any, refactoring. You can just define a new relationship and start using it to link nodes together. With a relational database you'd have to do a whole lot more refactoring, adding or modifying columns, etc. And then there's the direct focus on relationships between nodes. If you're working with highly-interconnected data and the connections themselves have their own attributes beyond just the two nodes they link together, I can see how a graph database could be useful. Basically it sounds like it's more useful for modeling complex, constantly evolving networks. Like a Social Network for example, but one where you can freely define relationships between you and other people rather than picking from a dropdown or creating explicitly-defined lists of people. What I want to know is how the data is actually stored and indexed beyond just having nodes and relationships, and how that affects query performance. Take the very first query he showed, for example. A simple "SELECT * FROM questions" in MySQL will just find the "questions" table and return every row it contains. But the equivalent "MATCH (q:Question)" in Graph will... do what, exactly? Does it walk across the entire graph to build a list of question nodes? Are the nodes stored in some kind of other internal data structure that makes it possible to grab an entire category of nodes without needing to peek at every node and connection in the entire database?
@invntiv
@invntiv 6 жыл бұрын
As a student learning Relational Databases in my information studies degree, i’m so grateful that you introduced me to this new pattern for databases! Gotta stay on top of emerging standards and technologies. Thanks for sharing!
@HMan2828
@HMan2828 6 жыл бұрын
Fair bit of advice: "emerging" technologies like this often emerge from nowhere promising the moon, usually fail to deliver, and disappear just as quick. As a student you should probably focus on what is proven and tested and in-use in the industry.
@tomhollins9266
@tomhollins9266 4 жыл бұрын
Excellent presentation: Fast, lively, practical. Will be exploring this technology further.
@GrantSR
@GrantSR 3 жыл бұрын
13:50 - He makes a disingenuous argument. If one had created their relational database to actually contain all of those pieces of information mentioned in the salesperson's question, then it would be possible to get the data out. But when he switches to talking about the graph database, he just presupposes that you have nodes that contain all of this information, and that you have complete information on all of your customers. You may have information about some of the customers that have bought toasters. You may have information about some of the customers that are ex-cons. But, in a graph database, you have no guarantee that you have complete information about each customer. More importantly, you do not know if your lack of information is because the customer never bought a toaster, or because you simply don't know about the toaster the customer bought. With a relational database, you can at least indicate which customers you have complete information about and then only consider those in your statistics. Now, I am a huge fan of graph databases. That's why I'm watching this video. However, it seems almost any time someone tries to compare and contrast two technologies, they always seem to make disingenuous comparisons. They will consider a critical Factor for one technology and then assume that critical Factor is not a big issue with the preferred technology. You got to make even comparisons if you are going to have any chance of choosing a technology based on its merit.
@dandan7884
@dandan7884 6 жыл бұрын
this was a very good talk that made me consider graph dbs. thanks
@firefly618
@firefly618 6 жыл бұрын
What it made me do is to consider looking into alternative _languages_ to query the relational DBs we already have, because clearly SQL is not optimized enough for the common use case. Additionally it made wonder if graph DBs have some hidden power that goes beyond what was shown in the presentation, because that was all pretty basic level SQL.
@althaz
@althaz 6 жыл бұрын
This talk was interesting and taught me some things about graph DBs...but what it didn't do was point out *any* benefit to them. Every single thing mentioned in presentation is fairly easy to do with relational databases and SQL. If the benefit is that unknown questions become faster, then if you have a genuinely massive dataset, this could be good (or in fact amazing). Otherwise, it's pre-optimization, which is the mother of all anti-patterns. Because you could replace graph DBs apparently with just smart decision when you discover new questions. Either this wasn't explained well enough or the speaker doesn't know enough about relational databases (hardly uncommon, for some reason a lot of people just can't understand relational DBs).
@TheMrVogue
@TheMrVogue 4 жыл бұрын
Loved the talk, loved the humor. Great introduction... I'm hopefully working with a startup soon who's deeply using Neo4j
@Donaldo
@Donaldo 6 жыл бұрын
As other commenters have pointed out, the vast majority of this video spends time on material that is easily handled in relational databases. OP says "indirect" a lot but as a long time user of relational databases, I hoped to hear more about queries where valid results mean traversing a variable number of "joins."
@theamici
@theamici 6 жыл бұрын
As a long time user of relational databases, perhaps you've lost touch with how complicated they can be to work with.
@Donaldo
@Donaldo 6 жыл бұрын
Maybe :) But coming from the relational side, I wanted to see problems that *I* would consider extremely difficult in relational.
@matthewrummler
@matthewrummler 6 жыл бұрын
Agreed, though I've created and utilized data structures in RDBMSs for many years as well. Maybe then the real point is graph is easier to learn, not technically more powerful in any particular way?
@Donaldo
@Donaldo 6 жыл бұрын
matthew rummler hmm hadn't thought of it like that... oh maybe thats what amici was saying
@KevinRWhitley
@KevinRWhitley 6 жыл бұрын
Kind of goes back to the old saying... "if all you have is a hammer, the whole world looks like a nail". As a long time user of relational dbs myself, the question isn't "can I accomplish this using an existing tool", but rather "can this be MORE EASILY accomplished using a different tool (plus how long will ti take to learn, will it likely be around tomorrow, etc)?". We should ALWAYS be looking for more performant ways to achieve tasks, as this wastes less of our own development time, resources, etc. Additionally, when steering clients/companies, we have an obligation to avoid leading them into more and more technical debt, as they bind themselves to legacy architectures that are ill-suited to the growing complexities of modern questions/tasks.
@cambsdigital
@cambsdigital 6 жыл бұрын
Hands up if you ever fought deleting rows in MS Access! Great video and an interesting way to challenge the way we are storing data. I am looking at GDPR currently and it seems like sticking private stuff in a single related table will be allow a lot of freedom from the GDPR restrictions, I am guessing the Graph system fits the real world better and may not be easily manipulated in the same way.
@djd829
@djd829 Жыл бұрын
Last time I did that was around the time my pet dinosaur died
@pankajsinghv
@pankajsinghv 6 жыл бұрын
Figuring out indirect relationship is the strength of Graph database is my key takeaway from the excellent talk...
@Saschaborg
@Saschaborg 5 жыл бұрын
The concept of Graph DBs somehow reminds me of Prolog ^^
@gspahr
@gspahr 6 жыл бұрын
Not even a minute has passed, and I already like this guy. Looks like it's going to be a pretty good talk!
@FidelGuajardo
@FidelGuajardo Жыл бұрын
Who in La La Land is this guy? He is HILARIOUS!!!! What a GREAT presenter!!!!
@srithanreddysavela2845
@srithanreddysavela2845 Жыл бұрын
Listening to this lecture is so fun😍 The guy is a Great Teacher.
@this.channel
@this.channel 4 жыл бұрын
This guy is really funny. I got a tech talk and a stand up show in one sitting.
@HugRunner
@HugRunner 6 жыл бұрын
This would be much better if he compared the queries between different databases, e.g. SQL vs Graph, and then pointed out the point of using a Graph database. This mostly seemed like examples of queries but not so much details on why it's better than anything else already out there for many many years.
@yuriysemenikhin302
@yuriysemenikhin302 6 жыл бұрын
As usual, this is a great and god awful presentation at the same time on an interesting tool for a limited purpose. I'd be happy to have this tool sitting on top of a MySQL schema in case I need to get certain type of answers. I've seen people give some good use cases in separate presentations dealing with other subjects. I do appreciate the criticism that some queries do end up being slow due to too many joints and DBs not being optimized to answer the particular question. Even more noticeable when the DB has lower amounts of RAM allocated to it. But this issue is easily rectified by one or a collection of Functions/Stored Procedures that allow to break up the task into smaller modules (queries) A mistake made by most of the modern developers who don't actually understand properly the technologies they work with but are all too happy to jump onto the next new thing as long as it sounds cool and confuses potential customers into paying a bit of extra.
@vicsteiner
@vicsteiner 5 ай бұрын
A constraint in a data model is not something that "won't work" as in the example given of the foreign key but an element of a data model that is there to guarantee that the semantics associated to the data (is socially assigned meaning) is preserved when it's formalized in a logical system to be computerized. That is a constraint is not a problem but a necessary feature of any data model that want to oreserve semantics, the information carried by data as semantic content.
@CoryTheSimmons
@CoryTheSimmons 6 жыл бұрын
Great talk. I would love to see some simpler examples so I could get more familiar with the query language, but the speaker did an excellent job of getting me hyped on graph dbs (I've been in relationship hell on-and-off the job for my entire life).
@oneyx88
@oneyx88 Жыл бұрын
Thanks Ed! Very easy to follow and comprehensive talk about graph db
@IBWatchinUrVids
@IBWatchinUrVids 6 жыл бұрын
Oh man, advertisers are going to love this.
@levijohansen2603
@levijohansen2603 4 жыл бұрын
If you cant do this in SQL, then you’re not very good at it. But graphs databases look like they’re easier to learn; will check it out
@peachmango5347
@peachmango5347 7 ай бұрын
Its 6 years later - I just checked to see if comments reflected all these changed lives...
@tigana
@tigana 3 ай бұрын
1 minute in and I’m already cracking up.
@jackbotman
@jackbotman 3 жыл бұрын
Very cool, think this guy should just do every tech talk from now on
@chrissherlock1748
@chrissherlock1748 6 жыл бұрын
Relational databases are named after the mathematical concept of relations. It's not about table relationships.
@duramirez
@duramirez 2 жыл бұрын
My issue with these kind of databases is the overhead of Json format, it is an improvement over XML for sure, but it is not good for large result sets, you need to repeat your "scheme" in every data record, so it will perform poorly if you have a huge dataset as a result, and parse it out of Json has a cost, altho today that is very optimized, but still is a cost, i need a binary version of this i suppose, but the lack of scheme, make it hard to then parse it out. It's complex. 😕
@stillmattwest
@stillmattwest 2 жыл бұрын
Great overview of graph dbs and fun to watch.
@RichardBuckerCodes
@RichardBuckerCodes 6 жыл бұрын
The example given about the coupon in kansas with the criminal record is not as the effin guy says. Just as you need graph data in some fashion to represent the relationships the same is true of relational dbs. equally as you have a graph between a person, a criminal record, address, purchases and coupons... those things come into existence in similar ways. To suggest that a graph db allows for a dynamic schema means you do not understand relational DB tools
@Yaxqb
@Yaxqb 6 жыл бұрын
Incredible talk and dude!
@cameronmalacari7441
@cameronmalacari7441 6 жыл бұрын
Jakob Lindskog î
@gravious
@gravious 6 жыл бұрын
really interesting, providing me with lots of ideas for data manipulation in work :)
@Stabby666
@Stabby666 6 жыл бұрын
Interesting - realistically it seems like a graph database is just a relational database that maintains its own join tables though.
@jakspyder
@jakspyder 6 жыл бұрын
great talk on an interesting topic, something for further research for sure, thank you!
@steverobinson207
@steverobinson207 6 жыл бұрын
Long time ago I used to program in Prolog. It would do this kind of stuff but so much more elegant. -- if you can get your head round recursion.
@FrostSpike
@FrostSpike 3 жыл бұрын
If I was in charge, I'd make anyone planning on using a graph database learn Prolog first, and then see if they still needed a graph database.
@murv24
@murv24 Жыл бұрын
Great video, but the comments about relational databases being rigid and needing to know all the query requirements up front is completely the opposite of reality. One of the main advantages of a normalized relational database is the query flexibility. The joins might be ugly, but you can create any query you'd like against it. NoSQL key value stores on the other hand, do require that you know all your access patterns up front. Can't wait to try a graph database out one day!
@LondonAppDeveloper
@LondonAppDeveloper 5 жыл бұрын
Fantastic introduction to Graph Databases, very engaging speaker.
@RisingDad
@RisingDad Жыл бұрын
I watched this to learn about graph database. 13 1/2 minutes in and I have heard a lot of disdain for relational databases. I don't have any of those issues he talked about and I have had people ask for crazy things.
@sidekick3rida
@sidekick3rida 3 жыл бұрын
Liked as soon as I heard the first sentence
@saurabhverma7366
@saurabhverma7366 3 жыл бұрын
You just helped me a lot Man, Thanks for your enlightening talk. Cheers! 🥂
@pekka676
@pekka676 6 жыл бұрын
It might be a good idea to extend graphs to hypergraphs - that is sets of nodes, not just binary relations.
@karmakast806
@karmakast806 6 жыл бұрын
I always liked node based databases. thats what i call them. Nice talk!
@micknamens8659
@micknamens8659 2 жыл бұрын
13:00 Actually this query can be expressed in SQL because you can join the tables with the condition data to the Person table. It doesn't need recursive indirection links.
@tigana
@tigana 3 ай бұрын
Ok so if I’m understanding correctly: Graph db for when you want to access indirect relationships and not be limited by a schema Document db for when you don’t want to be limited by a schema, but most data be accessed is usually all in the same document (?) Relational db when you want extreme structure, you want that schema as a safety net. And you’re not looking to access indirect relationships Is that correct?
@johnallcock5582
@johnallcock5582 3 жыл бұрын
Wish all presenters were this good!
@Screamer
@Screamer 6 жыл бұрын
That guy is a friggin genius.
@ethanpet113
@ethanpet113 6 жыл бұрын
But you can represent a graph with a relational database just fine Node(id,...fields) Edge(from_node_id,to_node_id,reltype_id) Relation_type(id,name) It's just that you're nodes can't be dynamica, without introducing a bunch of joins like Node_String_Fileds(node_id,value) Node_Integer_Fields(node_id,value)
@DanHaiduc
@DanHaiduc 6 жыл бұрын
I guess that makes relational databases also graph databases :) But I have a hunch they're much slower at joining that many tables and/or possibly needed recursive queries.
@supremeoverlord189
@supremeoverlord189 6 жыл бұрын
Put simply graph databases are optimized many-to-many relationships and that's what makes them useful and fast at what they do. For example give me all the friends of my friends who are not my friends (one of the reasons Facebook started using them) this takes forever in a standard relational DB simply because of design choices. In a graph db it's optimized to do these kinds of queries fast. Otherwise yes all graph DB's are easily implementable in a standard relational database also remember most if not all graphDB's are RAM databases in other words you have to have your graph loaded in RAM for things to go fast. Which right off the bat you see isn't what a standard relationalDB is based around yes a relationalDB can use a lot of RAM but it isn't a complete failure without it either. A graphDB will just not perform at all if it can't load the graph's in RAM. It's a different tool for a different task and a useful one at that.
@Draugo
@Draugo 6 жыл бұрын
That's the biggest problem I have with these kinds of lectures. They are always based on the idea that "this new thing will change your life completely and forever so you can just throw away all that old stuff which is bad and disgusting". In IT especially it is crucial to understand that most tools are good for something and no tool is best for everything and the challenge comes from finding the right tools, for the right job with the right cost. Any Turing complete language can do any job given enough time (to configure and to run) and resources, but if language A does the development three times faster than language B and language B does the execution 1.1 times faster than language A when you have X number of requests but language C does it 10 faster than either language A or B but takes 5 times as long to develop than language A, which is the best language for the job? The answer is that it completely depends on the situation and resources you have. No single technology will ever completely crush an older technology in all possible areas especially when it's little used, little known and relatively new. Still they are usually marketed as such through lectures like this with faulty logic and dubious or even completely misunderstood arguments and examples.
@HMan2828
@HMan2828 6 жыл бұрын
"For example give me all the friends of my friends who are not my friends" SELECT ff.PersonID FROM Person me INNER JOIN PersonFriends mf ON mf.PersonID = me.PersonID INNER JOIN PersonFriends ff ON ff.PersonID = mf.FriendPersonID LEFT JOIN PersonFriends nmf ON nmf.PersonID = ff.PersonID AND nmf.FriendPersonID = me.PersonID WHERE me.PersonName = 'Myself' AND nmf.PersonID IS NULL If the PersonID and FriendPersonID and PersonName fields are indexed, this query results in a single lookup, filter, and fetch. Not really that hard...
@rumfordc
@rumfordc 6 жыл бұрын
+HMan I'm pretty sure each one of those joins is a separate set of lookups, and that each lookup is logarithmic, not constant (single). So with N Persons, and a "me" with F average friends, each lookup is log(N), and your algo breaks down to: find me (+ log(N)) find my friends (+ F * log(N)) for each friend, find their friends (+ F^2 * log(N)) filter out my friends (no new lookups, + negligible constant K) assuming our number of friends' friends is F^2, and assuming the cost of filtering is negligible constant K, we get a worstcase runtime of log(N) + F * log(N) + F^2 * log(N) + K = log(N) * (1 + F + F^2) which isn't terrible, but it could be better. with a graph, only the first lookup is necessary, and everything else can be found through the nodes' edges (in _truly_ constant runtime, because nodes are not relative offsets in an index but absolute offsets in memory). there are notably less lookups this way: find me (+ log(N)) find my friends (+ F) for each friend, find their friends (+ F^2) filter out my friends (+ negligible constant K) which gives a worstcase runtime of log(N) + F + F^2 + K = log(N) + F + F^2 Which is quite a bit better when working with extremely large datasets. At least that's my understanding of it, I hope i got that right.
@explosu
@explosu 6 жыл бұрын
It's funny seeing all the relational db peoples saying "I don't see the point, yeah it's easier and faster, but who cares I've been tracking banana shipments to market data to police records for port authorities across 10 different countries for 25 years your database sucks if you can't!"
@HMan2828
@HMan2828 6 жыл бұрын
I think what we are actually saying is "I don't see HOW this is any faster OR easier, or what tangible advantage it has over the mature, tested and true technology I am already using. Why should I gamble customer data on this solution?
@explosu
@explosu 6 жыл бұрын
I just think it's absolutely _ridiculous_ that we can't make anything new in software without swarming behavior trying to bite it to death like an intruder into a hive. If this isn't appealing to you, if you find SQL easier, if you're worried this isn't as secure or fast, good. Go write SQL. Otherwise I'm pretty sure I see the same old job security dance belittling anyone that finds their technology obtuse. Competition isn't bad.
@HMan2828
@HMan2828 6 жыл бұрын
That's not what is happening here. I welcome new concepts, IF they provide a worthwhile improvement in some way. I just don't see what this particular concept brings to the table. To be competitive there needs to be a competitive advantage, somehow. If you told me, for example, that this approach is better because it lends itself better to neural net processing, or that it improves efficiency or that it scales better, then I'm interested, you got my attention. All I see in this presentation is a different way of doing something we already do not as well and for the sake of being different.
@vicsteiner
@vicsteiner 5 ай бұрын
I've done too many comments just to say I do have a genuine interest in graph data models, I just feel unnecessary to refer to misunderstandings of what the relational data model is like SQL databases to make the case of graph data modelling. If the video was using SQL database every time it mentions relational data model instead it would be much more precise.
@pranayroy
@pranayroy 2 жыл бұрын
This is a brilliant explanation.
@vicsteiner
@vicsteiner 5 ай бұрын
It's very important to have in mind that the slowness of current available SQL databases (none of them are actual implementations of the relational data model, please refer to at least Fabian Pascal, C.J.Date and David McGoveran) has nothing to to with features of the relational datamodel itself. How does a graph is stored in a computer? A computer does not stores nodes and edges, these are abstractios, the same way a relation or other things like tables are abstractions. All these abstractions can be represented in computer memory in various physical ways. As I mentioned before a table abstraction or also a matrix abstraction can represent a graph. SQL is not synonym of relational data model which is an application of first order predicate logic. T. Codd thought about using second order logic but as the person in the video mentioned simplicity is to be preferred. And again a data model without constraints is not a data model but simply data. A database might be backed by a data model or not. Most databases unfortunately are not support by proper data models as formal systems. A key value data base has no data model but a syntactical abstraction for representing data. It makes no guarantees on the semantic consistency of your data, therefore you can not safely rely 100%of the time on the inferences you derive of such databases. A graph is a methematical construct. A graph data model is not the same as a graph. And a graph database management system should not store graphs but a graph data model.
@joshblf
@joshblf 3 жыл бұрын
Amazing speaker and topic!
@bw7112
@bw7112 2 жыл бұрын
I wasnt expecting Gilfoyle to give a presentation. (Silicon Valley reference)
@UrielVS
@UrielVS 6 жыл бұрын
Nearly all the examples he showed were easily doable in any relational database. I'll give a little leniency on the last one... But, its not like what he showed, was any more less complex then what a `join` statement would look like. Essentially replaced `JOIN` with `MATCH` ..... Then speed? There's a pretty damning whitepaper out now that shows how relationship DB's performance vastly better in nearly 95% of all the cases you'd need a DB for. Bottom line is don't get caught up in superficial hype trains and start evaluating actual-realistic use cases for a Graph. These examples are not it..
@firefly618
@firefly618 6 жыл бұрын
I'm not convinced. The queries shown in this talk are all beginner- or at most intermediate-level SQL. In fact, I could easily write a transpiler from the subset of ASCII-art language used in the presentation into SQL, assuming you are only joining on foreign key constraints-which of course SQL doesn't restrict you into doing. So either the power of graph databases lies elsewhere, in some advanced features that were not shown, or this thing is just another poor man's schema-less store with a fancy query language. For example, off the top of my head: can you traverse a variable number of joins/edges, depending on the data you find? Can you traverse a variable _type_ of join/edge, depending on the data you find? Can you express a recursive definition of joins/edges, again depending on the data? What about a set of mutually recursive definitions of joins? Are such things performant? And so on. Mind you, good relational DBs allow you to do most of that, but they don't necessarily make it easy or performant, so I could see the use of something more powerful. Which this presentation did not show.
@dcodernz
@dcodernz 6 жыл бұрын
A relational DB schema can also be visualised as a graph. This is interesting technology but I think the presenter just doesn't understand relational DB dismissing the technology. A sane relational DB can also answer arbitrary questions with relational algebra which can be translated into SQL.
@supremeoverlord189
@supremeoverlord189 6 жыл бұрын
see graph db's as optimized many-to-many relationships. They are very fast at "joining tables" which is their main purpose they also need a lot of RAM to load the entire graph and uses pre loaded graph's to make sure it's always fast. If you always run a graphDB from disk it's going to be a nightmare.
@dayvie9517
@dayvie9517 6 жыл бұрын
As a graph with fat arrows which go between table and table maybe, but not as a graph with alots of granular arrows for each dataset/document.
@Metachief_X
@Metachief_X 4 жыл бұрын
Great introduction. Many thanks
@LordBadenRulez
@LordBadenRulez 6 жыл бұрын
Graph databases messed up my life. I vouched for the technology at my company. The problem is that in theory it's all good but the technology is so new that all the graph databases out there have so many issues that make them unusable in production. Stay away from Neo4J and Orientdb!
@vishaljotshi6869
@vishaljotshi6869 3 жыл бұрын
I hope those issues would be resolved by now and please write back if you think they are good to be used in production now
@LordBadenRulez
@LordBadenRulez 3 жыл бұрын
@@vishaljotshi6869 it's been 4 years since I put my reputation on the line for this technology. It's probably much better now. I still would not recommend graph unless you want to try something new. They are fun to play with but not so much fun when things fall apart in prod.
@luisgomez4544
@luisgomez4544 3 жыл бұрын
@@LordBadenRulezwhat kind of problems did you have in production. Exist so much possibilities and use cases, maybe your problem was the focus. or the model it's wasn't thought for a concrete problems.
@AndrewBuckleBookReviews
@AndrewBuckleBookReviews 4 жыл бұрын
Excellent talk about graph databases
@WanWuChi
@WanWuChi 6 жыл бұрын
At 13:25 he said the crucial thing. IF the data somehow is in the system. How could you answer an unanticipated question with any data system if the data is not available. It is not a matter of key constraints or storage structures.
@Proeng
@Proeng 6 жыл бұрын
I must be missing something, anyone who is competent in SQL will be able to design a database in the given scenario and create those queries using an, imo, much simpler syntax as well?
@Dan-ic4yp
@Dan-ic4yp 6 жыл бұрын
You missed the point. His talk was a bridge.
@delavago5379
@delavago5379 6 жыл бұрын
Callum Vass can relate
@muskduh
@muskduh 2 жыл бұрын
Thanks for the video.
@CTimmerman
@CTimmerman 6 жыл бұрын
12:10 Something like this should work, but criminal records is probably an API call with select user info: select count(uid) from criminal_records where uid in ( (select distinct uid from purchases where itemtype='toaster') p join (select distinct uid from users where city='Kansas') u on u.uid = p.uid join (select distinct uid from redeemed_coupons where publication_date > current_date - 1) c on c.uid = p.uid )
@michaelangular2553
@michaelangular2553 6 жыл бұрын
damn I love this guy, great talk about graph databases
@stellatedhexahedron6985
@stellatedhexahedron6985 6 жыл бұрын
I know that this is fairly certainly naivete (from someone who's largely new to practical programming, and also definitely on the opposite side of the theoretical/practical scale), but everything I've learned about relational databases leaves me thinking of as, well, just objects, with a few (admittedly very nice) tie ins to keep track of all the props, and types of props. It seem a little silly that almost nobody was doing this before a couple years ago. What am I missing? Do you need processors of a sufficient strength or flexibility to make the payoff worth it? Is the math knottier than I thought? Am I just being unspeakably naive about how entrenched SQL was, and how hard it would have been to switch over?
@HMan2828
@HMan2828 6 жыл бұрын
WHAT exactly is the payoff is the question? To me all of this was just flavor of the month snowflake idea from someone who doesn't understand why relational databases are so widely used, even though Graph databases as a concept already existed in the 60's. I don't see the payoff at all.
@stellatedhexahedron6985
@stellatedhexahedron6985 6 жыл бұрын
What compels people dig all the way down into the youtube comments for a genuine question and respond with contentless curmugeonry? The world may never know!
@TheHabibass
@TheHabibass 3 жыл бұрын
The Mark Rippetoe of IT
@kanaanbahmani5062
@kanaanbahmani5062 6 жыл бұрын
i had no doubt about the speed and benefits of using of graph databases, but this talk made me more confident about them, BTW this guy is awesome.
@vicsteiner
@vicsteiner 5 ай бұрын
A relational data model has relations (not tables rows and columns), constraints and operations applied to roations and the way data is physically stored is irrelevant for the model since any data model is a formal system, that's based on logic and can be physically implemented in many ways assuming it respects the logic of the defined formal system.
@TimRubel
@TimRubel 4 жыл бұрын
A row, entity and not mentioned tuples are not always the same in relational databases. Writing queries in databases are easy.. learn the difference between your joins
@patternsexpert7502
@patternsexpert7502 6 жыл бұрын
The speaker is awesome! and fun!
@sephyshen2510
@sephyshen2510 6 жыл бұрын
learn much more about graph database. thanks a lot.
@Adam-yf2ux
@Adam-yf2ux 3 жыл бұрын
Had interview where I was asked if I knew what graph DBS are. Now I know that the answer is: good for many data.
@bartholomewtott3812
@bartholomewtott3812 6 жыл бұрын
Relational database is not about relationships between tables. He is confusing terminology
@dgpretzel
@dgpretzel 6 жыл бұрын
True. The "Relational" in Relational Database refers to mathematical relations, i.e., tuples.
@aledmb
@aledmb 6 жыл бұрын
he told you "i didn't do well in computer science"
@iamblaineful
@iamblaineful 5 жыл бұрын
In practical application in Production environments, the business world, you couldn’t be more wrong.
@ALLCAPS
@ALLCAPS 4 жыл бұрын
@@aledmb then why is he making a case against traditional db ? Lol
@kokizzu
@kokizzu 4 жыл бұрын
12:30 looks easy in SQL '__')
@VictorMartinez-zf6dt
@VictorMartinez-zf6dt 4 жыл бұрын
SQL sucks at temporal queries.
@busyrand
@busyrand 6 жыл бұрын
Awesome Lecture! Well done....
@cnordbakk
@cnordbakk 6 жыл бұрын
Jesus, at @12:11 it comes apparent that this guy has never managed a large relational database... I don't disagree that graph-databases have a lot of uses, but this isn't one of the cases.
@jorgeguerrero3455
@jorgeguerrero3455 4 жыл бұрын
Yep! I agree.
@ShaoVideoProduction
@ShaoVideoProduction 4 жыл бұрын
The point is that this is a complex and expensive query, you don't want that.
@ALLCAPS
@ALLCAPS 4 жыл бұрын
The request was actually simple it would be a few joins but he makes it seem like its impossible to get that answer. If your DB schema is solid and good you can answer questions you never imagined
@ShaoVideoProduction
@ShaoVideoProduction 4 жыл бұрын
@@ALLCAPS i said expensiv, not hard. Bubble sort for exsmple is easy and expensiv.
@ALLCAPS
@ALLCAPS 4 жыл бұрын
@@ShaoVideoProduction I guess? but not really. It's not expensive because it's been done 1,000,000 times in databases that are larger than 400million users and we haven't had any issues. So what gives?
@SimonPedersen1
@SimonPedersen1 6 жыл бұрын
Great talk. Scott is an empathic and interesting guy.
@tmst2199
@tmst2199 6 жыл бұрын
It's amazing to me how the relational model still dominates nearly 20 years after Zope/ZODB made its splash.
@olemew
@olemew 2 жыл бұрын
Maybe GDB dont have as many use cases as they say.
@SB-yl1ng
@SB-yl1ng 2 жыл бұрын
Always thought every one new how this works, no , what till quantum computers it's a fill in the lines in between the lines and the lines in between the lines that'll be fun. It's not like they don't have it all ready.
@TerenceKearns
@TerenceKearns 6 жыл бұрын
This would work well with the Trivium method (which is a way of thinking critically)
@attanoqin3618
@attanoqin3618 Жыл бұрын
Hello, may i have your permission to move this video to bilibili and cite the source of Coding Tech youtube channel to share it with more people in China~? It's a great video, sad that most of us have no VPN access to visit youtube...
@julienbongars4287
@julienbongars4287 6 жыл бұрын
Good talk. Thumbs up
@toastybowl
@toastybowl 2 жыл бұрын
I think many of the existing replies somewhat unfairly bind the topic here. The appeal of such a concept concerning your own, existing "graphs" in life are simple to input, file by file. "I have 6 bananas, 3 tbsp soy sauce + some addy, what recipes can I make without spending over $20 at the store ?"
@JohnEthan777
@JohnEthan777 6 жыл бұрын
Since this is over a year old, judging by the name of the talk, I was curious as to whether the permissions for reupload take time, or is it just that you get to watch it late?
@CodingTech
@CodingTech 6 жыл бұрын
Hi Ethan9750. I usually republish new content but sometimes I add a bit older videos just because they are freakin' good :)
@EdanZy
@EdanZy 6 жыл бұрын
Freakin' amazing and graph'ical :)
@Epistemer
@Epistemer 4 жыл бұрын
to be honest you should've brought an example that is more complex to query with SQL, because relational databases are MADE to answer such a question with ease 12:30 .
@Zp00kie
@Zp00kie 6 жыл бұрын
Somebody telll this guy that Comedy Central is hiring!!!
@MyWissam
@MyWissam 3 ай бұрын
How is logic programming (e.g., Prolog) related to graph data bases?
@stuffedk
@stuffedk 6 жыл бұрын
Ah he lost me when he talked about not being able to answer specific questions in SQL DBs. If the information is not there its simply impossible regardless of your DB type, if it is there and you can't get it out of a SQL db structure you built yourself in at MAXIMUM a day, then probably you have not used it that much (and nothing wrong with that, you could be an expert in other things)
@MartyBallard
@MartyBallard 6 жыл бұрын
Great talk, now I have to go and learn how to use a Graph Database IRL.
@dariusdulskis1237
@dariusdulskis1237 6 жыл бұрын
Very entertainig video. Couldn't stop laughing :) Especially the intro and the demo when you dragged a single node of the graph and the other nodes smoothly followed it like sheep in a herd :) The product that you created is really impressive. But... It didn't take a lot of time to realize that your graph database implementation internally uses the same "ledger-style" structures (mostly known as "tables" ) that relational databases do. Inevitably your graph database has to have meta-"ledgers" that describe all objects of your database, including graphs and their respective nodes and edges. Metaphorically speaking you dressed a dog with cloths of a human and you are saying that you genetically "upgraded" it into a new smarter species :)))) And my blind guess is that you are using SQLite in your product. Maybe , maybe not :)))) Nowadays a lot of software developing companies do. And do it silently :) And quite possibly you forked one of existing open source relational databases. What you created is nothing less and nothing more but data query visualisation tool with the dreadful Perl-style query language. :))) Don't be offended but code written in this language doesn't look less scary than it does in SQL, for example such as: SELECT count(*) count_of_exotic_customers FROM customers cust INNER JOIN coupons coup ON cust.id=coup.cust_id INNER JOIN customer_contacts cont ON cust.id=cont.cust_id WHERE uppercase(cont.city)='KANSAS' AND EXISTS (SELECT 1 FROM criminal_records crime_rec WHERE crime_rec.personal_ID=cust.personal_ID) AND DAYOF(sysdate)-1=DAYOF(coup.coupon_date) // pseudofunctions :) A little research on Alphabet-owned search engine revealed there are similar products like yours. Try to google search "visualizing graphs with relational databases cambridge intelligence" for example. I hope you don't keep grudge on me for criticism :) I wish you all the best.
@quebono100
@quebono100 6 жыл бұрын
You dont quit get the idea out of it. I think thats because you are not a mathematician. You can do all kind of crazy stuff with neo4j. For Example: Pagerank like google in the year 2000, dencity of relationships, save Word Vectors to find synonyms
@matthewclayton7095
@matthewclayton7095 6 жыл бұрын
very educational
@kevinleesmith
@kevinleesmith 5 жыл бұрын
"How many people, bought a toaster, live in kansas, have criminal record, used a coupon" - you can answer that questions in a graph db(- assuming you had all the date in the db, and there are paths between them). But its also easy to answer that question in an RDBMS (assuming you had all the date in the db, and there are relationships between them). So what am I missing????
@ShaoVideoProduction
@ShaoVideoProduction 4 жыл бұрын
The needed query is somewhat complex and quite expensive
@realwizardry834
@realwizardry834 6 жыл бұрын
This guy sounds exactly like Derek Banas, a KZfaq coding lesson guy
@harvibally
@harvibally 5 жыл бұрын
Idk who to that is. Let’s search him lol
@BritishBeachcomber
@BritishBeachcomber 6 жыл бұрын
8:36 just dots and lines? No, it's just turtles on turtles, all the way down!
A Skeptics Guide to Graph Databases - David Bechberger
1:00:54
NDC Conferences
Рет қаралды 61 М.
Graph databases: The best kept secret for effective AI
23:07
Web Summit
Рет қаралды 31 М.
Violet Beauregarde Doll🫐
00:58
PIRANKA
Рет қаралды 36 МЛН
SPILLED CHOCKY MILK PRANK ON BROTHER 😂 #shorts
00:12
Savage Vlogs
Рет қаралды 50 МЛН
Magic trick 🪄😁
00:13
Andrey Grechka
Рет қаралды 56 МЛН
Introduction to NoSQL • Martin Fowler • GOTO 2012
54:52
GOTO Conferences
Рет қаралды 987 М.
Design Microservice Architectures the Right Way
48:30
InfoQ
Рет қаралды 711 М.
Neo4j (Graph Database) Crash Course
1:23:08
Laith Academy
Рет қаралды 219 М.
What are Graph Databases and Why should I care? - Dave Bechberger
56:05
4 Programming Paradigms In 40 Minutes
41:28
Coding Tech
Рет қаралды 489 М.
Which Database Model to Choose?
24:38
High-Performance Programming
Рет қаралды 51 М.
Understanding graph databases with Neo4j
17:52
Google Cloud Tech
Рет қаралды 23 М.
7 Database Paradigms
9:53
Fireship
Рет қаралды 1,6 МЛН
Violet Beauregarde Doll🫐
00:58
PIRANKA
Рет қаралды 36 МЛН