No video

Dataflows vs. Datasets

  Рет қаралды 15,441

BI Polar

BI Polar

Күн бұрын

Пікірлер: 52
@nedoshivin
@nedoshivin 2 жыл бұрын
Great explanation, you have a talent of explaining something very complex in a very easy to digest manner!
@bradleyvandevis7378
@bradleyvandevis7378 4 жыл бұрын
Thanks so much Matthew. I'm new to leveraging dataflows and this was a great primer for their use vs a dataset. Thanks again!
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Thank you!!
@jainbhavesh9
@jainbhavesh9 2 жыл бұрын
Thanks Matthew, very well explained!!!
@kostaskolotouros4345
@kostaskolotouros4345 4 жыл бұрын
Thanks for this BI Polar, very good video ! 2 questions: 1) Can a dataflow be consumed in multiple workspaces? 2) Is there a suggested way to organise the dataflows? For example would you create one dataflow per database and include all its tables or would you create a separate dataflow per entity?
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Key Kostas - thanks for the feedback and questions. Quick answers: 1 - Absolutely. You create a dataflow in one workspace but can use it in as many datasets in as many different (or the same) workspaces as you want. 2 - It depends. There's no one answer here, but if you follow the general principles of "things that will be used together get organized together" you're probably on the right track. Also remember that dataflow permissions are set at the workspace level, and that refresh is performed at the dataflow level. These two functional characteristics may influence your design as well.
@kostaskolotouros4345
@kostaskolotouros4345 4 жыл бұрын
@@BIPolarSSBI thanks!
@thiagofraletti4220
@thiagofraletti4220 4 жыл бұрын
Wonderful Matthew, thank you!
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Glad you enjoyed it!
@user-lm5wb8vi1x
@user-lm5wb8vi1x Ай бұрын
Finished watching
@Tattysnuc
@Tattysnuc 3 жыл бұрын
Great intro and explanation. Thx
@BIPolarSSBI
@BIPolarSSBI 3 жыл бұрын
Glad it was helpful!
@pukashell6170
@pukashell6170 4 жыл бұрын
Great Stuff Matthew. Like the new channel. Look forward to future videos.
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
The plan is to have new videos every Monday. Fingers crossed...
@sau002
@sau002 3 жыл бұрын
Much better. I like your problem-solution approach. Thank you.
@bradj229
@bradj229 4 жыл бұрын
Excellent video! I'm wondering though. 1. What's the difference between a Power BI Desktop Dataset (tabular model) and Power BI Service Dataset (seems basically identical, but w/o modeling capability). 2. You cannot create relationships between entities (tables) in Dataflows correct, instead it's more used as a data source to connect to to then build relationship within Power BI Desktop?
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Short answer 1: datasets are Analysis Services tabular models, like what you've had in SQL Server Analysis Services for over a decade. Power BI Desktop is the primary authoring / modeling experience, and the Power BI service is the deployment / consumption platform, but both the service and Desktop serve as hosts for the tabular engine. Short answer 2: You cannot explicitly create relationships between dataflow entities through a UI, but the underlying CDM metadata does include relationships. If you think of dataflows as a data source for your datasets and the relationships between tables in the datasets' tabular models, you're on the right track.
@nigelnaicker7948
@nigelnaicker7948 2 жыл бұрын
how relevant is this now? surely i can create a dataset and that can be stored on the PBI service, and users can connect to the dataset from power bi desktop, im not seeing the big value add here.
@sebastiendebosscher
@sebastiendebosscher 2 жыл бұрын
Hi Matthew, I couldn't find anything on this: The primary keys defined in my dataflows don't exist anymore when I import that table in power BI desktop. Is that unsupported? Should I need to recreate the primary keys in the dataset by Table.ReplaceKeys? (I need primary keys for performance on merging and aggregating tables in the dataset)
@gulhermepereira249
@gulhermepereira249 4 жыл бұрын
Great explanation, Matthew! I've got one question, am I able to share just a couple of dataflows within a workspace with a specific user or is it "all or nothing" kind of sharing?
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Thank you! The workspace is the unit of sharing. If you want to share a subset of your dataflows, you'll need to put them in a different workspace.
@Boedie92
@Boedie92 4 жыл бұрын
So.. the example you've provided uses an web api as a source, publicly accessible via the internet. What about using an on-prem database or file system as a source? Will it embed credentials in the data flow as well?
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Yes - take a look at the public docs, or create a dataflow to check it out. Although there are a few exceptions, connectivity and credential management works the same for dataflows as it does for datasets.
@clodola1
@clodola1 2 жыл бұрын
I have one Dataset , I published to the service into its own dataset workspace , I have a second work space for PBIX files (workspaces are segregated, I can apply different security measures across the two workspaces, i.e. no user can see the dataset workspace but only has read access to the dataset, same user can see the workspace or App where the reports reside) ; multiple PBIX files use this one Dataset (one central location, refresh , security) , has all the benefits of a dataflow plus the vertipaq engine for performance ; lean report files referencing one dataset published in the service (live connection to the dataset in PBI Service) ; is this a better approach or would you still recommend dataflow in this scenario ; only downside? Initial dev is done locally vs in the cloud , limited to you local machines resources
@nivek81600
@nivek81600 3 жыл бұрын
Thank you Matthew, it's very clear! Can we insert columns and measures in dataflow like we can do in BI desktop?
@BIPolarSSBI
@BIPolarSSBI 3 жыл бұрын
Thanks Nivek! You can add columns to any dataflow entity (just like you would in any tool that uses Power Query) but measures are a Vertipaq/Tabular/dataset concept that doesn't exist in dataflows.
@sau002
@sau002 3 жыл бұрын
Can I define relationships inside a DataFlow? Or should that be inside a DataSet only?
@georgekaroubas6136
@georgekaroubas6136 4 жыл бұрын
Very nice explanation. Thank you
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Thank you!
@makelifeeasy6035
@makelifeeasy6035 4 жыл бұрын
What edge does data flow has over published Power BI dataset. What I mean is I define a Power BI dataset in PBI desktop without VIZ and publish it. Other Power BI reports will use this Power BI dataset as its data source.
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Dataflows enable more granular reuse. They let you "mix and match" entities from multiple dataflows, and mash them up with other data sources, to create a new dataset. You can't do that with datasets. There's more detail here: ssbipolar.com/2019/10/14/power-bite-dataflows-vs-datasets/
@AnandDwivedi
@AnandDwivedi 4 жыл бұрын
Nice and useful
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Thank you!
@HenryTsang
@HenryTsang 4 жыл бұрын
Awesome Matthew, this is great explanation. With DataSets, you mentioned that behind the scene is Analysis Services Tabular and hence I can modify the semantic via its exposed XMLA endpoints (I had a requirement to do so with a project). With Dataflows, could that model be changed in a similar fashion (it sounded like it is no longer using Analysis Services behind the scene).
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Take a look here for a good starting point on dataflows: ssbipolar.com/2018/10/23/dataflows-in-power-bi/ Dataflows use file storage (CDM folders) behind the scenes, which is completely different from AS Tabular.
@thangtruongquoc6754
@thangtruongquoc6754 4 жыл бұрын
Hi Matthew! I appreciate your helpful video. I got a problem. I'm dealing with the huge dataset (around 25 million data rows) and increasing fast day by day. I only have a Power BI Pro account. I build a dataset in power bi desktop, then publish it into power bi service. But it takes a long time to refresh in pwbi services. I tried to use Incremental Refresh but it does not work in my case. So I wonder when I used dataflow, it can help me to reduce refresh-time in pwb services? Thanks for reading this comment and best wishes!
@danielweikertsn1615
@danielweikertsn1615 3 жыл бұрын
Hi Thanks for the video. I got a question. If we prepare our datamodel, do all the transformations, etc. and then share this prepared model as a Power BI dataset which other people can use, and modify it when necessary we have a single point of truth with modifications. So where is the use case of dataflows in this case. I do not really get that. Could you please elaborate? Thanks so much!
@BIPolarSSBI
@BIPolarSSBI 3 жыл бұрын
Does this help? kzfaq.info/get/bejne/qJxldZCqsavFmJc.html If your dataset does everything you need - no one needs to customize it, and the data in it is not used in any other dataset - you may not have a use case for dataflows, but each tool provides different capabilities for reuse...
@danielweikertsn1615
@danielweikertsn1615 3 жыл бұрын
@@BIPolarSSBI Thanks a lot highly appreciated. Does dataflows "only" provide individual entities/tables or can we also get a complete model like in the dataset. So if we import the dataflow but instead of creating the relationships manually automatically have them after the import? by the way. Great channel
@mathew9665
@mathew9665 3 жыл бұрын
Hi BI Polar, Thank you for this, is there any data on the Pro v Premium licences differences and limitations and finally - If you've built Power BI reports directly from source and wish to change current reports to a Dataflow and also Dataset usage is this do able without having to re-build the reports?
@BIPolarSSBI
@BIPolarSSBI 3 жыл бұрын
Please check out these posts - they should give you what you need: docs.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-premium-features ssbipolar.com/2019/11/25/power-bite-turning-datasets-into-dataflows/
@mathew9665
@mathew9665 3 жыл бұрын
@@BIPolarSSBI Thank you so much for your help - both links very useful. Is there a method on how to change a Power BI report that imports from SQL directly, to a report that instead connects to a newly created dataset? I have a number of Power BI prototype report, and was hoping to transform them to connect to Datasets (and then in turn further down the line dataflows) Your video on moving a report/dataset to use a dataflow was great, thank you.
@akashleenamullick1923
@akashleenamullick1923 3 жыл бұрын
Hi, is it possible to use dax tables created in power bi desktop as a datasource for data flows ?
@BIPolarSSBI
@BIPolarSSBI 3 жыл бұрын
You can connect to a Power BI dataset in a Premium workspace by using its XMLA endpoint and the Analysis Services connector in dataflows. Connecting to tables in a tabular model running in in Power BI Desktop is not supported.
@victorarayal
@victorarayal 4 жыл бұрын
Hi Matthew! About cloud sources for Dataflows, like Azure SQL database for example. When I tried to do the connection, i am obligated to install and configure the gateway to make it work (even though it is a cloud source). As far as you know, are we obligated to use the gateway with cloud sources like azure sql database? Because If we don't use dataflows, we can schedule refresh without the gateway, so it is much easier to maintain. Hope you can give us some guide. Thank you for your videos!
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
You do not need to use gateways if you're using a cloud data source like Azure SQL Database. If you're being prompted to select a gateway, there's some other factor at play.
@victorarayal
@victorarayal 4 жыл бұрын
​@@BIPolarSSBI Thanks! I just have one more doubt about sharing. Is sharing "the whole workspace" the only way to share the dataflow with other users? For example, i know it is possible to share just the dataset with other users (no need to share the whole workspace). Here, it seems the only way is to share the whole "workspace" with an appropriate security level. ¿Is there a better way?
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
@@victorarayal Permissions for dataflows are set at the workspace level. See here (and related posts) for more details and patterns: ssbipolar.com/2019/06/22/quick-tip-creating-data-workspaces-for-dataflows-and-shared-datasets/
@bixbe_sglearn
@bixbe_sglearn 4 жыл бұрын
Doesn't sound like Power BI is easy for business folks to use. Must go to Wikipedia to search for jargon every other sentence. Tableau seems much more intuitive.
@BIPolarSSBI
@BIPolarSSBI 4 жыл бұрын
Please don't use my mode of presentation to reach this conclusion. There are a lot of business folks out there being successful with Power BI every day, and lots of folks in the community creating content for them. I am not one of these people.
@alt-enter237
@alt-enter237 4 жыл бұрын
I can't speak for how intuitive (or not) Tableau is, but I can say that with Power BI, there are some concepts to be learned. I find it difficult to imagine that those same concepts are not also required to be successful with Tableau. After all, both tools are using underlying data, data models, and relationships, all of which have terms associated with them that may be new to business users.
@RealJazzMC
@RealJazzMC 2 жыл бұрын
I was really able to understand the fundamentals of what a dataflow is compared to a dataset: you explanation was very clear and helpful! Thanks :-)
Workspace Lineage View
4:48
BI Polar
Рет қаралды 1,2 М.
Enabling reuse by moving queries from datasets to dataflows
11:57
Пройди игру и получи 5 чупа-чупсов (2024)
00:49
Екатерина Ковалева
Рет қаралды 4,4 МЛН
女孩妒忌小丑女? #小丑#shorts
00:34
好人小丑
Рет қаралды 88 МЛН
АЗАРТНИК 4 |СЕЗОН 1 Серия
40:47
Inter Production
Рет қаралды 585 М.
Data sharing and reuse with dataflows and datasets
6:38
BI Polar
Рет қаралды 5 М.
🚨 YOU'RE VISUALIZING YOUR DATA WRONG. And Here's Why...
17:11
Adam Finer - Learn BI Online
Рет қаралды 101 М.
What are the Use Cases of Dataflow for You in Power BI
9:38
Power BI datasets vs. Power BI dataflows - What gets refreshes?
2:58
Power BI dataflows vs datamarts: What's the difference???
5:44
Guy in a Cube
Рет қаралды 59 М.
Being a PM at Microsoft: Influencing without authority
13:42
Introducing: Power BI data prep with dataflows
25:08
Microsoft Power BI
Рет қаралды 26 М.