Great explanation, you have a talent of explaining something very complex in a very easy to digest manner!
@bradleyvandevis73784 жыл бұрын
Thanks so much Matthew. I'm new to leveraging dataflows and this was a great primer for their use vs a dataset. Thanks again!
@BIPolarSSBI4 жыл бұрын
Thank you!!
@jainbhavesh92 жыл бұрын
Thanks Matthew, very well explained!!!
@kostaskolotouros43454 жыл бұрын
Thanks for this BI Polar, very good video ! 2 questions: 1) Can a dataflow be consumed in multiple workspaces? 2) Is there a suggested way to organise the dataflows? For example would you create one dataflow per database and include all its tables or would you create a separate dataflow per entity?
@BIPolarSSBI4 жыл бұрын
Key Kostas - thanks for the feedback and questions. Quick answers: 1 - Absolutely. You create a dataflow in one workspace but can use it in as many datasets in as many different (or the same) workspaces as you want. 2 - It depends. There's no one answer here, but if you follow the general principles of "things that will be used together get organized together" you're probably on the right track. Also remember that dataflow permissions are set at the workspace level, and that refresh is performed at the dataflow level. These two functional characteristics may influence your design as well.
@kostaskolotouros43454 жыл бұрын
@@BIPolarSSBI thanks!
@thiagofraletti42204 жыл бұрын
Wonderful Matthew, thank you!
@BIPolarSSBI4 жыл бұрын
Glad you enjoyed it!
@user-lm5wb8vi1xАй бұрын
Finished watching
@Tattysnuc3 жыл бұрын
Great intro and explanation. Thx
@BIPolarSSBI3 жыл бұрын
Glad it was helpful!
@pukashell61704 жыл бұрын
Great Stuff Matthew. Like the new channel. Look forward to future videos.
@BIPolarSSBI4 жыл бұрын
The plan is to have new videos every Monday. Fingers crossed...
@sau0023 жыл бұрын
Much better. I like your problem-solution approach. Thank you.
@bradj2294 жыл бұрын
Excellent video! I'm wondering though. 1. What's the difference between a Power BI Desktop Dataset (tabular model) and Power BI Service Dataset (seems basically identical, but w/o modeling capability). 2. You cannot create relationships between entities (tables) in Dataflows correct, instead it's more used as a data source to connect to to then build relationship within Power BI Desktop?
@BIPolarSSBI4 жыл бұрын
Short answer 1: datasets are Analysis Services tabular models, like what you've had in SQL Server Analysis Services for over a decade. Power BI Desktop is the primary authoring / modeling experience, and the Power BI service is the deployment / consumption platform, but both the service and Desktop serve as hosts for the tabular engine. Short answer 2: You cannot explicitly create relationships between dataflow entities through a UI, but the underlying CDM metadata does include relationships. If you think of dataflows as a data source for your datasets and the relationships between tables in the datasets' tabular models, you're on the right track.
@nigelnaicker79482 жыл бұрын
how relevant is this now? surely i can create a dataset and that can be stored on the PBI service, and users can connect to the dataset from power bi desktop, im not seeing the big value add here.
@sebastiendebosscher2 жыл бұрын
Hi Matthew, I couldn't find anything on this: The primary keys defined in my dataflows don't exist anymore when I import that table in power BI desktop. Is that unsupported? Should I need to recreate the primary keys in the dataset by Table.ReplaceKeys? (I need primary keys for performance on merging and aggregating tables in the dataset)
@gulhermepereira2494 жыл бұрын
Great explanation, Matthew! I've got one question, am I able to share just a couple of dataflows within a workspace with a specific user or is it "all or nothing" kind of sharing?
@BIPolarSSBI4 жыл бұрын
Thank you! The workspace is the unit of sharing. If you want to share a subset of your dataflows, you'll need to put them in a different workspace.
@Boedie924 жыл бұрын
So.. the example you've provided uses an web api as a source, publicly accessible via the internet. What about using an on-prem database or file system as a source? Will it embed credentials in the data flow as well?
@BIPolarSSBI4 жыл бұрын
Yes - take a look at the public docs, or create a dataflow to check it out. Although there are a few exceptions, connectivity and credential management works the same for dataflows as it does for datasets.
@clodola12 жыл бұрын
I have one Dataset , I published to the service into its own dataset workspace , I have a second work space for PBIX files (workspaces are segregated, I can apply different security measures across the two workspaces, i.e. no user can see the dataset workspace but only has read access to the dataset, same user can see the workspace or App where the reports reside) ; multiple PBIX files use this one Dataset (one central location, refresh , security) , has all the benefits of a dataflow plus the vertipaq engine for performance ; lean report files referencing one dataset published in the service (live connection to the dataset in PBI Service) ; is this a better approach or would you still recommend dataflow in this scenario ; only downside? Initial dev is done locally vs in the cloud , limited to you local machines resources
@nivek816003 жыл бұрын
Thank you Matthew, it's very clear! Can we insert columns and measures in dataflow like we can do in BI desktop?
@BIPolarSSBI3 жыл бұрын
Thanks Nivek! You can add columns to any dataflow entity (just like you would in any tool that uses Power Query) but measures are a Vertipaq/Tabular/dataset concept that doesn't exist in dataflows.
@sau0023 жыл бұрын
Can I define relationships inside a DataFlow? Or should that be inside a DataSet only?
@georgekaroubas61364 жыл бұрын
Very nice explanation. Thank you
@BIPolarSSBI4 жыл бұрын
Thank you!
@makelifeeasy60354 жыл бұрын
What edge does data flow has over published Power BI dataset. What I mean is I define a Power BI dataset in PBI desktop without VIZ and publish it. Other Power BI reports will use this Power BI dataset as its data source.
@BIPolarSSBI4 жыл бұрын
Dataflows enable more granular reuse. They let you "mix and match" entities from multiple dataflows, and mash them up with other data sources, to create a new dataset. You can't do that with datasets. There's more detail here: ssbipolar.com/2019/10/14/power-bite-dataflows-vs-datasets/
@AnandDwivedi4 жыл бұрын
Nice and useful
@BIPolarSSBI4 жыл бұрын
Thank you!
@HenryTsang4 жыл бұрын
Awesome Matthew, this is great explanation. With DataSets, you mentioned that behind the scene is Analysis Services Tabular and hence I can modify the semantic via its exposed XMLA endpoints (I had a requirement to do so with a project). With Dataflows, could that model be changed in a similar fashion (it sounded like it is no longer using Analysis Services behind the scene).
@BIPolarSSBI4 жыл бұрын
Take a look here for a good starting point on dataflows: ssbipolar.com/2018/10/23/dataflows-in-power-bi/ Dataflows use file storage (CDM folders) behind the scenes, which is completely different from AS Tabular.
@thangtruongquoc67544 жыл бұрын
Hi Matthew! I appreciate your helpful video. I got a problem. I'm dealing with the huge dataset (around 25 million data rows) and increasing fast day by day. I only have a Power BI Pro account. I build a dataset in power bi desktop, then publish it into power bi service. But it takes a long time to refresh in pwbi services. I tried to use Incremental Refresh but it does not work in my case. So I wonder when I used dataflow, it can help me to reduce refresh-time in pwb services? Thanks for reading this comment and best wishes!
@danielweikertsn16153 жыл бұрын
Hi Thanks for the video. I got a question. If we prepare our datamodel, do all the transformations, etc. and then share this prepared model as a Power BI dataset which other people can use, and modify it when necessary we have a single point of truth with modifications. So where is the use case of dataflows in this case. I do not really get that. Could you please elaborate? Thanks so much!
@BIPolarSSBI3 жыл бұрын
Does this help? kzfaq.info/get/bejne/qJxldZCqsavFmJc.html If your dataset does everything you need - no one needs to customize it, and the data in it is not used in any other dataset - you may not have a use case for dataflows, but each tool provides different capabilities for reuse...
@danielweikertsn16153 жыл бұрын
@@BIPolarSSBI Thanks a lot highly appreciated. Does dataflows "only" provide individual entities/tables or can we also get a complete model like in the dataset. So if we import the dataflow but instead of creating the relationships manually automatically have them after the import? by the way. Great channel
@mathew96653 жыл бұрын
Hi BI Polar, Thank you for this, is there any data on the Pro v Premium licences differences and limitations and finally - If you've built Power BI reports directly from source and wish to change current reports to a Dataflow and also Dataset usage is this do able without having to re-build the reports?
@BIPolarSSBI3 жыл бұрын
Please check out these posts - they should give you what you need: docs.microsoft.com/en-us/power-bi/transform-model/dataflows/dataflows-premium-features ssbipolar.com/2019/11/25/power-bite-turning-datasets-into-dataflows/
@mathew96653 жыл бұрын
@@BIPolarSSBI Thank you so much for your help - both links very useful. Is there a method on how to change a Power BI report that imports from SQL directly, to a report that instead connects to a newly created dataset? I have a number of Power BI prototype report, and was hoping to transform them to connect to Datasets (and then in turn further down the line dataflows) Your video on moving a report/dataset to use a dataflow was great, thank you.
@akashleenamullick19233 жыл бұрын
Hi, is it possible to use dax tables created in power bi desktop as a datasource for data flows ?
@BIPolarSSBI3 жыл бұрын
You can connect to a Power BI dataset in a Premium workspace by using its XMLA endpoint and the Analysis Services connector in dataflows. Connecting to tables in a tabular model running in in Power BI Desktop is not supported.
@victorarayal4 жыл бұрын
Hi Matthew! About cloud sources for Dataflows, like Azure SQL database for example. When I tried to do the connection, i am obligated to install and configure the gateway to make it work (even though it is a cloud source). As far as you know, are we obligated to use the gateway with cloud sources like azure sql database? Because If we don't use dataflows, we can schedule refresh without the gateway, so it is much easier to maintain. Hope you can give us some guide. Thank you for your videos!
@BIPolarSSBI4 жыл бұрын
You do not need to use gateways if you're using a cloud data source like Azure SQL Database. If you're being prompted to select a gateway, there's some other factor at play.
@victorarayal4 жыл бұрын
@@BIPolarSSBI Thanks! I just have one more doubt about sharing. Is sharing "the whole workspace" the only way to share the dataflow with other users? For example, i know it is possible to share just the dataset with other users (no need to share the whole workspace). Here, it seems the only way is to share the whole "workspace" with an appropriate security level. ¿Is there a better way?
@BIPolarSSBI4 жыл бұрын
@@victorarayal Permissions for dataflows are set at the workspace level. See here (and related posts) for more details and patterns: ssbipolar.com/2019/06/22/quick-tip-creating-data-workspaces-for-dataflows-and-shared-datasets/
@bixbe_sglearn4 жыл бұрын
Doesn't sound like Power BI is easy for business folks to use. Must go to Wikipedia to search for jargon every other sentence. Tableau seems much more intuitive.
@BIPolarSSBI4 жыл бұрын
Please don't use my mode of presentation to reach this conclusion. There are a lot of business folks out there being successful with Power BI every day, and lots of folks in the community creating content for them. I am not one of these people.
@alt-enter2374 жыл бұрын
I can't speak for how intuitive (or not) Tableau is, but I can say that with Power BI, there are some concepts to be learned. I find it difficult to imagine that those same concepts are not also required to be successful with Tableau. After all, both tools are using underlying data, data models, and relationships, all of which have terms associated with them that may be new to business users.
@RealJazzMC2 жыл бұрын
I was really able to understand the fundamentals of what a dataflow is compared to a dataset: you explanation was very clear and helpful! Thanks :-)