Introducing Dagster Insights -- Dagster Launch Week - Fall 2023
Рет қаралды 882
Күн бұрынJoin us for day 3 of Dagster Launch Week as Jarred Colli shares the details on Dagster Insights, a new operational observability capability that greatly expands Dagster's observability capabilities. Monitor your runs at the asset level to understand compute usage and what is driving your cloud bills.
Read the companion blogpost: dagster.io/blog/dagster-insights
00:00 Introduction: Avoiding the Modern Data Money Trap
01:24 Best practices in operational visibility
02:15 Introducing Dagster Insights
05:20 Dagster Insights demo
08:04 Why is Dagster uniquely placed to provide operational observability
09:00 The release plan
Try Dagster today with a 30-day free trial: dagster.io/lp/dagster-cloud-t...
@user-xh6tx8py1r 8 ай бұрын
Jarred from Dagster here. Thanks for the question - We are still prioritizing which platforms to support next, and we are taking input on which integrations and metrics are the most valuable. Databricks is on the list, but no ETA on when that will be released. Dagster Insights is customizable, so you can bring in data from your own Databricks instance.The biggest challenge for Databricks is mapping how it accounts for cost (which is focused on instances and run time, and not on a per query basis) to a Dagster run.
@user-ph8mi2ei2y 8 ай бұрын
Is there a plan to provide out-of-the-box insights gathering for Databricks as well or will that be something that the community (i.e. us) will need to create?
Мозголом
Рет қаралды 659 М.
Electronics_latvia
Рет қаралды 1,1 МЛН
Syncswift
Рет қаралды 1,2 МЛН
flaco
Рет қаралды 652 М.
Special Effects Funny 44
Рет қаралды 2,7 МЛН