Deployment Pipelines give you more CONTROL (Power BI Premium)
Вставка
- Опубліковано 3 чер 2020
- With Deployment Pipelines, you can control your application life cycle stages. Keep content in sync at the different stages of your development. Power BI Premium is required.
Documentation:
docs.microsoft.com/power-bi/c...
docs.microsoft.com/power-bi/c...
docs.microsoft.com/power-bi/c...
📢 Become a member: guyinacu.be/membership
*******************
Want to take your Power BI skills to the next level? We have training courses available to help you with your journey.
🎓 Guy in a Cube courses: guyinacu.be/courses
*******************
LET'S CONNECT!
*******************
-- / guyinacube
-- / awsaxton
-- / patrickdba
-- / guyinacube
-- / guyinacube
-- guyinacube.com
**Gear**
🛠 Check out my Tools page - guyinacube.com/tools/
#PowerBI #DeploymentPipelines #GuyInACube - Наука та технологія
Pipelines look really slick! This reduces the headache of manually creating dev and prod workspaces and trying to keep track of everything manually! Great work PBI team!
What a wonderfully well constructed video! Become your instant fan 😊👍 MS is a bit late as Life Cycle Management should have been there from the beginning but a welcome addition.
This video is a textbook example of the proper way to make a Power BI video! Bravo!
Great vid! Thanks! Do the additional workspaces needed for the pipeline cost extra or are they included in the price of the existing workspace?
Amazing, thanks for the quick over! Please keep us posted on the updates :)
Tx for detailed info Adam. The first video on this new feature.
Amazing feature! We’ve been waiting for this for a while..
Thanks for the update. Love your work!
I like it! If you assign production workspace first there is no way to work backwards.
For dataset refreshes, when we publish from Test --> Production, if we have refreshed the dataset in Test does it publish the refreshed dataset? This would be big as we could re-publish on dev/test, wait for refresh completion, then push it into production, rather than doing a full refresh each time and have users have out-of-date info if Desktop .pbix is out-of-sync.
Great Video and I like the pipelines feature a lot. But what about removing dashboards, reports and datasets. Is this still a manual process by removing the items in test and prod manually as well?
Adam, how would you do version management?
Thanks You GUYS In CUBE .. It is indeed a great and Informative Video.. I am still curious to know about the data flows and excel files
This was awesome, thank you so much
Does it work with Streaming Datasets, like the type you would use to update real-time dashboards? These are APIs at my organization.
Excellent video, but a question -- what happens if you need to revert? That is, you need to take the version in Prod and move it back to Dev for an emergency patch? When we attempt to do that we get the Prod setting for the Direct Query dataset, and we want it to point to the Dev database since we're in Dev. We tried copying back, but the dataset kept the Prod settings. With a different source data table it crashed the report and we were unable to fix the version for a re-release.
How do you take a Prod version and bring it back (granted, only needed in a pinch) to Dev and get the Dev settings back onto its Dataset?
I will ultimately have a Paginated Report in my Production App. Any thoughts on where I publish that from/to? Should I publish that straight off to the Production Workspace/App?
This looks great!! was wondering if it is possible to change embedded canvas app url based on environment?
Question on the limitations around excel files: if I have a composite model scenario (using an excel file as an extra data source), will the PBIX report I create utilizing a composite model not properly flow from dev to production?
Very thorough! One of my favorite workspace management features in a long long time. I need to adjust what I cover when I do a video on this now, haha.
Impressive feature !!
Does the Schedule and RLS will be intact ? Also this means, the "Update App" in the workspace will go off shortly ?
This looks great.
If I restrict membership of the Prod workspace member role, I can limit who can promote something into Production, but they can still push stuff around Dev and Test if they're members of those workspaces member roles? Sounds too simple :D
Love your videos guys! Keep em rolling.......... :-)
Is there any possibility to deploy selective contents from a single workspace in TEST stage to multiple workspaces in target stage?
Really cool Adam. I am working with a Powerbi consultant as contracter while I do most of the work myself. Leave the hard stuff for him ;-) We always have to be aware of who is developing where. In particular since there a acces limitation for the consultant on our network. I think this will kill all those issues and help us controle our dev - test -deploy proces. Great video.
This is cool feature. How does this work with Power ON visual planner?
Great vid, as always! :) what SWs do you (and of course Patrick) use to record videos? I guess you have some video editing, screenrecorder, etc... Thanks
Check out guyinacube.com/tools/ and guyinacu.be/streamsetup. Been using the streaming setup more lately to record. Makes it pretty easy. Using Adobe products for editing and post-production.
Do we have any approval mechanism through email ? for the same . Or a way to notify the managers to review and approve the report ?
Very nice and great info Adam thanks a lot
How about the credentials are different from Dev , UAT n Prod then how can we change those please explain
Is RLS get applied between the workspace?
Hej!
You forgot to mention that you NEED to have permission to create workspace to be able to use the pipelines. Even after a pipeline are created and have all three WS created you can’t deploy without this permissions.
Feels like a mistake by MS and we hope it will be changed soon!
Hi Adam,
What if I don't wanna create new by-product workspaces, instead I would like to use my existing dev, test and Prod workspaces?
This is awesome !! Cool.. Impressive..
Great video. Thanks.
Can we use existing Dev and UAT workspaces for deployment pipelines?
Great! Can we deploy Test to multiple Prod workspaces. For my case, we need to maintain one dev report, but multiple Production env (one for each client). The only difference is the underlying database name.
I appreciate the video and the high production quality of it. My only feedback is that I would have loved to see the full diffing functionality. Or is there nothing more to it?
I have a development background and I need help to understand this.
Why did MSFT create such a feature? This is completely normal CI/CD pipeline stuff. They already have 2 such products. There was no need for this. It is such a basic thing and of course they managed to do it differently from all the rest of the SDLC.
Again, high quality production, and I can see why there would be enthusiasm for such a basic and needed feature.
Lightning bold :) 4:58 I can feel that sense of humor:) good job !
Someone knows how to automatically change a live report data source when you deploy? in my case it keeps the previous workspace configuration
Hi everyone. Thanks for the awesome content Adam, but even if I updated the configuration rules and added data source rules to provide access to QA or Production databases (SQL Server databases on-premise), reports in QA or Production workspaces still access the development database. Namely, data source rules I added do not take affect. Does anyone have a tip for this problem? Regards.
Is there any way to have a many to one relationship on those pipelines? Eg have one test workspace but multiple production workspaces. In my example I have EU and US workspaces which contain exact copies of the same pbix files, just with different connection strings.
Lovely. Just missing one piece: source control for the pbix file in DEV. I've seen methods using OneDrive and SharePoint -- what do you recommend? I need a process that will allow me to add comments on each version change.
SharePoint is what I do, howevr 3 year later (since I am a bit late to answer lol) you can check the nw Power BI project Feature, can save the repor as a Pbip file, this will divide your report to 2 folders one of them has a Json like format file you can keep for version change
Does it support monitoring versions history, so i would be able to restore any old version?
Thank you for this. I am struggling with how to integrate my dataflows into the process of development and testing. I don't have access to any databases, just dataflows. What do you recommend? Does this warrant a video?
Do I need 3 workspaces with premium?
I just finished watching one of the dev camp videos and always play those @.75 speed... I jumped into this one at slow speed, and you sound pretty funny in slo-mo! 😂
Yes, I used Pipelines, We are exploring pushing reports with a different type of data sources.
somehow the deployment settings of the newly created prod workspace show that I have no datasets? despite having deployed them already?
Do you know if they are planning to add support for Dataset rules for datasets residing outside of the workspace you have assigned? We have a single workspace for our Datasets that all of our report workspaces are pulling from, and it does not allow me to set dataset rules.
Awesome!! Full SDLC..
QQ -- Will it work for the report which is using data flow from other workspace?
Yes reports and datasets are covered by this. Regardless of the data sources. Dataflows themselves are not covered by this directly.
Good video, Adam. Thanks!
Appreciate that James! 👊
whoa! MSFT invested in a new cool lego logo and microphone :)
Hi, if we implement the incremental refresh in production workspace and do the development work in dev workspace (without incremental setup) and everytime push the changes from dev to prod, will it impact the incremental setup or we'll have to apply incremental setup again?
Is there a way to deploy only certain items? Right now it seems like gets moved. For example, my Dev workspace has a lot of OTHER things that I may not want to see in a Test or Prod environment. Can I move only the reports and datasets I want to see in Test and Prod?
What if we have already existing Dev, Test and PROD workspace - now we need to setup the Deployment pipeline on those existing workspace - how we can do that. Thanks in Advance
Can we rename the Test and Prod Premium workspaces ? .. as it creates default ones
What happen when I need to add other Origen Data with other conexión and upload and replace the power BI project to workspace? And How can I return back the other version?
Hi "Guys in a Cube". Thank you for this amazing channel. I have a question about the pipeline. I have two series of changes. Both these series are in the test now. But one of them has been tested and ready to deploy to Prod. How can I use pipeline to deploy just one of the changes to Prod and keep the other one in the test?
👍 very helpful
When you deploy from Dev to Test, let's say, are the datasets deployed in Test automatically refreshed whenever a new deployment happens?
Man , that's beautiful, we can focus on PBI only !!!
Adam, is it not possible to change the connection information if you are using a Power BI dataset in a different workspace? After deploying 4 reports to test that all have separate datasets in a different workspace, the "lightning bolt" dialog box will be empty?
If I have a 17 GB dataset, would it copy the entire dataset to production, or just the metadata of it?
Do both workspaces need to be Premium Workspaces?
Hi Adam - please update this video or its description to mention that these features displayed by you are no longer available / have been updated by the Microsoft team.
Suppose our team implements a deployment pipeline, but later down the line we change our mind and want to revert back to managing separate workspaces. Is it possible to take the workspaces &/or reports out of the pipelines?
How will it work for Paginated reports ?
Great overview. But leave the bananas for Patrick 😅
Awesome t-shirt, looks sick!!!
Is it possible to create more than 2 test environments in deployment pipe lines
What screen recording software do you use?
Is it possible to upgrade an existing workspaces backed up by the premium capacity to utilise the pipeline features?
Yes, but what I really want to know is can you use existing for all 3?
What can be developed, tested..etc ?
This is great. We were looking into how to do this programmatically and this is much better. Does this work with incremental refresh?
It does not support incremental refresh datasets, which makes me very sad. :-(
@@micahdail I had a feeling. Incremental is amazing but still not enterprise ready. We have problems with it constantly.
Yet :) baby steps. It is a nice feature for sure. I know the team is working on a lot of enhancements.
@@GuyInACube Great to hear!
I'm getting this error. What could be the issue ?
"The workspace can be assigned, however, when the workspace is deployed to another stage, items won't be deployed to the next stage.
The workspace contains the following items:
Unsupported report ,Unsupported dataset"
Just Wanted to know if any feature exist like if we have more than 100 report to publish from test to prod then can we select all 100 report together in one go or we must do individual select and deploy
Both, you can select each
it will be good if we just select a report from the workspace to work on instead of copying everything to start with. I have over 20 reports that are in production. i would like to use the pipeline for a new report to be done
WOW, love it!
Awesome! 👊
Aint using Deployement pipelines going to take extra space as the same dataset is transfered to each workspace ?
I'm sad that deployment pipelines are a premium feature. Most of my employer's customers are too small to consider Power BI Premium as an option as it is too expensive for them.
Coincidentally, I set up a whole deployment pipeline in azure devops just 3 weeks ago. For small teams devops is completely free and no premium capacity is necessary. You may use that instead 🙂
tareksalha thanks for this! I’ll look into Devops to create a pipeline.
@@tareksalha Any good videos to showcase this?
@@tareksalha can you show us how you did it? Thank you in advance
@@mruniversemrwhite333 hi guys, sorry, missed the other question. this is a good start: community.powerbi.com/t5/Community-Blog/PowerBI-CICD-using-Azure-DevOps/ba-p/769244
Nice video. What if we have more than 3 environments- dev, qa, uat and prod?
Then you need to new-look at your process as seems overly complicated. If it is that technical you should have the skills to manage via 3rd party or self built tools either way something not right
could you confirm, so i build a dashboard and then this deployment pipelines is just changing the data being fed to the dashboard?
More than 3 environments, can I deploy reports using single pipeline ??
Is postgre sql don’t support deployment pipeline in power bi?
1) Do Apps deploy from Dev to Test to Prod? 2) What can my Pro users do with a PPU workspace?
What about using different data source credentials between workspaces, as in the scenario where a developer does not have access to full production data; can this be handled by pipeline rules / parameters or something else?
this is all in PBI service so credentials should be passed via stored credentials configured in the gateway, not individual files. I would imagine this should work if properly configured
Hi Adam, awesome job and videos, I'm a fan!
I'm trying to do the same thing with paginated reports using PowerBI Report builder. The problem is that there is no dataset when dealing with paginated reports! I can't change the sources! So, is there a way to use pipelines in a paginated report usecase?
set up the data source in the query as a parameter. then set a rule in each workspace which parameter to use
This looks great. But I have a question, I want to deploy a PBIT that when pipelined to a workspace, I want it to automatically link up to a specific database/datasource, save it as a PBIX file and when opened by a user, it opens as that PBIX file with all custom settings working as expected.
Any ideas? Any sites I can look at to make this happen?
how can deploy pipeline into already created work spaces? example : i have 3 premium work spaces already created Sales Dev sales QA Sales Prod
Is it possible to use deployment rules for altering which Power BI dataset a report connects to as it moves through the stages? I thought those connections were supposed to move automatically but they don't. I had a report connected to the shared dataset in the dev workspace, deployed to production, then when I looked at lineage view the production report was trying to connect to the dataset in the dev workspace and it was causing all sorts of permissions issues.
I have a dataset with dynamics CRM and Synapse together. Synapse instances are different for all 3 environments. Is there a way I can push the SQL authentication creds through the pipeline. Currently I sync in the dataset to higher environment and then publish it. Is there a way to automate it
Need one help... I have deployed the report using the deployment pipeline.. Have two stages test and production..
I have some changes to be done in power bi pbix.. I have done it and republished it in test ws.. And then deployed to prod.. But post deployment it is showing that dataset don't match
Thank you so much for sharing this important information about pipeline, do the parameter rules also apply if I'm using fields parameters? It just that I have a report with fields parameters but in the prod stage it is not working the pipeline, why do you think that is happening?
I'd really appreciate if you could help me with this issue I'm having :)
Hello I'm using Azure Analisys Services as the datasource of my dashboards (Live Connection) and I have these databases (TabularDev, TabularQA and TabularProd) when I add the rules to change the database for the specific environments in the pipeline it doesn't work, Can someone please tell me what am i doing wrong?
Does it work for Paginated Reports?
No it does not.
All good
thanks for video. Now i have already Production and Acceptance classic work spaces , if i would like to create pipeline what would be the way? My Assumption is
1.Upgrade Production classic work space to new work space.
2 Use Assign new production work space and create pipeline with Test and Production stages.
3.Now manually deploy Acceptance reports to Test stage
Is this is how i should follow? could you please help me
thanks in advance
Ability to deploy the objects from dev/ test to already available premium production workspace would be useful? Instead of creating new workspace?? Just my use case for my one of the projects we went LIVE recently. Big fan of your work 🧡
I've heard that from a few folks - as well as folks asking for clarification on that point. But, that's how it is currently designed.
@@GuyInACube Thanks for your reply Adam 🙏😊
Really cool! Unfortunately useless if you don't want all users to have PPU accounts. I feel like Pro users should be able to access the workspaces. It would be beneficial at that point.
110% agree