Impressive video, Guy in a Cube. Looking forward to your next upload from you. I smashed the thumbs up button on your content. Keep up the fantastic work! Your insights into environment management for pipeline orchestration are incredibly valuable. Have you considered discussing how different dependency management strategies might affect performance in larger projects?
Nice information Patrick, thank you. Something weird that happened to me is that after creating an Environment and added a library, saved and published and started to use it, some days later the library got deleted. I still had my Environment but without the library. I had to reinstall it.
I've run into this but from the Synapse Analytics side and it looks like it's a bit more limited in resolving that issue in Synapse (it was quite annoying to get the module available for all modules). Another reason to advocate the step up to Fabric for my manager :D
This works well but not cross workspace, the environment is strongly connected with the workspace. I add special libraries or my own in a lake house in a separate workspace. In this workspace I keep all my shared components. Then when I need a library I make a shortcut to that lake house and then pip install it. This way I have only one place where I have the right (and only) version of a file. Tomorrow I will add a link with more detailed info
Any chance you can make a video how to restore a backpack file made by a sql server tsql backup command. I would like to restore this in a fabric sql server. Is this possible . This will be very helpfull for viewers. Look forward to seeing the video
Impressive video, Guy in a Cube. Looking forward to your next upload from you. I smashed the thumbs up button on your content. Keep up the fantastic work! Your insights into environment management for pipeline orchestration are incredibly valuable. Have you considered discussing how different dependency management strategies might affect performance in larger projects?
Man, that blue GIAC shirt is super crispy and clean. Great reminder that I need to get a new one!
Good stuff, Patrick - clean, concise, helpful. Nice to see the 3 options.
Nice information Patrick, thank you. Something weird that happened to me is that after creating an Environment and added a library, saved and published and started to use it, some days later the library got deleted. I still had my Environment but without the library. I had to reinstall it.
I've run into this but from the Synapse Analytics side and it looks like it's a bit more limited in resolving that issue in Synapse (it was quite annoying to get the module available for all modules). Another reason to advocate the step up to Fabric for my manager :D
This is awesome. I can't find "%pip install semantic-link-labs" in the public libraries?
Nice vid, yea managing packages with spark can be a little tricky
This works well but not cross workspace, the environment is strongly connected with the workspace. I add special libraries or my own in a lake house in a separate workspace. In this workspace I keep all my shared components. Then when I need a library I make a shortcut to that lake house and then pip install it. This way I have only one place where I have the right (and only) version of a file. Tomorrow I will add a link with more detailed info
@@renevduren it’s better include the package installation on each pipeline? For ever 🏃♂️ 🏃♀️ 🏃 🤔
Any chance you can make a video how to restore a backpack file made by a sql server tsql backup command. I would like to restore this in a fabric sql server. Is this possible . This will be very helpfull for viewers. Look forward to seeing the video