Tales From The Field
Tales From The Field
  • 353
  • 142 629
Letting Go of Work
Send us a text (www.buzzsprout.com/twilio/text_messages/2391123/open_sms)
We've all heard the saying do you live to work or work to live? But there is no denying we spend a lot of time at work.
Maybe you've got a great job, maybe it's ok, or maybe you can't wait to quit. Anyway you spin in out of our adult life most of our time is spent at work. So how do we leave it behind and let it go.
That's the subject and you will hear our tips, struggles, and failures.
Переглядів: 21

Відео

Exercise
Переглядів 1221 день тому
Send us a text (www.buzzsprout.com/twilio/text_messages/2391123/open_sms) We have a love hate relationship with exercise. Maybe a hate / hate relationship. We know we need it, and the older we get the more we need it, but it doesn't make it easier. As a matter of fact it makes it harder. It's easier to get injured, it's harder to do it, and it's harder to recover from injury. But the benefits a...
Azure SQL: Restore Azure SQL Managed Instance Database with the Same Name
Переглядів 16328 днів тому
You asked for this video! Literally! Today Daniel Taylor, aka @DBABulldog , answers a user question on how you restore a backup on a database with the same name in SQL Managed Instance! Chapters 00:00 Intros 01:00 Subscriber question based on point in time recovery and docs 01:38 I add and extra step to the documentation and reasoning 01:59 Restore to a point in time (review video provided belo...
Microsoft Fabric: Pass Multiple Parameters from Notebooks to a Data Pipeline Using JSON!
Переглядів 224Місяць тому
In this video Bradley Ball, aka @SQLBalls, answers two questions! How do we pass multiple parameters from a Notebook to a Data Pipeline and how do we pass a JSON Object from a Notebook to a Data Pipeline? Make sure to look at our first video in this series, ua-cam.com/video/NIBCi251Sb8/v-deo.html , because we pick up running right from where that video left off! Chapters 00:00 Multiple Paramete...
Triggers
Переглядів 38Місяць тому
Send us a text (www.buzzsprout.com/twilio/text_messages/2391123/open_sms) When we talked about Male Vulnerability this was a topic that came up. Triggers. A Trigger can provoke a reaction. It could be emotional, physical, or even hostile. We discuss some of our triggers. We discuss tools learned through therapy to address them, and hopefully at the end we are a little more mentally stable-ish.
Having Fun
Переглядів 27Місяць тому
Send us a text (www.buzzsprout.com/twilio/text_messages/2391123/open_sms) It's important to have fun. Part of mental health is not just trudging through the rough stuff, part of it is going out and having fun. It could be at a spa, even better a thermal spa, a game night, a cruise, or many other things. Join the crew as they discuss having fun!
How to Pass Parameters from Notebooks to Pipelines in Microsoft Fabric!
Переглядів 419Місяць тому
Trying to figure out how to pass a #parameter or #variable from a #MicrosofFabric #Notebook to a Data Factory #pipeline? In this video Bradley Ball, aka ‪@SQLBalls‬ , walks through how to use the exit value of a Notebook to pass a parameter to a pipeline. Then we pass it from the pipeline back to another notebook and write it to our Lakehouse! Chapters 00:00 Parameters from Notebooks to Pipelin...
Burn Out
Переглядів 49Місяць тому
Burn Out
Male Vulnerability
Переглядів 43Місяць тому
Male Vulnerability
Monitoring SQL: 3 Most Asked Database Watcher Questions
Переглядів 153Місяць тому
Monitoring SQL: 3 Most Asked Database Watcher Questions
Microsoft Fabric: AI Skills Preview! Build RAG Patterns Simple and Easy!!
Переглядів 7852 місяці тому
Microsoft Fabric: AI Skills Preview! Build RAG Patterns Simple and Easy!!
Where in the World is the Tales from the Field Team?
Переглядів 1022 місяці тому
Where in the World is the Tales from the Field Team?
Microsoft Fabric: Time Travel in Data Warehouse for up to 30 Days!
Переглядів 3092 місяці тому
Microsoft Fabric: Time Travel in Data Warehouse for up to 30 Days!
Azure SQL: Manage Backup Compliance with Long Term Backups for Azure SQL Managed Instance!
Переглядів 2042 місяці тому
Azure SQL: Manage Backup Compliance with Long Term Backups for Azure SQL Managed Instance!
Microsoft Fabric: Use Restore Points to Save Yourself from Logical Corruption!
Переглядів 1842 місяці тому
Microsoft Fabric: Use Restore Points to Save Yourself from Logical Corruption!
Microsoft Fabric: JSON Deserialization to Ingest Census Data in Microsoft Fabric!
Переглядів 2862 місяці тому
Microsoft Fabric: JSON Deserialization to Ingest Census Data in Microsoft Fabric!
Azure SQL: How to Move and Copy Managed Instance Databases
Переглядів 3332 місяці тому
Azure SQL: How to Move and Copy Managed Instance Databases
Microsoft Fabric: How to Ingest API Data Dynamically in Microsoft Fabric
Переглядів 1,1 тис.2 місяці тому
Microsoft Fabric: How to Ingest API Data Dynamically in Microsoft Fabric
Azure SQL Managed Instance: Instance Pools Fast, Predictable, and Scalable!
Переглядів 3503 місяці тому
Azure SQL Managed Instance: Instance Pools Fast, Predictable, and Scalable!
Microsoft Fabric: How to Connect Azure Storage Explorer to OneLake
Переглядів 5783 місяці тому
Microsoft Fabric: How to Connect Azure Storage Explorer to OneLake
Azure SQL Managed Instance: How to set up Advanced Notification Email Alerts for Maintenance!
Переглядів 2553 місяці тому
Azure SQL Managed Instance: How to set up Advanced Notification Email Alerts for Maintenance!
Azure SQL Database: How to Migrate Encrypted Data
Переглядів 2783 місяці тому
Azure SQL Database: How to Migrate Encrypted Data
Microsoft Fabric: Blob Storage Event Triggers in Data Factory Pipelines
Переглядів 7934 місяці тому
Microsoft Fabric: Blob Storage Event Triggers in Data Factory Pipelines
Microsoft Fabric: Fix Errors, Ask Questions, Explain Code with Fabric Data Warehouse Copilot!!
Переглядів 3254 місяці тому
Microsoft Fabric: Fix Errors, Ask Questions, Explain Code with Fabric Data Warehouse Copilot!!
Database Monitoring: Change Database Watcher Data Store to Fabric Eventhouse!
Переглядів 3354 місяці тому
Database Monitoring: Change Database Watcher Data Store to Fabric Eventhouse!
Microsoft Fabric: Copilot for Real-Time Intelligence KQL Queries
Переглядів 4124 місяці тому
Microsoft Fabric: Copilot for Real-Time Intelligence KQL Queries
Microsoft Fabric: End to End Tutorial on Real-Time Streaming Analytics
Переглядів 9074 місяці тому
Microsoft Fabric: End to End Tutorial on Real-Time Streaming Analytics
How to Monitor Azure SQL: Adding SQL Targets to Database Watcher
Переглядів 5325 місяців тому
How to Monitor Azure SQL: Adding SQL Targets to Database Watcher
Microsoft Fabric: Import On Premise SQL Server 2022 Data into Microsoft Fabric with Data Pipelines!!
Переглядів 1 тис.5 місяців тому
Microsoft Fabric: Import On Premise SQL Server 2022 Data into Microsoft Fabric with Data Pipelines!!
Azure Data Community Round Table April 30th 2024
Переглядів 2025 місяців тому
Azure Data Community Round Table April 30th 2024

КОМЕНТАРІ

  • @geirforsmo8749
    @geirforsmo8749 2 дні тому

    Hi! great video. I am actually trying to something that is very similar to this. I need the communication line to be not connected to public internet, and the data flow is only legal from on prem sql to fabric as a push mechanism using ADF. In your solution, do I have to do anything to make the line completely secure? The data is highly sensitive that is why I need to do it this way. By the way, are you using Synapse or ADF in your example?

  • @CathyCui-r5b
    @CathyCui-r5b 3 дні тому

    Can we use managed identity instead of SAS?

  • @dipeshvora8621
    @dipeshvora8621 3 дні тому

    Hey, What if I want to execute the fabric pipeline only if there is data blob created on a specific container and folder. I dont wanrt to trigger it for all the blob uploads ??

  • @kudakwashemujiri6621
    @kudakwashemujiri6621 4 дні тому

    Thank you for the above Sir, very informative and helps. I kinda have the same scenario with encrypted SPs, would you know how anything about how to do this.

  • @JamesCollins90
    @JamesCollins90 5 днів тому

    *Customer wants a test run of upgrading an application, and needs a PITR snapshot in SMI in case of need to rolback* Googles how to.... finds this video, PHEW! Thankyou for dropping this, very handy!

  • @KevinBillings
    @KevinBillings 11 днів тому

    I am using it now... and it works. Reminder ... set a batch limit on the downstream foreach activity that is consuming the .json output.

  • @rafaelalexandrou-t2y
    @rafaelalexandrou-t2y 11 днів тому

    The SID comes as an encrypted value. Anyone had the same issue?

  • @SandeepRajput-g9i
    @SandeepRajput-g9i 12 днів тому

    Nice video . I want to know if this service is free or do we have to pay for using this service? I mean does it billed in my monthly billing?

  • @africanprincesSK89
    @africanprincesSK89 18 днів тому

    Joseph Masengesho is the best! Very helpful article

  • @MorsiMasmoudi
    @MorsiMasmoudi 20 днів тому

    Thank you for the overview of Elastic jobs. However, I have jobs to run on Azure Managed Instance. Is it the same as Azure Database? Because when I tried to create an Elastic Job Agent, the database selection column is empty (I have a SQL Managed Instance with 2 databases on my Azure tenant).

  • @Gezai-G
    @Gezai-G 20 днів тому

    Amazing video!! Can you send me TSQL scripts and all the steps how to secure and setup?

  • @EssentialSQL
    @EssentialSQL 21 день тому

    Thanks for keeping it real

  • @ahmedtambe781
    @ahmedtambe781 24 дні тому

    can you please copy/paste the script in the description

  • @ZarkoJovanovic-i9m
    @ZarkoJovanovic-i9m 24 дні тому

    so how much your ADF that does only this cost monthly?

  • @SQLTalk
    @SQLTalk 27 днів тому

    Love the video. Thanks!

  • @Kirbys911Heaven
    @Kirbys911Heaven 27 днів тому

    Another brilliant video. Thank you!!

  • @pawewrona9749
    @pawewrona9749 27 днів тому

    This is more than great! I am running a notebook that runs multiple notebook and I wanted pass the notebook names that failed for further processing. Thank you for sharing!

  • @danieldoyle5924
    @danieldoyle5924 28 днів тому

    What happens when you promote those storage event triggers to the next environment (workspace)? How do you get it to update the subscription / storage account name etc? Currently in ADF you have to use the ARM template overrides per trigger which is painful

  • @christophehervouet3280
    @christophehervouet3280 Місяць тому

    May I ask a security/ permission question please ? I guess on Fabric notebooks, we are fully UPN SSO regarding permissions ? Permission to access Workspaces objects like Lakehouses & Power BI semantic model ( via semantic link library) fully SSO on interactive notebook sessions , but what happen on "batch" sessions , with data pipeline runs ? - Is it the notebook creator UPN (the owner) which is used on batch pipelines runs ? - What happen during Life cycle CDCD deployment pipeline ? Along side Workspaces - Do we need the notebook owner to be granted access on each environment WS ? - Sounds Microsoft works on a substitution UPN for pipelines runs Thanks a lot for any help

  • @MathiasDenzin
    @MathiasDenzin Місяць тому

    Thanks! This solves one of many problems I have right now. Also good to know, if you pass a boolean from a notebook you can not use True and False, but 1 and 0. In the Pipeline variables it will be set as true and false then.

  • @augbir
    @augbir Місяць тому

    Great video Bradley! Are you coming to the European Fabric Community Conference?

  • @manassehkisame6286
    @manassehkisame6286 Місяць тому

    Inspiring! For a pseudo data scientist

  • @mohamedabohassan-c4p
    @mohamedabohassan-c4p Місяць тому

    what if i have a private db at rds mysql this method will be valid if i white list the subnet?

  • @ThirdwaveItech
    @ThirdwaveItech Місяць тому

    Thanks for the Demo. I investigated mirroring several months ago and saw disclaimers not to use this on production databases. Do you know if it is safe at this point?

  • @snehajagadal2148
    @snehajagadal2148 Місяць тому

    Awesome video✨!! I have one question. After publishing, we get an endpoint, and you ran that endpoint in a Fabric notebook. Suppose I want to run the code outside the workspace, for example, in VS Code, but it's throwing an error for the synapse.ml.mlflow model. Is there any solution for this?

  • @JerryBradshaw-lg6rl
    @JerryBradshaw-lg6rl Місяць тому

    Beautiful views!

  • @SQLBalls
    @SQLBalls Місяць тому

    Amazing!!

  • @DBABulldog
    @DBABulldog Місяць тому

    Incredible!

  • @joshluedeman
    @joshluedeman Місяць тому

    What a beautiful view!!❤

  • @winmax100
    @winmax100 Місяць тому

    This is amazing. I am actively looking for something to replace our current approach to simulate real-time data from on-perm SQL database to a storage account. This is a true solution in my opinion. Can’t wait to test it out. Thank yoi

  • @dipeshvora8621
    @dipeshvora8621 Місяць тому

    Can I create folders within Lakehouse in a workspace ? Basically I want to create bronze/silver/gold in all my workspaces like dev/test/prod and create folder related to sales, product, customer, marketing, hr, finance etc. Then I can give access to users on logical folders

  • @khalilallouch9936
    @khalilallouch9936 Місяць тому

    Hello, I appreciate your explanation thank you. Could I ask how to restore the SQL MI Database with the same name?

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      @khalilallouch9936 @dbabulldog here thank you so much for your comment. We don't have the ability to do a restore with replace within out PaaS services. What I like to do is do a restore of the database from backup to a new name, ensure that the restore is what I am looking for, delete/drop the old database that has the name I wish to restore to, and then alter the newly restored database to the name of the drop/delete that I just completed. Look for a video on this next Monday my friend.

  • @MrRanoren
    @MrRanoren Місяць тому

    very simply put! thanks

  • @sacnan
    @sacnan Місяць тому

    how to pass the value of a fabric pipeline variable to a variable in Notebook ?

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @sacnan We produced a video on that! ua-cam.com/video/Rmf7-WOcouE/v-deo.html We also cover it in this video when we pass the set variable to the second notebook. Hope this helps!

    • @sacnan
      @sacnan Місяць тому

      Thank you very much for the response . In my use case the item value of the for each activity has to be sent to an variable declared in the notebook. So setting a base parameter is not an option.

  • @sankarprayaga
    @sankarprayaga Місяць тому

    same request as the previous one. Can you share your TSQL script, with details on where to run each of the section?

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      @sankarprayaga @dbabulldog here sorry for the delay. Work and life has been busy as of late. I have all the scripts in one place and I am working on documenting them so that they line up with the video. If you would like the raw versions of the scripts before they are complete, I can send you what I have so far. Email me at datay@microsoft.com

  • @totnguyen3308
    @totnguyen3308 Місяць тому

    I encountered the following error: "The database cannot be mirrored to Fabric due to below error: User does not have permission to mirror the database." How can resolve this issue?

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @totnguyen3308 per Bradley, "In the Fabric Workspace for the Mirror click on the three dots ... and click on Manage Permissions, then make sure than the Managed Identity for the Azure SQL Database is listed with Read, Write permissions. If it is not there you need a workspace admin to add it, but that will prevent Mirroring for working. You can also run, EXEC sp_help_change_feed against the mirrored database. There is a column named state. You want the state column to equal 4 otherwise, mirroring is not successfully set up."

    • @totnguyen3308
      @totnguyen3308 Місяць тому

      ​@@Tales-from-the-Field Could you provide a detailed video tutorial on the setup process? I am currently using the trial version and have an admin role in the workspace. I suspect the issue might be with the Azure SQL Database configuration, but I'm not exactly sure. Thank you for your support.

  • @OneNI83
    @OneNI83 Місяць тому

    Nice.What are the use cases of this ?

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @oneNI83 per Bradley, "I work with a lot of different customers and we've also received questions about this on other videos. The use case would be if you had a value you were retrieving in a notebook and you wanted to utilize it some where else. How would you do this? The answer: you use the exitValue to pass the value out of the notebook. I then passed this to another notebook and wrote it to a table. You could also use this as an expression for a file path, or to use in an if else condition, or to supply a value to a stored procedure that you want to execute a script task against. There are a lot of different use cases for needing to get this data out of a Notebook and then using it in a data pipeline. "

  • @piratesmvp
    @piratesmvp Місяць тому

    Thanks so much for doing this video! This will be my first time at Live 360 this fall. One question, what do most people typically wear to the conference? I've been to some where it was all business casual/professional and others like SpiceWorld or Ignite where people even wore shorts and t-shirts. Just don't want to be the odd one out when I go!

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Great question @piratesmvp! First make sure to say hi to the team while you are at the event, and we will make sure you get a laptop sticker! Second great question. Casual to Business. It is far and few between (normally just Buck Woody), but I've seen people in suits. Most people have blue jeans, khaki pants, t-shirts or polo shirts. Bradley has presented in blue jeans & t-shirts or khaki shorts and a t-shirt. Keep in mind, you are in walking distance to the theme parks. In November it can be sunny, it can be rainy. Temperatures can fluctuate. We've had the mornings as cool as 40 degrees Fahrenheit, and as hot as 80 degrees Fahrenheit. So make sure to bring shorts, pants, t-shirts, and a jacket, just to cover your bases. Also don't forget the swim suit, the pools at the hotels are really great!

  • @MrJmartinezorlando73
    @MrJmartinezorlando73 Місяць тому

    You guys ROCK

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Dear @MrJmartinezorlando73 , A conference was held. A discussion was had. A unanimous vote was taken. We have officially decreed the following: "No sir. It is you who ROCKS." Sincerely, Your friends at Tales from the Field

  • @vbhvprksh
    @vbhvprksh Місяць тому

    Where did you get that username and password from ??

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @vbhvprksh per Bradley, "Hi @vbhvprksh I've got two different places I use a login in the video, so I want to make sure I answer you correctly. The first is my domain account that was created in M365 that I use to log into the Power BI Data Gateway. That account is already aligned with a Microsoft Fabric tenant so when it authenticates it registers the Data Gateway with my tenant automatically. The second is a simple SQL Authentication account I created on my local system. I didn't show creating that account, but it is just a SQL Authentication account and has db_datareader and db_datawriter permissions. I hope this helps!"

  • @BurneyHu
    @BurneyHu Місяць тому

    To be precise, it only works on F64 and larger. The reason is to drive more revenue for the product if people want to use AI skill. To be fair, it make economic sense but not very friendly to SME though.

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @BurneyHu per Bradley, "@BurneyHu, totally get the vibe. We haven't don ourselves any favors. However,....... there's stuff I can't talk about..... not sure when, but when I can I will. My hope is you will one day..... one day... be pleasantly surprised. That's it, that's all I can say. For now...."

  • @KurtJ-r8w
    @KurtJ-r8w Місяць тому

    Please detail more how you added the API and parameterized it

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @KurtJ-r8w per Bradley, "Hi @KurtJ-r8w You have to sign up for an API Key at the www.census.gov/ website. They will email you an API Key you can use. Then I'm making a call using pyspark. I parameterize the API key but it's just by setting a variable saying APIKey='insert the api key from the email' this is what I'm covering from the 3 minute mark to the 4:17 minute mark. After that I'm using beautiful soup to load the irregularly formed JSON to parse the data as a list file and assign the data frame schema to it. I hope this helps! "

  • @peterdaniels3428
    @peterdaniels3428 Місяць тому

    Cool! Does this work with ADLS Gen2 configured as a shortcut in Fabric?

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @peterdaniels3428 per Bradley, "Hi Peter! Yes sir! This works for ADLS Gen 2 as well. Love this feature and I really look forward to the day we get it for OneLake!"

  • @adisbey-ef
    @adisbey-ef Місяць тому

    Very interessting, can you please provide tsql that you used in video ? I know it can be downloaded from Ola Hallengren but you did some changes to it and it would be much easier to get it from you. Thank you

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      DBABulldog here. TY for reaching out I’ve been a bit busy so I do apologize for the delay. I will work on gathering this up and follow-up with a GitHub location.

    • @adisbey-ef
      @adisbey-ef Місяць тому

      @@Tales-from-the-Field Looking forward to test this, thanks.

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      @adisbey-ef @dbabulldog here sorry for the delay. Work and life has been busy as of late. I have all the scripts in one place and I am working on documenting them so that they line up with the video. If you would like the raw versions of the scripts before they are complete, I can send you what I have so far. Email me at datay@microsoft.com

  • @shanthanpaladi231
    @shanthanpaladi231 Місяць тому

    How can Parameterize the database name in notebook from other notebook which use SparkSQL.

  • @phillipdataengineer
    @phillipdataengineer Місяць тому

    awesome vid, man! Thanks for the detailed information

  • @zacharythatcher7328
    @zacharythatcher7328 Місяць тому

    I also still don't have the AI skills option. I have a paid subscription but I don't currently have the F64 or higher. Can anyone confirm whether this is why?

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @zacharythatcher7328 per Bradley, “Hi Zachary, yes sir this requires an F64 and it must be enabled from the admin portal. I will make sure to call this out in a video soon.”

  • @brianszeto3418
    @brianszeto3418 2 місяці тому

    Great video! How were you able to get AI skills working in a Fabric trial capacity? I tried it myself and I'm able to setup an AI skill, but upon asking questions in the chat window I get a FT1 SKU Not Supported error

    • @Tales-from-the-Field
      @Tales-from-the-Field Місяць тому

      Hi @brianszeto per Bradley, “Hi Brian, this only works on a paid F64. I will make sure to update that in a future video. I’m on a paid F64 bit it is showing the subscription count down, not really sure why. “

  • @rcb3921
    @rcb3921 2 місяці тому

    Very helpful video! Thanks so much, this really clears up some of my questions.

  • @Chathumal2011
    @Chathumal2011 2 місяці тому

    You just saved my day. Copied 5GB data within 1 minute :)