Can we used for 200GB database how much time it will take ? If there we faced any timeout issue ? Please share your input.

Hi how can we pass the specific environment to a notebook dynamically in fabric

Thanks, pls share the notebook code

Thank, is it possible to share the notebook?

Would be real cool if you can show the steps to us a backpac backup file to restore in sqlserver . I think you have to use the az cli for that to work . Store the bac file in the lake house and show us how to retrieve it

Would it be possible to have zero downtime during the migration?

What would be your suggestion how to migrate from Azure SQL Database to another?

Nice video.... You should have also included connecting to kernel and executing cells etc. Great help though. thanks for sharing :)

i keep getting ""Forbidden", 403" error on the write operation. i am using a working, active secret with the correct secret. do i need to set specific API permissions to write to fabric lakehouse?

Hey Bradley, if you have a min, could you help me out? I'm getting the error: Error: ErrorCode=UserErrorInvalidPluginType,'Type=Microsoft.DataTransfer.Common.Shared.PluginNotRegisteredException,Message=Invalid type 'FabricSqlDatabase' is provided in 'linkedServices'. Please correct the type in payload and retry.,Source=Microsoft.DataTransfer.ClientLibrary,' It seems like my connection to my Fabric SQL Database has the wrong type, however, I can't edit it. @SQLBalls, do you know what the right value should be?

Thank You! Right to the point. Appreciate your video.

Great video, thank you. I deployed #FabSQL in a client environment yesterday. They were going to use a Warehouse originally but now they have the option of SQL DB inside fabric, they are going with that instead 😊

Can we look at how to subset and anonymize/sanitize data during the import process from On-prem SQL Server to FabSQL. This helps in certain compliance cases when real PII needs to be protected (or not replicated as is).

Be nice if the fabric pipeline had CDC built into on prem sql -> "fabsql".. ADF does this (in preview?) but won't work with an IR. This would be very useful instead of having to roll your own CDC handling methodology across the gateway..

Great video, Thank you!

It is very useful. Is it possible to pass dynamic parameters from Copy Data activity to Note Book Activity in the Data Pipeline

Great session, thanks! Love the #FabSQL name, going to try and drop it into a client call tomorrow 😂

Is it possible to upload pdf documentation with for Ai skills to be aware of?

Thank you, it worked like a charm!!!

Thank you for sharing and Demo! Database watcher is cool and seems easier to implement than SQL Insights.

Thank you for your video. By any chance do you know how to do it with a SQL Server instance created inside a VM. I tried to create a Managed Identity attached to the VM using the Storage Blob Data Contributor role for the Azure Blob Container but this didn't worked. Thanks.

How to use this parameter when we want to use delete statement instead of insert?

Amen Josh on no pineapple on pizza

I've seen issues with dropping databases on an MI if there are other backups running in the background. The MI has to take a tail-log backup (in case you want to restore the dropped database) and this has to wait until the other backup has completed, which can take a while for large databases. The database drop appears to hang and you can't restore another backup with the same name until it has completed. The workaround I use is to rename the database before you drop it, then restore the point-in-time backup with the original name. You don't need to wait for the drop to complete, but you do need to make sure you have enough storage space for 2 copies of the database (until the original drop completes).

Azure database watcher connected to sql managed instance does not show any sql managed instance in dashboard am follow ur steps but did not found any luck yet can u help me plz?

hi , how can i update the parameter using sparksql in the notebook with (for example) a select statement e.g. the number if rows added to a table

THIS IS REALLY BIG!!! I HAD BEEN WONDERING ABOUT THAT. Great and simple video instructions! Very POWERFUL !!!!

Thank you for the wonderful series of videos. I have a few questions. 1. How to automate the creation of containers in the storage account when considering large numbers of databases to migrate (100+ databases). It's possible that there's a script that can create a container simultaneously. 2. How to create credentials in an on-premise SQL server instance for database backups in newly created containers for all databases at once. 3. Modify the OLA Hallengren script to backup SQL databases in their respective containers.

Nice. Do I have to setup a private endpoint in azure? I am using a public endpoint

Thanks for the article and video :) It solves the problem of including a 10min sleep in the pipeline. And "According to the documentation, automatic synchronization between the Lakehouse and SQL endpoint in Microsoft Fabric can take a few seconds. " Wow!!! For me, It takes atleast 3-5 minutes everytime

Exactly what I was trying to do. Thank you.

Hey at 3:24 while creating the connection for the trigger the window loading never seems to end, what should I do (I left it for 6 hours yesterday)

Hi , guys my name is Dary im from dominican republic im 19 years old i study Data sciences and this topic in my country or spanish content doesnt touch theses subjects. Good Job dont give up new fallower. I hope that you continue to speak clearly. Many creators of the youtube content doent realized that they can emprove their views and followers only speaking clearly. I havent a good English but i hope that my message arrived you

Excellent ! Thank you to surface this blog post in this video with this clever way to use AI Skills in Notebook

my scenario : on-prem gateway needed to extract the data. first step is a complex notebook to populate variables. Then in a copy job, i use these variable to make sure only the needed data is extracted. Do you have a better option to achieve this?

its not possible to parse the two variables only using one 'set variable' .. i need like 5 variables, and it can become a bit messy

awesome video .. Thanks alot!

Really good content! I have a question. I encountered the scenario (at least 6+ months ago) where I tried using Fabric features in a region that did not support Fabric. I then tried creating the capacity in a region that supports Fabric, but because the capacity wasn't in the same region as the Power BI tenant (which you show in this video), the capacity wouldn't work. Microsoft support told me that the Fabric capacity has to be in the same region as the Power BI Tenant. So here's my question: Is it still a requirement that Fabric capacity must be provisioned in the same region as the Power BI tenant? If so, and you are in a region that doesn't support something like Mirroring, does that mean you'd have to move both the capacity and the tenant to a different region?

I'm confused. So in Power BI gateway, there is already Azure Data Lake Storage Gen2 connection created. This kind of gateway was not mentioned in other similar tutorials online. Is it really necessary? How to create this connection? This gateway was not mentioned before, it just suddenly appeared in the video.

Another great job on this video.

Why would you go for Azure Data Factory for such task? What is the benefit of using ADF here rather than Azure Automation? Not only that pricing wise ADF can be more expensive and an overkill

This looks like a great option! Question: i only see my VM name for my sql server in the managed identity select list. Would that work or does it have to be listed as sql managed instance?

Hi! great video. I am actually trying to something that is very similar to this. I need the communication line to be not connected to public internet, and the data flow is only legal from on prem sql to fabric as a push mechanism using ADF. In your solution, do I have to do anything to make the line completely secure? The data is highly sensitive that is why I need to do it this way. By the way, are you using Synapse or ADF in your example?

Can we use managed identity instead of SAS?

Hey, What if I want to execute the fabric pipeline only if there is data blob created on a specific container and folder. I dont wanrt to trigger it for all the blob uploads ??

Thank you for the above Sir, very informative and helps. I kinda have the same scenario with encrypted SPs, would you know how anything about how to do this.

*Customer wants a test run of upgrading an application, and needs a PITR snapshot in SMI in case of need to rolback* Googles how to.... finds this video, PHEW! Thankyou for dropping this, very handy!

I am using it now... and it works. Reminder ... set a batch limit on the downstream foreach activity that is consuming the .json output.

The SID comes as an encrypted value. Anyone had the same issue?

Nice video . I want to know if this service is free or do we have to pay for using this service? I mean does it billed in my monthly billing?