How To Connect To On-Premises Data In Microsoft Fabric

[@Kinnoshachi]

How do you keep it flowing and up to date?

[@udendors]

Very helpfull and direct with no fuss.

[@PragmaticWorks]

Happy to hear the video was helpful, thank you for the comment!

[@jaggyjut]

can we use the MS Fabric data pipeline/ azure factory functionality to ingest data from ServiceNow to an on-prem MS SQL Server

[@valentinloghin4004]

Very nice many thanks !! It will be possible to copy files from a folder located on premise too ?

[@austinlibal]

That is correct. You can connect with an on-premises file system using a gateway.

[@lerbous4633]

can we use the copy data in Synapse Data Engineering method connect to on Prem SQL Server too? Cause i try with that method test connection unsuccessfull

[@austinlibal]

Currently the ability to work with the On-Premises Data Gateway in Fabric is restricted to only utilizing Dataflows Gen2. Support for this with the copy data activity in the Data Factory pipeline experience is on the roadmap and will be coming at some point in 2024. You do have the ability to use a traditional Azure Data Factory or Azure Synapse Analytics pipeline to connect to your on-premises network with a Self-Hosted Integration Runtime and set the Sink property to the Fabric Lakehouse. This is a valid workaround for now!

[@majeedadil777]

Thanks for sharing. How to load data using data factory instead of Data Flow G2?

[@austinlibal]

Data Factory pipelines currently don’t support connection with the data gateway in Fabric. Instead you could load on-premises data via the traditional data factory experience in Azure with a Self Hosted IR to the Fabric Lakehouse or Warehouse.

[@lagendijkict]

@@austinlibal I am glad it doesn't support worrying :D

[@austinlibal]

@@lagendijkict 🤣 I fixed it. Thanks!

[@moneshbhagavathula4913]

In Oracle, i have a table which has almost 25 million records. I am trying to move this data to Datalake. I have tried multiple approaches including this approach. Due to huge volume of data, the workflow fails frequently. Upon multiple tries, using ADF, i have moved the data by removing aggregations and saved it in lakehouse. This took 17 hours. Any way to do this more efficiently ?

[@vishwassee]

Is there a way to connect to on-prem SQL server using Fabric Notebook?

[@austinlibal]

Sure Notebooks are all code so you just have to create the connection and get all the details in your language of choice.

[@ernestoandrerodriguez6496]

Please, I am trying to learn Fabric and I have a problem. When I connect to SSMS using Windows autentication there is no password that I need to write, it connects "automatically". How can I obtain that password for using it in Fabric?

[@AbiolaSingHymns]

This is completely incomplete and not useful video as you did not cover the important part of how you downloaded the Data Gateway and set up up. How do you think an average users will understand how to successfully connect to on premises data?

[@satellitepop]

The most important information was missing, how to configure the Gateway and how to schedule refreshes. Sorry, this video is not worth it, a waste of time.

[@amal7411jo]

useless video he just ingorned the main part how to setup the gate way in local machine