Microsoft Fabric: Import Azure SQL Data to Warehouse | Multiple tables using Pipeline

In this video, I have discussed how to get tables from Azure SQL to Microsoft Fabric Warehouse using a data pipeline, more than one table at a time.
Microsoft has Microsoft Fabric, the next-generation Analytic Platform. Check out how to enable it on Power BI Service. How to start a Fabric (Preview) trial
The Microsoft Fabric Platform provides customers with a SaaS-ified, open, lake-centric(One Lake), full-featured data, analytics, and AI platform that meets all their data estate needs. Power BI, Synapse Data Warehouse, Data Factory, Spark, and Notebook all under one platform
00:00 Problem Statement
01:30 Create Pipeline
04:00 Data mapping in Pipeline
09:30 Test Data and Create Power Bi Report
GIT File link - github.com/amitchandakpbi/pow...
All files: github.com/amitchandakpbi/
Power BI - Azure Free Tier, Create Azure Data Lake Gen 2 and connect that in Power BI: • Power BI: Connect with...
Get Azure SQL DB and Configure it on Power BI: • Abstract Thesis 93: Po...
Official Document: learn.microsoft.com/en-us/fab...
Video from GuyinaCube: • Microsoft Fabric Launc...
Buy a Microsoft Fabric subscription: learn.microsoft.com/en-us/fab...
SKU: learn.microsoft.com/en-us/fab...
Licenses: learn.microsoft.com/en-us/fab...
Enable Fabric: learn.microsoft.com/en-us/fab...
🔵 What is Microsoft Fabric
Microsoft Fabric is an all-in-one analytics solution for enterprises that covers everything from data movement to data science, Real-Time Analytics, and business intelligence. It offers a comprehensive suite of services, including data lake, data engineering, and data integration, all in one place.
With Fabric, you don't need to piece together different services from multiple vendors. Instead, you can enjoy a highly integrated, end-to-end, and easy-to-use product that is designed to simplify your analytics needs.
How to enable Fabric, find details - learn.microsoft.com/en-us/fab...
Microsoft Fabric licenses details -learn.microsoft.com/en-us/fab...
Don't forget to like, comment, and subscribe for more great content!
▶️Please Subscribe: / @amitchandak
▶️Data:
• Covid 19: covid19.who.int/WHO-COVID-19-...
• Get The data and Pbix files on Github: github.com/amitchandakpbi/pow...
• DropBox files: www.dropbox.com/sh/90ycq7hpmn...
---------
▶️Follow me on:
• Medium: / amitchandak
• Twitter: / amitchandak78
• LinkedIn: / amitchandak78
---------
▶️My Other Videos:
• Mastering Power BI: • Power BI for Beginners...
• Expertise Power BI: • Expertise Power BI- Ho...
~-~~-~~~-~~-~
Please watch: "Microsoft Power BI Tutorial For Beginners✨ | Power BI Full Course 2023 | Learn Power BI"
• Microsoft Power BI Tut...
~-~~-~~~-~~-~

[@adilmajeed8439]

The best part of fabric, once the data ingested in the sql end point layer, it is available as a dataset which can be used within PBI, thanks for your awesome videos - please keep continue sharing your knowledge base

[@AmitChandak]

Thank you so much for your kind words! I'm thrilled to hear that you find the fabric feature valuable. I appreciate your support and encouragement, and I'll definitely continue sharing my knowledge. Stay tuned for more awesome videos! 🙏

[@NaaneVinu]

is it possible to stream continuously in the data from sql server as the new records are added to source database?

[@kalpanap5687]

Great Explanation sir but how to give the parameters for database level and server level. Please explain in detail sir. Thank You

[@AmitChandak]

Please check if this code can help from sqlalchemy import create_engine # Define the database and server parameters database_name = 'your_database_name' server_name = 'your_server_name' username = 'your_username' password = 'your_password' port = 'your_port_number' # Create a dictionary of additional parameters # For example, setting the connection timeout and encoding additional_params = { 'connect_timeout': 10, 'encoding': 'utf-8' } # Create the connection URL using the parameters and additional parameters url = f'mssql+pyodbc://{username}:{password}@{server_name}:{port}/{database_name}?driver=ODBC+Driver+17+for+SQL+Server' # Create the engine using the connection URL and additional parameters engine = create_engine(url, connect_args=additional_params) # Use the engine to perform database operations # For example, execute a query result = engine.execute('SELECT * FROM your_table') for row in result: print(row) # Remember to properly handle exceptions and close the connection when you're done engine.dispose()

[@saumyakapoor6772]

This is an off topic here, but how does data governance look like in Fabric?

[@AmitChandak]

Please refer, if these can help learn.microsoft.com/en-us/fabric/governance/governance-compliance-overview learn.microsoft.com/en-us/fabric/security/security-overview