Microsoft Fabric: Shortcut within Fabric and for Azure Data Lake| File vs Table Shortcut

In this video of Microsoft Fabric, you will how to use shortcuts for lakehouse, warehouse, and Azure Data lake Gen 2(ADLS). For what type of file you will get a table. Python code convert CSV to Delta parquet
Microsoft has Microsoft Fabric, the next-generation Analytic Platform. Check out how to enable it on Power BI Service. How to start a Fabric (Preview) trial
The Microsoft Fabric Platform provides customers with a SaaS-ified, open, lake-centric(One Lake), full-featured data, analytics, and AI platform that meets all their data estate needs. Power BI, Synapse Data Warehouse, Data Factory, Spark, and Notebook all under one platform
00:00 What is Shortcut
04:00 Create a new Lakehouse and Create Shortcuts
12:00 Short from ADLS Gen 2
20:00 Convert CSV file to Delta Parquet using python
24:00 Table Shortcut using ADLS Gen 2 Delta Parquet files
GIT File link - github.com/amitchandakpbi/pow...
All files: github.com/amitchandakpbi/
Power BI - Azure Free Tier, Create Azure Data Lake Gen 2 and connect that in Power BI: • Power BI: Connect with...
Get Azure SQL DB and Configure it on Power BI: • Abstract Thesis 93: Po...
Official Document: learn.microsoft.com/en-us/fab...
Video from GuyinaCube: • Microsoft Fabric Launc...
Buy a Microsoft Fabric subscription: learn.microsoft.com/en-us/fab...
SKU: learn.microsoft.com/en-us/fab...
Licenses: learn.microsoft.com/en-us/fab...
Enable Fabric: learn.microsoft.com/en-us/fab...
🔵 What is Microsoft Fabric
Microsoft Fabric is an all-in-one analytics solution for enterprises that covers everything from data movement to data science, Real-Time Analytics, and business intelligence. It offers a comprehensive suite of services, including data lake, data engineering, and data integration, all in one place.
With Fabric, you don't need to piece together different services from multiple vendors. Instead, you can enjoy a highly integrated, end-to-end, and easy-to-use product that is designed to simplify your analytics needs.
How to enable Fabric, find details - learn.microsoft.com/en-us/fab...
Microsoft Fabric licenses details -learn.microsoft.com/en-us/fab...
Don't forget to like, comment, and subscribe for more great content!
▶️Please Subscribe: / @amitchandak
▶️Data:
• Covid 19: covid19.who.int/WHO-COVID-19-...
• Get The data and Pbix files on Github: github.com/amitchandakpbi/pow...
• DropBox files: www.dropbox.com/sh/90ycq7hpmn...
---------
▶️Follow me on:
• Medium: / amitchandak
• Twitter: / amitchandak78
• LinkedIn: / amitchandak78
---------
▶️My Other Videos:
• Mastering Power BI: • Power BI for Beginners...
• Expertise Power BI: • Expertise Power BI- Ho...
~-~~-~~~-~~-~
Please watch: "Microsoft Power BI Tutorial For Beginners✨ | Power BI Full Course 2023 | Learn Power BI"
• Microsoft Power BI Tut...
~-~~-~~~-~~-~

[@Milhouse77BS]

Thanks, helped me figure out shortcuts to delta finally!

[@AmitChandak]

Glad it helped!🙏

[@christianharrington8145]

Amit this is tremendous the amount of information you are providing in those videos! 😍 I really appreciate that you always go behind the scenes, a step further for the official docs. I was looking how to connect to my ADLSG2 tables with shortcuts. You explained everything! 😄 I have a question, do you think the shortcut from Fabric to ADSLG2 will be able to add also "Delta" type file to view as a Table in the Lakehouse? Your example is with Parquet, but we have a scenario where we extract data from On premise data and need to store it in Delta type in ADLSG2, since it gets updated frequently and thre is a need for time travelling. I don't know if Fabric suppors that, not so clear to me...I'll try it, but wanted your advice as well. Many thanks! 👍

[@christianharrington8145]

I realized my question makes no sense, and I already have my answer. Your example was already "Delta" file. I assumed it was Parquet cause it was a bit confusing to me, but it's more clear now. Delta is extra function on top of Parquet for historical purpose. Important to note however, based on my testing, I am not able to create a shortcut directly on a Parquet file to be recognize as a table. It can link to the file itself, but it will not show under Tables in he Lakehouse.

[@AmitChandak]

If you saved the file a delta parquet, then only it will shown as table, when you create shortcut from the top menu or table section.

[@RKTECH1021]

@@AmitChandak I already have delta parquet files in ADLSGEN2, when I connect these Parquet folders(files). they show up under Files but not under Tables, Do you know why. If your example of sales_delta.csv then it works. Basically I don't want to create or conver parquet since I already have files in my azure cotainer (gen2

[@samnaidoo1990]

I created a shortcut under files, it points to a Gen2 data lake. Every day new csv files get uploaded and I need to query the data.I use the "Load to table" option from files, but how do we automate this process? When new files arrive in the lake I'm able to see them under files if I refresh, but how we get this them into the lakehouse tables without any manual intervention?

[@AmitChandak]

You can create a pipeline or Spark notebook code. While reading file from pipeline use folder and file format so that you can read more than one file. Or configure dataflow Gen2 to read latest file medium.com/@wkrzywiec/getting-data-from-the-latest-file-in-a-folder-using-power-query-51dfa4bff711

[@SaiShankar-i4s]

Is it possible to save the delta parquet file if we choose S3 as a shortcut instead of ADLS gen2. I tried with S3 as a shortcut it's not working.Can you please help

[@AmitChandak]

Have you tried table shortcut on delta parquet folder ?

[@SaiShankar-i4s]

@@AmitChandak delta parquet file is not creating in S3 bucket

[@SaiShankar-i4s]

I have CSV files in S3 bucket created shortcut in files section. Created parquet folder similar like you did in the video, after this df.write.format("delta").save("Files/pocbucket/parquet") it is throwing error like this function is not supported through shortcuts.

[@preetipics]

Thanks alot. When using ADLS shortcuts and creating a PBI dataset, are you able to utilise the new direct lake technology or the does the data need to be natively in fabric for that to work?

[@AmitChandak]

If the data in ADLS Gen is in delta parquet format, there is no need to copy, we can use that as a table directly in fabric

[@preetipics]

@@AmitChandak amazing thanks

[@user-tk2zq2zy4w]

Hi Amit, if we create shortcut in Fabric Files folder over ADLS Gen2 delta files, will it create Fabric Table automatically?

[@AmitChandak]

Fabric treat delta parquet files as table. So when we have file in ADLS Gen2 as delta parquet, fabric can work on that as Fabric table.

[@christianharrington8145]

I wonder why sometimes the shortcuts does not recognize parquet files as tables...I put the path to the folder containing the parquet files which is delta parquet, but the shortcut falls under "undefined" folder so it sees it only as files not table. Have you encounterd this behavior?

[@AmitChandak]

I encountered this when I was trying to copy delta parquet from local to Lakehouse. But did not face that as a shortcut. Usually means something is missing.

[@user-gw6mb1ci1k]

please start Microsoft Fabric in hindi

[@AmitChandak]

Please check out three videos in Hindi series Introduction to Microsoft Fabric in Hindi | What it is, Why Use, Who Should, When and How to use kzbin.info/www/bejne/bJLHpoKKpK6qqsk Microsoft Fabric in Hindi Part 2: Create Workspace, Lakehouse, Warehouse: kzbin.info/www/bejne/jJ-mnIN9lJlqrqc Microsoft Fabric in Hindi part 3: How to load data in Lakehouse using Data Pipeline | End to End Scenario- kzbin.info/www/bejne/n3u1g4mhq9qYo8U