quick quesiton, in case I decide to use external table, ill be able to see the table created in the SQL analytics endpoint? or just when the table is managed?
@dheeruacademic25 күн бұрын
I have followed your steps, pipeline is successful but no data is getting loaded. I have additional columns configured in source of copy activity. Only those columns are loaded, all other columns which are coming from source are not getting loaded.
@zohadaditto130727 күн бұрын
sir,cant this project be done in free version of microsoft fabric?
@DataVerse_Academy26 күн бұрын
It is only done in free version.
@poonammalpani561Ай бұрын
Next button is disable
@murthyherofashionАй бұрын
🎉amazing
@pragatisharma60362 ай бұрын
if my file get new data it will also work for the updated data or should i need to creat Agin the data flow
@DataVerse_Academy2 ай бұрын
You can implement the incremental load inside the dataflow gen2 as well.
@GiancarloBlaze2 ай бұрын
Very informative! thank you
@kiranj87692 ай бұрын
Excellent, great video..🎉
@nickfaleev92332 ай бұрын
I just finished watching this video on using PySpark in Microsoft Fabric, and it was incredibly helpful! The explanations were clear, and the step-by-step walkthrough made complex concepts easy to understand. This is definitely a must-watch for anyone looking to get started with PySpark in Microsoft Fabric. Great job, and thank you for sharing this valuable content! I highly recommend subscribing to this channel. The content is consistently high-quality, with tutorials that are not only informative but also easy to follow. Whether you're a beginner or an experienced professional, this channel offers valuable insights and tips that can help you stay ahead in the data world. Don't miss out on the great content they’re putting out!
@DataVerse_Academy2 ай бұрын
Thank you! 🙏
@gopalammanikantarao5932 ай бұрын
Nice Video, It's helped me to understand M.Fabric flow.
@DataVerse_Academy2 ай бұрын
Thank you! 😊
@Otto_at_work2 ай бұрын
Very useful. Thank you.
@surerakase50172 ай бұрын
Can we pass parameters in dataflow gen2
@DataVerse_Academy2 ай бұрын
No, it’s not supported yet.
@meashhh11343 ай бұрын
Very very good explanation Thank you
@balajikrishnamoorthy73523 ай бұрын
will this work if we delete or update a data in the source table ?
@DataVerse_Academy3 ай бұрын
It will work in case of update , not in delete. As it’s incremental approach not CDC.
@conexaomotorizada3 ай бұрын
Hi, how can i edit a table from a semantic model in power bi's power query ?
@namangarg70233 ай бұрын
Can u pls explain how u get connection oath for source over here like we did in ADF
@moeeljawad53613 ай бұрын
Thanks for your video, very intuitive and impressive. I have a question, if your Table_List table is saved as a delta table from a python script, and i would like to have the Max_value updated.... I believe i will not be able to keep the stored procedure, right? if not should i be replacing it with a notebook activity? Thanks
@DataVerse_Academy3 ай бұрын
Yes you are right you will not be able to use stored procedure to update a delta table. You need to create a notebook for that.
@Giraffe-j3h3 ай бұрын
how to create new columns and dim date table in this model
@vinaypratapsingh58153 ай бұрын
When i am clicking on New Semantic Model , I am not able to see all those tables to select a table or all tables . Because of that i am not able to create Semantic Model. Could you please help me here ? Thanks
@DataVerse_Academy3 ай бұрын
Whats the error you are getting ?
@vinaypratapsingh58153 ай бұрын
@@DataVerse_Academy Thanks for your response. I am not getting any error, but I am not able to select any table to create my semantic model . Under Select all , it's not giving me tables name to select the table name
@DataVerse_Academy3 ай бұрын
Please try below once Settings- admin portal- > tenant settings - > information protection -> allow users to apply sensitivity labels for content - enable this, Then you will be able to create semantic model through lakehouse
@julies5085Ай бұрын
@@vinaypratapsingh5815 Hi, I am facing the same issue, only 3 tables shown for selection , others not shown to be used for semantic model creation. Were you able to solve this problem?
@priyanthakarunathilake80303 ай бұрын
Really helpful. Thanks.
@ceciliaayala39233 ай бұрын
Great explanation, thank you!
@sridharnallagatla74423 ай бұрын
For microsoft fabric how the market there is any calls
@DataVerse_Academy3 ай бұрын
Not now, but you will a lot of movement towards fabric in upcoming 1-2 year.
@tv.TheDogFather3 ай бұрын
Thanks for the video... Gold_Product is still not included in the Code zip file. Can you please include it? Not as Important, but at the same time, can you include the Run_Load notebook?
@BrundaAS-e8r3 ай бұрын
Not able to access the azure blob storage link you have shared
@pragatisharma60363 ай бұрын
product script is missing in data code file please upload it
@andreaskoblischke81863 ай бұрын
Nice one. Usefulefor me. Thx
@lucasamorim58234 ай бұрын
Thank you, help me a lot with this short video.
@seetha1103784 ай бұрын
how to read data from a REST API that has authentication tokens (Refresh tokens) into a Fabric lakehouse?
@priyankaparida84234 ай бұрын
Hello Sir, After line no. 23 it is directly showing line no.77 .the middle part is skipped so not getting the code in between that. can you help with it.
@dhheanom10d4 ай бұрын
Thank u so much!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
@ADhuidv4 ай бұрын
Hello sir, Thank you so much providing these productive videos. Today, I faced a challenge, and the solution I couldn't find elsewhere. That is How to Extract data from SAP Hana Cloud to Microsoft Fabric (cloud to cloud connectivity). Could you please help me here?
@heyrobined5 ай бұрын
So I did the same with on prem sql server to the warehouse , and checked every connections are preview working but when I am validating the activity I got this error "Copying data from on-premises connection with staging storage in workspace is not supported. Please use external staging storage instead." what could be the solution?
@vamshisamineniz59055 ай бұрын
Is there a way to connect to ADLS directly without creating Shortcut in Lakehouse
@DataVerse_Academy5 ай бұрын
Yes you can use the service principal method.
@ADhuidv5 ай бұрын
Sir, How can we build the JDBC/Pyodbc connection between Fabric Data warehouse and Fabric Notebook. I have been finding it since a long time, but un-successful
@DataVerse_Academy5 ай бұрын
But why do you need it, what is the use case which you are trying to implement?
@ADhuidv5 ай бұрын
1.Initially, we are getting data from multiple sources and sinking them in one warehouse (Raw Data). 2. Now we want to extract data from this warehouse (Raw Data) to another warehouse (Transformed Data) through a Notebook wherein we will be performing our transformation logic. Hence, I want to build the connection between warehouse and Notebook only using JDBC or Pyodbc
@Shreekanthsharma-t6x5 ай бұрын
Hi , I have some complex "Scalar user defined functions" defined in MYSQL and I have to migrate them to fabric, but as of now fabric doesn't support creation of "Scalar user defined functions" in warehouse. In this scenario please let me know alternative options I can use. Thanks
@DataVerse_Academy5 ай бұрын
you can build that logic inside the procedure. I know you will not able to return a value using a function, but you can build whatever the logic which you are trying to build. If you can give me context, then i will provide you the code as well
@ADhuidv5 ай бұрын
Sir, Can we extract the data directly from warehouse to the notebook, then transform it, and then finally save it to the same warehouse??
@DataVerse_Academy5 ай бұрын
You can transform the data inside a notebook from warehouse, but you can’t write the data into the warehouse.
@Shreekanthsharma-t6x5 ай бұрын
Hi Good Morning!, I have to convert the existing SQL server stored procedure into fabric environment, In my stored procedures there are CURSOR commands but fabric doesn't support CURSOR commands, in this case how do I proceed, is there any alternative.
@DataVerse_Academy5 ай бұрын
You can use the while loop for that.
@Bharathkumar-l3n5 ай бұрын
Hi sir, can we use metadata activity instead of look up activity, in order to perform same operation and get same result? Is metadata activity can do the same work as look up activity do?
@DataVerse_Academy5 ай бұрын
No, you will not be able to write query inside the meta data activity.
@EduInquisitive5 ай бұрын
thanks for the great explanation but here i didnt get one thing and that is where the metadata for managed table is getting created. I cant see any files created in Files folder while for external we can see them in the path provided.
@DataVerse_Academy5 ай бұрын
for managed tables, metadata and data is inside the tables folder itselft
@Shreekanthsharma-t6x5 ай бұрын
this is great video. thanks
@Shreekanthsharma-t6x5 ай бұрын
I have a SQL server stored procedure which updates, deletes and merges data into a table , how do I convert the stored procedure to pyspark job, is it possible to update a table in fabric using pyspark?, please make a video on this topic
@DataVerse_Academy5 ай бұрын
It’s very easy to do the same thing in pyspark, we can do all the stuff which you mentioned. I am a on break for couple of months. I am going to start creating video very soon.
@Shreekanthsharma-t6x5 ай бұрын
@@DataVerse_Academy please do create a video when you are back from break. Thanks
@AnisurRahman-wm2ys5 ай бұрын
Excellent !!!!! Do you have this type of video for SCD2 ?
@tv.TheDogFather3 ай бұрын
I think for the DIM Merges just wrap the merge inside an Insert Into and change the Update of the Merge Accordingly.
@yveshermann6 ай бұрын
this guy is a champion!! Thanks so much :):)
@IEYdel6 ай бұрын
Super helpful! Do you have a video that shows the silver layer with an example of joining related data from heterogenous data sources with data cleansing and deduplication? :D Still you are my hero Vishnu! Thank you for this video!
@gagansingh34816 ай бұрын
Sir could you please make a video on Azure log analytics for Semantic Model and azure mirroring in fabric
@DataVerse_Academy6 ай бұрын
Definitely 💯
@rajudasari84826 ай бұрын
which table is speed in retrieving the data
@sanishthomas28586 ай бұрын
Nice. quick question, the Presentation slide shown for Architecture is Power Point or any other software?
@DataVerse_Academy6 ай бұрын
It’s power point.
@ROHITKUMARGUJAR-k8t6 ай бұрын
Very good explanation.
@DataVerse_Academy6 ай бұрын
Thank you 🙏
@John.Wick.2216 ай бұрын
Where can I get more such data source
@samuel_t_chou6 ай бұрын
Thank you, random Indian KZbinr. Very clear and useful.