ETL Process using SSIS [Real Time Practical Example] Step By Step

[@thegbfolks]

The way you explained the ETL process from the scratch is just amazing.

[@gurunathad13]

Thanks and happy learning

[@ashishchauhan4723]

Good starter example, looking forward to finding more examples where the script is used, multiple tables are being transformed using ETL with proper error handling .NET Application is executed using SSIS, etc. Thanks for the video, much appreciated.

[@gurunathad13]

Happy Learning !!!

[@nimikajadav3004]

This is very nice video. I am learning SSIS and in 1st watch, i have understood many things from this video. Thank you so much .

[@bhushankhamkar2831]

One of the best video on ETL SSIS

[@gaurie1030]

One of the best tutorials ever...you are the best...Request you to please upload more SSIS projects tutorial or any series..I will be happy to learn from it....Thank you sir once again!!!! :)

[@asmaalegat2744]

I totally agree!

[@arunkumarchamrthi8768]

i am fresh to SSIS, but understood very well... thank you guru

[@lakshmisravani6930]

U know real time work

[@naveedzaman3533]

please check date is missing for two client's otherwise good job👍

[@nabilnagi22]

thank you i have just understand the process of ETL from this valuable tutorial .. many thanks

[@gurunathad13]

Welcome and Happy Learning!!!!👍

[@seemadotiyal5341]

wow, very well explained 👍

[@kunalsharma9488]

Excellent video...

[@mitunbalar9989]

Nice Explanation from beginning to end. Appreciate your efforts. I was having one doubt why didn't we use OLE DB Destination instead of ADO NET Destination.? If we use the OLE DB Destination for this project will that work?

[@gurunathad13]

Thanks 🙏

[@gurunathad13]

yes definitely. You can choose anyone both will work fine OLE DB or ADO.NET

[@sarathraju2859]

Thanks for the clear explanation. But in Date column ee got 2 null values in SQL server which are exists in excel and those may not in date datatype

[@jayack1927]

Hi..Nice n proper understanding tutorial. If u upload Urs classes part wise it would be more helpfull. One by one all transformations, SCD, I can see Urs Vedios Randomly arranged.

[@gurunathad13]

Thank you for your valuable feedback.will arrange my videos properly... Happy Learning !!! 👍

[@jayack1927]

Thank you soo much... daily I am watching n practicing according to Urs Vedios. I'm bit confused where to Start after that Vedio which I have to watch 😊

[@srinivaschalla9158]

super ......i understand clearly now..lov u bro

[@bornofdata]

Really nice video, at least I understand what this is about now.

[@tadivamsi4759]

Very Helpful....Thank u very much keep posting like this

[@vidyasagar5212]

Excellent sir

[@vigcee4778]

You did a great job with your explanations. Keep up the good work. Thanks

[@ramnaidu8211]

Can you please clarify on why it's come null when run SQL server

[@ismailzaidi7967]

thank you so much :)

[@ProdipKDas-bg1il]

Nice clearification !

[@gurunathad13]

Thanks and Happy Learning

[@chetanakakade7494]

Nice Explanation. Thank you very much for your efforts! I have a Question: Suppose if there is data already present in the SQL Server table, can we append to this data using SSIS?

[@gurunathad13]

Yes 👍...

[@mandiralamichhanedahal5401]

well explained video , everything is clear , i am so glad to see your video so please sir could you please make SSAS videos by giving part1,part 2...... thank you very much

[@mamadouaw3129]

Great job sir thank you very much . I would like to know how to process if we have many flat files ( fact table and many dimensions) .

[@jayshrimendhapurkar2153]

nice and helpful video thnx for this do one video on Tablue also

[@allmedia656]

good explanation wel done thank you

[@grigoriyz]

It's very clear explanation! Thank you!

[@gurunathad13]

Thank you so much 👍

[@djgq1007]

Great explanation, this will definitely help me with my interview tomorrow. I have a question: if im transferring flat file to sql, where i will query the data, is it possible to query the data within visual studio and send the flat file to the department requesting it? thanks!

[@gurunathad13]

yes you can use execute sql task component, available in the control flow tool box

[@djgq1007]

@@gurunathad13 thank you, you're the best out there!!!

[@thawzinmyint8088]

@@gurunathad13 thank you for your tutorial . But Can I ask some queries to you ? I saw results, 2 values are being null in Visited Date column in SQL . Please let me know why ?

[@mosesalagba]

This is very explicit. Thank you.

[@hectormotsepe1581]

Thank you Very Much

[@gurunathad13]

You are welcome

[@_ProjectGuide]

Thank you so much sir.You have explained very clearly. thx a lot

[@masoodmd6727]

Excellent tutorial, i have one question how about if there is new data added to same excel sheet or new sheet or new excel file, appreciate if you could show that as well

[@Artem1s-_-]

Super Majestic!🥳🥳🥳🥳🥳

[@gurunathad13]

Thank you 😊

[@Artem1s-_-]

​​@@gurunathad13you have saved my job bro ty so much)

[@mustafakamal5945]

Really, very nicely explained..

[@kevinndungu4511]

Great content keep up the good work.

[@PAULA-bi6fy]

Hello!!, thank you for your material. I would like to request a video about how SSIS properties influece the performance of a SSIS package. I created a project using SSIS and when I change batch size and lobchunksize properties, the project works, if I don't change them the project doesn't run. I would appreciate your help!! Thank you!

[@rosaparks1]

Thanks for the video.Very helpful

[@bagkarnikhil]

Thanks a lot sir. Can u please help on how to load a file(xlsx) present on Microsoft One drive into Database as a table and to set automatic refresh so that the table get updated once the file on one drive path is updated.

[@puneettiwari2251]

Superb Sir,thanks

[@yibeyibe389]

very nice clarification!

[@thawzinmyint8088]

thank you for your tutorial . But Can I ask some queries to you ? I saw results, 2 values are being null in Visited Date column in SQL . Please let me know why ?

[@girijameena343]

Thank u so much sir....

[@badbandla]

good example

[@Faiiisall]

Thanks for the great tutorial. But there are a null values in the destination visited date.

[@abhishek8311]

That's because in the source, last couple of date are in string format and our destination is taking data in datetime format. If he would have used the log file to register error, it would have showed up there

[@giridharjadhav8980]

tnq soooooo much dogi

[@nibinjoseph3725]

Thank you!!!

[@pklifeTV]

Thank you

[@user-be5kk3mp1d]

visual studio 2022 error "The connection manager 'Excel' is not properly installed on this computer" I would be grateful for your help

[@madhumithan6653]

Hi sir,thanks for the nice video.While i am trying to install visual studio code,vsc 2022 version is installed .the 2022 version is totally different from previous versions.please help.

[@gurunathad13]

MSBI Doesn't work in VS 2022.. Kindly Choose 2019 version... SSDT For VS 2022 Not released yet

[@madhumithan6653]

@@gurunathad13 Thanks sir

[@bhushankhamkar2831]

Thank you sir

[@raonamu28]

Much helpful ✌🏻very detailed

[@gurunathad13]

Thank you... Happy Learning !!!👍🙏

[@charithashankara3338]

Hii sir, it couldn't retrieve the table information for connection manager ' Excel Connection Manager'. Failed to connect source using connection manager.

[@gurunathad13]

Hi, Kindly change package configuration mode to 32Bit .. For more info check this video : kzbin.info/www/bejne/b4C8kmSdfMaHiM0

[@vaseline236]

While configuring the Excel source file 30:42, the last two rows of the column "CustomerVisitedDate" can be seen as null(due to the wrong data type in the source file). How can we fix this issue before moving further or before loading the data in the "data flow" section, as the source file itself has incorrect data, doing the transformation step using the "derived column" can not fix it. How should we handle this kind of error?

[@dharamsinghindia]

Nice one...very easy to understand ...

[@gurunathad13]

Thanks

[@masheTyMasha]

Great video

[@RaviTeja-gj7ed]

It is really nice,but I have one doubt, can you please help with that

[@gurunathad13]

Yes please

[@venkataakhilmanduri8354]

Simple and super

[@gurunathad13]

Happy Learning

[@pradhyumsharma1710]

Please make power Bi dax videos

[@gurunathad13]

YES SURE...Thanks for your suggestions

[@mpscott1006]

You helped alot! thank you!

[@gurunathad13]

Glad it helped!

[@paulraj5554]

i am getting this error while reading from csv file to oledb : Error at Data Flow Task [OLE DB Destination [276]]: The column "NAME_ID" cannot be processed because more than one code page (65001 and 1252) are specified for it. Error at Data Flow Task [OLE DB Destination [276]]: The column "HIC_NUMBER" cannot be processed because more than one code page (65001 and 1252) are specified for it. Error at Data Flow Task [OLE DB Destination [276]]: The column "MEMBER_ID" cannot be processed because more than one code page (65001 and 1252) are specified for it.

[@gurunathad13]

I need to check this ...will let you know

[@dusseterakesh8711]

Well explained......

[@gurunathad13]

Thank you so much .. Happy Learning !!!

[@asmaalegat2744]

Nice tuto! You can make other tuto about SSAS & SSRS

[@gurunathad13]

Yes definitely will.make ..thanks for your feedback 👍

[@vidyasagar5212]

Sir can you run classes for power BI

[@gurunathad13]

Yes... 👍

[@abhijitshinde4275]

Hi but where involve or where is the actual ETL tester role. where we perform Test Cases and Test scenarios

[@gurunathad13]

Hi Tester can perform using SSIS Unit testing or SSIS Tester tools

[@janjames-xc3fw]

i am getting the following error when trying to connect excel connection manager. can you please help TITLE: Microsoft Visual Studio ------------------------------ There was an error displaying the preview. ------------------------------ ADDITIONAL INFORMATION: Too many fields defined. (Microsoft JET Database Engine) ------------------------------ BUTTONS: OK ------------------------------

[@nayansolanki4004]

pls make video for test case scenario

[@adeboladyrojaiye5109]

This is awesome .How can i reached you .

[@gurunathad13]

Let me know, your query will answer you...Thank you!!!

[@bibhusankarmohanty3118]

Hello sir.I have followed all your step and also I changed all the data type according to input column.But still I am facing an error at Data conversion step.Data flow stopped at Data conversion step.Please help

[@gurunathad13]

Hi, can you please share me the error description..will help you to fix it...just send me error description...Thanks👍

[@nilofarshaikh5669]

At the time of running the programme showing this error "Object reference not set to an instance of an object"

[@ruchiramote4298]

I am unable to see SSIS Toolbox in left corner.I tried checking in View>Other windows but cannot find. How to get SSIS toolbox?

[@gurunathad13]

Hello, you can get it from right top side lane where package execution,event handler tabs are there..just go top right side end ..you will checker small table icon.... click it you will get it SSIS toolbox

[@srivatsadeshpande9277]

Last 2 rows of the customer visited date col was null is the SSMS. Could you please explain why ?

[@gurunathad13]

Really...nope all data is filled properly..I think so ..

[@tahreemkhan29]

Hey I got this error while configuring the Excel Source -> 'TITLE: Microsoft Visual Studio ------------------------------ Could not retrieve the table information for the connection manager 'Excel Connection Manager 2'. Failed to connect to the source using the connection manager 'Excel Connection Manager 2' ------------------------------ BUTTONS: OK ------------------------------ ' Can you please help me sir?

[@gurunathad13]

Hi Kindly check this video For Excel Source : kzbin.info/www/bejne/b4C8kmSdfMaHiM0

[@tinachaulagai5177]

Hi Mr. Dogi!! Your video is really good, thank you. I followed step by step tutorial but at the end/at the run-time it showed error. I am new to ETL Process so don't know much. Kindly help me to resolve the error. The error created with so many lines so can't mention everything here. Again thank you for the nice video. Tina

[@gurunathad13]

Kindly tell me which part you got errors so that I can able to answer

[@tinachaulagai5177]

Thank you, When I press Start for the run then I got errors

[@gurunathad13]

@@tinachaulagai5177 Not getting exactly, not able to identify error.. need to check error screen shots ..kindly mail me please..Thanks

[@tinachaulagai5177]

@@gurunathad13 Thank you . Can you please give me your email, I'll send the screen shot.

[@jhansikantha2451]

I’m getting primary key violation error at destination, can u plz help me to resolve that error

[@gurunathad13]

Hi, Kindly remove the primary key from table ..there might be you are adding duplicate records

[@pavanbonasi4955]

I have an error though this lecture Could not retrieve the table information for the connection manager Excel connection manager

[@adityakumarsingh5317]

Can you please show us for multiple sources like excel,txt,xml in single package

[@gurunathad13]

Yes surely definitely 👍

[@gurunathad13]

Added a new video which extract data from multiple excel files

[@giridharjadhav8980]

hi dogi ,followed this video last step ado net destination during running the programme in visual studio getting error like follows the ui object returned an error code for getvalue , kindly help me here,tnq dogi

[@gurunathad13]

Yes sure will help you, Can you please send me complete error description...Thanks

[@giridharjadhav8980]

@@gurunathad13 sir,its showing as connection manager is not assigned to IDb connection

[@gurunathad13]

@@giridharjadhav8980 kindly check the server name and connection test using ole db or ado.net ... kindly go to connection manager and test it..it will surely will work fine...👍

[@giridharjadhav8980]

@@gurunathad13 sir ,tnq it worked

[@gurunathad13]

@@giridharjadhav8980 welcome .. Happy Learning!!!🙏

[@ajaykumarpalli987]

Hi sir, I'm trying to load data from DB2 table to SQL table and I'm getting data mismatch errors as the decimal in our DB2 table is stored as 100,25 instead of 100 .25 and also date format issue. How can I handle those

[@gurunathad13]

Try to use derived component and change data format ..using inbuilt functions

[@ajaykumarpalli987]

@@gurunathad13 thank you sir

[@syedamiralishah5630]

thanx alot bro....

[@danieltrapani77]

👍🏻

[@saranyav5950]

In this example, is the 'UpperCase & ConvertINRToUSD' a staging table?

[@gurunathad13]

It's a derived column.. custom calculation and using string function

[@pratikmuradi491]

Is this tools / software's free?

[@gurunathad13]

The developer edition is free to learn and explore...

[@deepakpahuja4477]

Can you please answer why ? Customer code in excel file was like - 1001, 1002..... But in the database table it got converted to - 1, 2, .... Can you please answer why ?

[@reidoniichan]

ithink its because he set the identity in the data base

[@gurunathad13]

Yes I have used identity with auto-increment ... If you want to achieve 1000, 1001...then set identity seed as 1000..Hope it helps

[@jadunandanbahinipati8422]

excel connection manager it can not load table or view

[@gurunathad13]

It should work... Kindly re establish connection and check

[@faustopf-.]

@@gurunathad13 I have the same issue sir

[@gurunathad13]

@@faustopf-. will check and update you...

[@gurunathad13]

@@faustopf-. Kindly run the project on 32 bit...to establish excel Connection

[@tahreemkhan29]

Hey I need some help. How can i contact you?

[@gurunathad13]

Kindly mail me on [e-mail]

[@tahreemkhan29]

@@gurunathad13 Hey i emailed you the error screenshot

[@gurunathad13]

@@tahreemkhan29 I replied

[@tahreemkhan29]

@@gurunathad13 I didn't recieve any reply sir

[@gurunathad13]

@@tahreemkhan29 check now please..due to slow internet connection not went

[@preritb.c.2105]

hello friendsthank you

[@ajaysingh0426]

Not sure if anybody noticed, but not all the dates rows are exported to SQL.

[@gurunathad13]

Which one not getting it..can you please help me so that I can fix it

[@nayansolanki4004]

Last two rows , also customer code has been changed

[@yassah8880]

Where is the real-time in this example!!! This video has no relation with the title. Thanks for wasting my time

[@bornofdata]

Real time here means he is taking you through a simple process of doing ETL by showing an example

[@lurdhurajnadar3305]

Thank you very much sir

[@gurunathad13]

Most welcome

[@saketsrivastava84]

Thank you sir

[@gurunathad13]

Welcome 🙏