SSIS Tutorial Part 04-How to Load Multiple Comma Delimited Files to SQL Server Table in SSIS Package

[@zbroderick]

Thanks for the tutorial. Helped me understand SSIS as I'm at a very beginner level currently. A lifesaver for a massive data import that I currently have to complete.

[@nirmalkumar3282]

Got a new job because of your tutorials...The SSIS interview questions are really mind blowing 3/5 question matched entirely... Gave the scenario as you explained..they were cherished.....thanks a lot Sir Thanks for reshaping the life.... Your way of teaching is awesome...........

[@TechBrothersIT]

+Nirmal Kumar I am very happy to hear that you got the job! all the best on new assignment. Work hard and I am sure you will do great. Thanks for kind words and glad to hear material provided was helpful.

[@nirmalkumar3282]

Thanks a lot Sir....

[@shilparamz]

Congratulations

[@krismaly]

I enjoyed watching this video and recommend others. Narrator knows the poic and explains well. This important in handling multiple similar data structure files. Creating Variables is interesting. Thanks a lot for educating the community.

[@BranislavOsif]

A very good video. Better than the official course I was going through. The omitted the explanation how variables work and does the looping through file names work. Quite a crucial thing to understand...

[@TechBrothersIT]

Glad it was helpful!

[@BranislavOsif]

@@TechBrothersIT One question though. I wantednto save that file path andnfile name to a DB table. I used a derived column node which has a problem with the FileName variable for some reason. Any thoughts?

[@aamirshahzad1848]

@@BranislavOsif I have many examples on this, here is one video that you can watch to get the idea. kzbin.info/www/bejne/nGmtnmuEotJseNU

[@girijajoshi1159]

Thank you so much Amir. These videos helps me a lot.

[@RC-nn1ld]

Best explanation on KZbin, thanks

[@TechBrothersIT]

You are welcome.Glad to hear that you liked my effort.

[@sonduong2457]

Thank you for your kindness

[@krismaly6300]

I enjoyed watching this video and recommend others Thanks for educating the community and appreciate your volunteer-ship. Thanks a bunch

[@time_capsul.e]

Awesome tutorial.....I was searching for a this since morning

[@TechBrothersIT]

Glad you found it and it was helpful.

[@hamedhelisaz5226]

You are a life saver! Thanks a lot.

[@TechBrothersIT]

Glad it helped!

[@devil..1036]

I am going to watch your all SSIS and SSRS video tutorials for getting job as a BI developer. I hope it will work for my goal. Appreciate for your Hardwork... Thanks a lot🙏💕🙏💕🙏💕

[@shahinashaik7394]

Hope you'd have got the job

[@kingingway3308]

Nice one from the TechBrothersIT. I enjoyed it!!

[@waverider80]

Excellent tutorial... huge help!

[@nileshkamble3673]

Thanks a lot Amir, It was a great help!

[@angelcolon3567]

If my files are in the main path but in that path have different daily folder name ie. 20160401, 20160402, 20160403 and so on.... How to find each file?

[@krismaly6300]

Revisiting. Question I know without initializing it works as you said but can we initialize the FileName variable?

[@andreigiubleanu]

Thank you. Awesome tutorials.

[@mkmk1356]

Nice video.. Thanks

[@subhradeepghosh7209]

Dear Sir, if I have to load(let's say) only 4 field data from a flat file (which is having 10 fields) into a database table using SSIS, how will I do that? You can also suggest me any video of you have made. Thanking You.

[@romeror1945]

Thank you for this. I very much appreciate it. How do we go about when Loading multiple XML files too?

[@krismaly6300]

Revisiting I enjoyed watching this video and recommend others Thanks for educating the community and appreciate your volunteership. I have created the example exactly and it worked fine. But I have a Question: Say I have 5 files File1 File3 File2 File5 File4 When the package runs in which order it takes does it take above order itself or File 1, 2 ,3,4,5 or Bottom to top like File4 File5 'File2 File3 File1 Could you respond? Thanks for educating the community

[@jyotigautam7018]

Hi Amir, Thanks for the video , It is very useful. I have one doubt , You have extracted the data from 2 or 3 flat files into the table ,but there are some redundant/similar records also , What should we do get only distinct records from flat files . Thanks.

[@TechBrothersIT]

Hi Jyoti, you can use this kzbin.info/www/bejne/oYfCZpaQrZKVZrM

[@jyotigautam7018]

Thank You for the response .

[@praveenkumar-ti6pt]

Use aggregate transformation to filter distinct records

[@rcallain2001]

Revisting. Is there a way to do this with a table that is the source that is delimited? My source SQL table was provided by another process of which I have no control over. I need to convert that comma-delimited data into a functional table. I have successfully been able to transform the table back to csv, then import that CSV file into a table, but I wanted to know if there was something easier?

[@TheSamQuentin]

Very helpful video. Thank you.

[@mmarsbarr]

This is great, but do you have an exemple where you show how to handle files with errors? I tried doing an exception file task from within the loop but it doesn't work.

[@neerajbhanottt]

Hi Amir , You are really a great teacher . I have one doubt over here . When i created this ssis package , it did upload the data twice of the same file . but after when we assigned variable to flat file connection . After that same file is getting loaded but its once . container is not loop into the second file . file names are :- sampletext2 and sampletext3. Can you suggest what mistake i must be doing ? Thanks

[@Jerriehomie]

I was trying to use Connection string for Flat file as you mentioned but was throwing me error that " it could not open the file". Then, I deleted the folder Path and just used the FIleName Variable and package started working again.

[@ahmedoraby4439]

It worked also for me :D is there any explanation for this ?

[@TheDonMostro]

@ 3:00 Why is it important to make variable for the location instead of hard coding it? I did not understand or catch what was said.

[@TechBrothersIT]

We create variable so we can simple change the value of variable. specially when you are running from SQL SErver agent job, you don't need to open package to change the value , you have option to change the value for variable in SQL Server agent and it will start reading from new location.

[@sweet199125]

Hi Amir, In Connection Manager Properties -> Expression I am unable to see User:: FolderPath except User::FileName. Did i miss something while practising.

[@rizwanhasan5854]

good one Amir

[@dianathomas9869]

Sir, in my version of visual studio I can't find how to incorporate new variable . Please would u help me with that

[@AVINASHSINGHKHALSA]

Hi Amir, There is no Directory option in BIDS 2008 (I have SQL Server 2008 R2 installed with BIDS). How to create a variable in Visual Studio 2008 with using that Directory Option?

[@TechBrothersIT]

+AVINASH SINGH KHALSA Hi, if you go to SSIS Tab ( Drop down). You will see variables. Click on that and it will let open variable windows.

[@AVINASHSINGHKHALSA]

+TechBrothersIT I got it now. I had to re-select the option "Foreach File Enumerator" to get the Directory option. Thank you :)

[@arunmaniviki]

Hi Aamir, i have doubt... I go through this video and tested. Its showing error. But when go with www.techbrothersit.com/2013/12/ssis-load-multiple-files-to-table-with.html this link, especially mentioned in Step 6 -5th point i didnt get any error. i didnt understand... Can u explain please...

[@krismaly6300]

I think I figured out the package takes the time (Old file first and latest file last) But let me know your comments

[@saeedgholamrezaee]

thank you Mr

[@saikrishnareddy6405]

Sir, how to load a flat file if the files are enclosed by single or double quotes. For eg: Id | Name | sal 1 | 'Ram' | 20000 2 | ' krishna' | 10000 Please suggest sir.

[@getusama]

Hi Tech IT Brothers I love your videos and I more love your idea about having a separate website with pictures and code to copy. But at work I cannot see the pictures and it is blocked but I can see pictures in other web site. If I can't see the pictures then the whole objective of a seperate site for people like me who can't see youtube videos fail. Please can you host your picture somewhere trusted. That will be extremely helpful. Thanks

[@ahsanjaved288]

What if the other file have different column names??

[@TechBrothersIT]

I have another post in ssis tutorial that you can use to load the table as per file name. Thank you

[@Circusfreak182]

You have malware/adware...... That browser icon on your task bar is for "Speed Browser" which is basically an Adware app sitting on top of Chromium. Go look up a Speed Browser removal tutorial.

[@TechBrothersIT]

That was deleted. Thanks

[@Circusfreak182]

TechBrothersIT Welcome, glad I could help out! Edit: Also, thanks a ton for the tutorials. Your stuff has really helped me out at work.

[@TechBrothersIT]

You are very welcome and we are really happy to hear that our tutorials are useful to you. All the best and Thanks again for support.

[@cvreddy369]

MSBI has job opportunities now?

[@TechBrothersIT]

Many jobs available. Again depend upon your location.

[@krismaly6300]

Suggestion to all Ensure that Same Structured and same Meta Data file in the folder. Another Point to note I had a couple of Comma Delimited files and one PIPE delimited file then ran the package and observed that Package FAILED but in reality, it ran the two Comma Delimited files successfully and but Package failed due to Pipe delimited file. Rule id Ensure Same Meta Data, Same Structure, Same Delimited data files in the folder. Thanks a lot

[@cherryengineer6690]

Tu Dev Manus Hai :-)

[@chaudhryalisalam3668]

Sheers -e- ssis zindabad sir

[@TechBrothersIT]

Thank you dear!

[@bibekanandadash4785]

How to contact ?? can i get contact number??