Working with Flat files - Flat File Validation

[@avinashbaburavi]

I usually do not comment in youtube but your video I have so much help and information I wanted to let you know that it is great and you have great teaching skills. Almost no wastage or lag in your explanation, hatsoff!!

[@TechCoach]

Thanks a lot Avinash for the kind words, they made my morning.

[@rajesh6262]

Finally my search ended here. I got what I was looking for. This topic almost covers everything about flat file validation. Thank you :)

[@TechCoach]

Thanks for the kind words. I have a small request I am working on this new youtube channel "An Indian Abroad" it will really help me if you watch and subscribe to it. kzbin.info/www/bejne/fnO0eZihgpaIaMU

[@sngrg81]

Very well explained really helped thanks for making such types of videos

[@tomkingtech9730]

What an excellent explanation of flat file validation! Our company is preparing to onboard a brand new financial system, and this helped center my mind of some of the potential challenges with building data integration between our old and new systems. Thank you very much!!

[@TechCoach]

I am glad I could help :)

[@Anavi-i4n]

Very helpful video well explained

[@TechCoach]

Thanks a lot for the kind words :)

[@surajpatil3579]

Amazing content... keep making videos on scenarios like this!!

[@mhl1740]

Very good! In my experience, checking the code page is very important too.

[@TechCoach]

Thanks buddy :)

[@hemanthdev8882]

Its such a relief to have related topic in one place and well addressed!! Great going!

[@TechCoach]

Thanks Hemanth for the kind words, It means a lot to me. I have a small request, I am working on this new channel and would really appreciate if you watch and subscribe to it. kzbin.info/www/bejne/f4GVh6Fsn7Brfsk

[@TechCoach]

Thanks Hemanth for the kind words, It means a lot to me. I have a small request, I am working on this new channel and would really appreciate if you watch and subscribe to it. kzbin.info/www/bejne/f4GVh6Fsn7Brfsk

[@parasuramb5656]

I have a new team who are in testing and it would be helpful if you have some tips to automate these file validations so that we can reduce the testing time and come out the monotonus stuff to more value added stuffs

[@yagersew437]

Thanks buddy. That was very informative.

[@ffboyopmohitfrombhiarp9662]

Really excellent 👍

[@qlqa8932]

Finally my search ended here. very good explain, can you please make video on pk check and fk check data validation in informatica powercenter.

[@sonaligujarkar631]

If one file having delemeter , and second file # and 3rd file having delemeter $ in such case can we do indirect mapping

[@TechCoach]

Why would you design a system that would have different delimiters from source, this would never happen in a well formed source. Also I doubt we will be able to use indirect load in this case

[@vijaykotagiri6452]

Very well explained the Flat file validation. Really good work..👍 👍 👍

[@TechCoach]

Thanks a lot Vijay for the kind words :)

[@rajghiya9]

Thanks for this video. Will it possible if you can show few examples on informatica

[@manojkumarhk5696]

do we have to use excel to validate data from flatfile to database?

[@TechCoach]

Not really we usually write validatjon rules in UNIX scripts, PLSQL procs or ETL tools as well.

[@kowmudi]

Hai sir thank you so much, by this video I got to know how to validate text flat files. could you please tell me how to develop a function that transforms the .txt flat file encoding to utf-8.

[@TechCoach]

I am glad I could help :)

[@pravinm1490]

Nicely explained

[@sharathshriyan1440]

Hi Sir, what are the validations to perform in staging area, in ods and in dwh?

[@qlqa8932]

please make video on data validation in informatica powercenter on flat file by taking scenario.

[@mayakkannanm3871]

Frequency - your says scenario right same like asked for interview , how to answer to interview perspective. I unable to understand flat file validation . For example source 1 flat file , source 2 CSV , source 3 tables this three file data loading to target via some tools and based on requirements . What are the validation will do , Please me update. And High level of scenario .

[@dineshcse11]

Excellent one

[@silaswilfred]

Thank you so much. Your videos are very informative and helpful. Can you please make a video on unix commands which does these file validations?

[@TechCoach]

silas wilfred Thanks a lot for the kind words, I will try to make one soon. I Would really appreciate if you help me build my new channel by watching subscribing and sharing "An Indian Abroad". kzbin.info/door/oLdaMxhfDgdgIAcRGlUvkg

[@roopalidixit9711]

Very nice video. Can you please provide the most common unix commands or script checks for these?

[@TechCoach]

Sure Roopali I will share them. You maywant yo start with find grep sed and awk

[@Indian_working_mom]

Excellent very useful video sir 👏👏👏👏👏👏👌👌👌

[@TechCoach]

Thanks a lot for the kind words Divya :)

[@Indian_working_mom]

@@TechCoach can you please explain project architecture in etl and what are the validations we do while loading data from source to target,and

[@Indian_working_mom]

@@TechCoach I have one doubt , source data is loaded from Source to data processing layer ,the data is loaded daily based or weekly or monthly or I don't know how oftenly data is loaded from source to data processing layer please tell me this was my interview question

[@Indian_working_mom]

What are the validations we will do between 2 tables in oracle 10g

[@nithyagct9673]

it was very clear and please give us the basic command used for validating all these scenarios.

[@TechCoach]

Thanks a lot for the kind words, I will try to make some more videos explaining the same. Please help me in my new Initiative by subscribing sharing and watching my new youtube channel "An Indian Abroad" kzbin.info/door/oLdaMxhfDgdgIAcRGlUvkg

[@parasuramb5656]

This is a very useful vdo explaining all the key things and in simple and plain language. Keep it up and all the best.

[@TechCoach]

Thanks a lot for the kind words, I have a small request I am working on this new youtube channel " An Indian Abroad " and will really appreciate if you watch and subscribe to it. kzbin.info/www/bejne/Z2KnfGClrrekopI

[@natarajbeelagi569]

While moving a flat file from landing area to staging will it be converted as Database file?

[@adhiladil6576]

Perfect video thank you

[@TechCoach]

Thanks buddy .

[@madhumithaelango1460]

Hi I am trying to connect to mainframe system and check for file stamp and existence of file using any of the scripts . Is it possible to do

[@TechCoach]

I am sorry Madhumitha, I haven't worked on mainframes systems.

[@Telugufun427]

bro how do we park the records which are not available in dimension tables

[@TechCoach]

The ETL process redirects them in a different table

[@Telugufun427]

@@TechCoach we need to capture in temp table right?

[@babureddy5574]

it would be really good if explained with unix commands

[@TechCoach]

Thanks for the feedback

[@sakshinaik05]

Plz make more videos on etl testing

[@TechCoach]

Sure Sakshi I will work on it soon

[@Amar-tk2yu]

superb you are speed is also very good keep the same phase bro my question is when we do file transfer the system got shot down in half process then how to know how many tables got loaded and which are those?

[@karthikasampathkumar1745]

Awesome explanation, may i know, is there any tool to validate these scenarios automatically?

[@TechCoach]

Thanks a lot buddy. May be there are some out there but I haven't come across one myself

[@chandubharath1772]

Thank you so much.

[@TechCoach]

Hi Chandu , Please consider subscribing to my other channel It will really help me kzbin.info/www/bejne/bHiUqXqfYqlopdk

[@puneettiwari2251]

Great Explaination....Fanatastic.........a small request,could you please give sequential numbering and naming format to the videos so that we get the sequence in which we should follow the videos ,currently naming convention is a bit unclear.....Thanks a lot. Just one more request if we could have topic/technology/concept wise playlist ,it would be very helpful. My apologies to bother you much.

[@TechCoach]

Sure Puneet, I will change it for all my future videos :)

[@mkr7345]

Can you give us scd 1 2 explanation link .

[@TechCoach]

kzbin.info/www/bejne/jqLHi3lmea-ji9U

[@TechCoach]

Please help me in my new Initiative by subscribing sharing and watching my new youtube channel "An Indian Abroad" kzbin.info/door/oLdaMxhfDgdgIAcRGlUvkg

[@ngrlittlecreations8396]

It's very nice video

[@TechCoach]

Thanks a lot Gopal. You can contact me on [e-mail] I have a small request I am working on a new youtube channel and would really appreciate if you watch and subscribe to it. kzbin.info/www/bejne/p2XIiayFhdVggtU

[@SreeramReddyB]

There is option of quotes

[@snowflakehelpers4600]

It was good but if file validation implementation is also explained it would be great

[@TechCoach]

Thanks Sanjeev, I will try to incorporate that.

[@sachin1234566]

Keep it up bro.👍

[@haamedpashasiddiqui]

Thank you buddy. Haamed Pasha Siddiqui

[@prafulnchikkamath1856]

Why you won't try SQL.. How to convert flat file have value like below.. It will helpful Source I'd values - columns 1 1,2,3,4 2 5,6,7,8 Target.. I'd value 1 1 1 2 1 3 1 4 2 5 2 6 2 7 2 8