Awk Crash Course

Earthly ➤ earthly.dev/youtube
In this video, we delve into the powerful command line tool, awk, and showcase its exceptional capabilities for parsing and analyzing data. Whether you're a data enthusiast or a programming novice, awk can revolutionize the way you handle and process files, text, CSVs, and TSVs. We provide a comprehensive introduction to awk and gawk, focusing on practical applications like leveraging field separators, using awk in shell pipes and one-liners, and employing if-else logic and begin-end blocks. Specifically, we demonstrate how to use awk for sorting data, running totals and aggregates, column slicing, and advanced text processing. By mastering awk's features, you can create specialized tools tailored to your specific data analysis needs.
Throughout the video, we guide you step-by-step on using awk for data analysis. We cover essential topics such as installing awk, the fundamental "print" command, working with sample data, and understanding field separators. Additionally, we explore the power of awk's pattern-matching capabilities using regular expressions, and we demonstrate how to enhance output using the "printf" function.
To take your awk skills to the next level, we provide scripting examples that showcase the flexibility and versatility of this incredible tool. By the end of the video, you can create your own awk scripts for various tasks tailored to your specific needs.
For those interested in diving deeper into awk, we highly recommend the book "The AWK Programming Language." Written by the creators of awk, this acclaimed resource offers an in-depth exploration of the programming language, making it an invaluable companion on your journey to mastering awk.
Don't forget to subscribe, like this video, and leave your comments below to let us know your thoughts and any questions you may have!
➡️ Earthly: earthly.dev/
➡️ Subscribe: www.youtube.com/@EarthlyTech?...
📒 Links 📒
The AWK Programming Language [Book]:
ia803404.us.archive.org/0/ite...
Article version of this tutorial:
earthly.dev/blog/awk-examples/
📒 Chapters 📒
00:00 - Intro
00:22 - Install Awk
01:05 - Awk print
04:51 - Awk Sample Data
06:28 - Printing Book Data
06:58 - Field Separators
07:56 - Awk Pattern Match With Regular Expressions
13:54 - Awk printf
15:27 - Begin and End
18:50 - Awk Scripting Examples
22:25 - Is Mockingjay Bad?
26:28 - Awk if else
32:55 - Summary
33:54 - Sorting
📒 About Earthly 📒
Earthly is a command line tool that simplifies build processes, especially for complex projects involving multiple programming languages. It helps manage communication between different languages, making builds easier to manage. If you want to streamline your build processes and work with multiple languages, Earthly can help.
Website: earthly.dev/
Follow us on Twitter: / earthlytech
Subscribe: www.youtube.com/@EarthlyTech?...

[@EarthlyTech]

Data file has moved: web.archive.org/web/20200919090548/s3.amazonaws.com/amazon-reviews-pds/tsv/amazon_reviews_us_Books_v1_00.tsv.gz

[@ChrisCox-wv7oo]

Second edition of The AWK Programming Language just came out btw. Thanks for the tutorial!

[@EarthlyTech]

Great book! I wonder what they changed?

[@alik.ebrahim2043]

Thanks Adam (I hope I got that correctly). This one's a nugget for someone like me who's just trying to get into the command line environment. Thanks for all the examples, they made awk capabilities very clear.. it's a great introduction. Hope to see more of such topics

[@EarthlyTech]

Very welcome!

[@sociologie4507]

I have been parsing raw text data from multiple sources for different data projects in Python for 6 years now. Its not bad, but AWK is better for lots of them. Thanks for the tutorial!

[@EarthlyTech]

Thanks for sharing! yeah, at certain tasks sizes AWK is a great fit. Python is still great past a certain size though.

[@onaecO]

Thx this is so well done!

[@EarthlyTech]

Thanks!

[@warrengibson7898]

Except for endless repetitions of “right”

[@chezchezchezchez]

In 2024…. Awk is 47 years old!!! Exciting old program!

[@EarthlyTech]

Still going strong!

[@vikingthedude]

How do you get the entire bottom bar to change colour for each vim mode? Mine doesn’t do that. Can we configure that in the vim plugin?

[@EarthlyTech]

I think its vim.statusBarColorControl

[@tridibbiswas3361]

Thank you for the video. Could you please share the aws link for downloading the data mentioned in the video (4:54min) to help try along. Trying to access it seems to give access denied error

[@EarthlyTech]

Oh shoot, it looks like they have changed taken it down. It can be found on the wayback machine here: web.archive.org/web/20200919090548/s3.amazonaws.com/amazon-reviews-pds/tsv/amazon_reviews_us_Books_v1_00.tsv.gz

[@tridibbiswas3361]

@@EarthlyTech Thank you

[@ArcWeltraumpert]

awkwkwkwkwkwk means hahahahah in Indonesian language