Regular Expressions - Computerphile

  Рет қаралды 246,469

Computerphile

Computerphile

Күн бұрын

Пікірлер: 383
@ke9tv
@ke9tv 4 жыл бұрын
'Some people, when confronted with a problem, think, “I know, I'll use regular expressions.” Now they have two problems.' - J. Zawinski
@BlazingSun46
@BlazingSun46 4 жыл бұрын
Kevin Kenny Oh I know! I will just use regex. wait, what was the token for that thing again?
@IshayuG
@IshayuG 4 жыл бұрын
Put RegEx into APL for ultimate confusion (and compactness)
@recklessroges
@recklessroges 4 жыл бұрын
booo "bad Regexp meme is bad". #Regexp4life
@limmeh7881
@limmeh7881 4 жыл бұрын
You just earned your 69th like my man. Regex is the most confusing thing for me lol.
@sugarfrosted2005
@sugarfrosted2005 4 жыл бұрын
It's funny because regular expressions regularly make my life easier because I use them constantly. A rare use of them is worse than using them often and now using them.
@ChrisSeltzer
@ChrisSeltzer 4 жыл бұрын
Just an anecdote about regular expressions from working as a software engineer. I once worked in a codebase that made lots of use of regular expressions. I suggested that for maintainability we should have a rule that above the regular expression you add a comment stating what it was intended to match. The pushback I received was that "the regular expression, by definition, says what it's intended to match."
@adamdyson3977
@adamdyson3977 4 жыл бұрын
How dare you not instantly know how to read regex 😂
@Roxor128
@Roxor128 4 жыл бұрын
[groans] A prime example of being correct on the wrong level.
@lawrencedoliveiro9104
@lawrencedoliveiro9104 4 жыл бұрын
My attitude to comments is that they shouldn’t say just what the code does (the code itself does that), but _why_ the code is doing what it’s doing. Perhaps a comment on the regular expression could be expressed on the same basis.
@evangrove2131
@evangrove2131 4 жыл бұрын
It's all fun and games until \b\w+\b\s*(?=(\[.*\]\w*)?([\(]|([ ](?![,+\-*/=!^&<>|?]|and|as|div|in|is|isnot|mod|notin|of|or|shl|shr|xor))))
@iainp84
@iainp84 4 жыл бұрын
Evan Grove please could you add a comment describing what that regex is intended to match?.....
@giotsas
@giotsas 4 жыл бұрын
A wise man once said: "The plural of regex is regrets"
@ryansandigan7184
@ryansandigan7184 4 жыл бұрын
I have no regrets using regex in programming...
@suicidalbanananana
@suicidalbanananana 4 жыл бұрын
wise words!
@kamilziemian995
@kamilziemian995 3 жыл бұрын
Pure gold.
@farhanaditya2647
@farhanaditya2647 3 жыл бұрын
@Poppy Smoria xD
@davidgillies620
@davidgillies620 4 жыл бұрын
It is hard to overstate the enlightenment that comes from realising that a regular expression is a state machine.
@profdaveb6384
@profdaveb6384 4 жыл бұрын
Yes !
@musashi939
@musashi939 4 жыл бұрын
Which you know if you study computer science. Regular language -> deterministic, finite state machine -> regular expression
@josko50
@josko50 4 жыл бұрын
All of the contributors on this channel are great, but every Professor Brailsford video always has my undivided attention. I appreciate his particular style of making these complex concepts unfold like a story.
@samipah
@samipah 4 жыл бұрын
More info in: Mastering Regular Expressions, 3rd Edition By Jeffrey Friedl Pages: 544
@Ceelvain
@Ceelvain 4 жыл бұрын
The famous book by the man who disregard and direspect the underlying math. This book will mostly teach you how to best use regular expressions given the current widespread implementations. Not what they are nor how regex engine actually work. It's targeted at casual programmers and not at computer scientists. (Gosh, I don't even remember this book talking about algorithmic complexity.) And most of everything he says about regex engines is at best incomplete and misuse the terminology, at worst it's wrong and misleading. I would recommend the blog of Russ Cox to dive into how regex are actually executed. I honestly loved every word.
@thomaskember4628
@thomaskember4628 4 жыл бұрын
Ceelvain I am in the middle of reading Larry Wall’s book on Perl. In it he says Friedl’s book is the place to go to for more information about regular expressions. Are you saying that this is not so and Friedl’s book is rubbish? I looked it up on Amazon but haven’t decided to go ahead and buy it.
@gangstaberry2496
@gangstaberry2496 5 ай бұрын
"To all of you who think I am personal friends with all these people" Bless this man, he puts up with a lot 🙏
@realandar
@realandar 3 жыл бұрын
I'm a huge fan of Prof Brailsford. I was extremely fortunate to start my computing career, while in secondary school in about 1975, learning on a pdp/8E. I learned so much, including TECO a text editor that used regexp. Those were the days that truly grounded my understanding of computers, hardware, firmware, and software. Watching this series brings back great memories. Thank you.
@swagatochatterjee7104
@swagatochatterjee7104 4 жыл бұрын
12:40 not only Ken Thompson. This problem was also solved on the other side of the Iron Curtain by Vladimir Glushkov. Unfortunately we are not taught much about Glushkov's construction algorithm.
@asaadb1
@asaadb1 4 жыл бұрын
I faced a really pesky regex problem the other day, took me 2 days to solve it (had to trace back data to a reduced set), i never knew you could use a diagram for regex - i just scribbled it down in like 20 mins, got the same solution. genius!
@thattimestampguy
@thattimestampguy Жыл бұрын
1:32 012 ac string 3:15 abc 3:57 Ab*c B* = 0 or more B’s 5:03 Quite complicated but locally simple 5:34 Chomsky Grammer approach 7:27 complete equivalence Automaton Regular expression Chomsky Expression Start, Automation, Finish 8:29 Snag in equivalence 9:46 2 alternatives, 2 completely different directions. 11:03 What are you gonna do? 11:28 Nondeterminist -> Determinist 13:03 Ken Thompson said 13:57 Regular Expression recognizer.
@sejinmajnaric2884
@sejinmajnaric2884 3 жыл бұрын
Thank you so much, Professor Brailsford! Hope you are well and healthy! I absolutely love listening to your explanation, it's so soothing to my ears.
@fouzaialaa7962
@fouzaialaa7962 4 жыл бұрын
i was taught this stuff without explanation never thought it could be used to solve a problem ..... i genuinely believe this channel is better that teachers i pay to teach me stuff
@lunafoxfire
@lunafoxfire 4 жыл бұрын
Lol I was the opposite... I got taught how to solve problems using it but not really any of the theory behind it.
@jaimecristalino
@jaimecristalino 4 жыл бұрын
His voice is so nice to hear...
3 жыл бұрын
Finally someone speaks about the important things. I would have visited his lectures just for relaxation 😌
@BTHobbies
@BTHobbies 4 жыл бұрын
This video was the first time the link between regular expressions and finite state automata clicked in my brain. I've been comfortable with both for years, and knew they were equivalent, but they just never came together for me before now. Thanks!
2 жыл бұрын
The NFA-to-GNFA-to-Regex algorithm is really helpful in making that connection too
@davidwise1302
@davidwise1302 4 жыл бұрын
I am retired now, but for decades of my software engineering career I have used C switch statements to implement state machines. No programming book that I have ever read has ever described such a method, but I learned it on-the-job (OTJ, a very common military acronymn since that is how you learn almost everything). In the last two decades of my software engineering career, I was repeatedly tasked with communicating with GPS receivers over their serial communications. We were never taught those skills in school, but we learned them immediately in the real world.
@lawrencedoliveiro9104
@lawrencedoliveiro9104 4 жыл бұрын
Yup, hand-coding state machines to handle parsing various kinds of data is an extremely common thing. Done it lots myself.
@lawrencedoliveiro9104
@lawrencedoliveiro9104 4 жыл бұрын
Yup, hand-coding state machines to handle parsing various kinds of data is an extremely common thing. Done it lots myself.
@LemonadetvYT
@LemonadetvYT Жыл бұрын
You can’t lie he is the best professor to explain regular expressions
@BeCurieUs
@BeCurieUs 4 жыл бұрын
As far as pedagogy goes, Professor Brailsford is unrivaled. Def reignited my computer science flame
@banderfargoyl
@banderfargoyl 4 жыл бұрын
Love the history. Ken and Dennis certainly deserve the recognition for their accomplishments.
@josephgaviota
@josephgaviota 3 жыл бұрын
💯 agree! True GENIUS.
@hahahatall09
@hahahatall09 4 жыл бұрын
It's terribly difficult to explain regex to people who don't use it!
@CottonInDerTube
@CottonInDerTube 4 жыл бұрын
I use it from time to time. I understood nothing from the video. And thats the first time on computerphile videos.
@pdrg
@pdrg 4 жыл бұрын
It's terribly difficult to explain regex to people who don't use it ;-)
@FireWyvern870
@FireWyvern870 4 жыл бұрын
@@pdrg you can use it -like this- you know
@a.yashwanth
@a.yashwanth 4 жыл бұрын
@@FireWyvern870 how
@RustyTube
@RustyTube 4 жыл бұрын
@@a.yashwanth As he said, -like this- (precede and follow it by a dash).
@Sei783
@Sei783 4 жыл бұрын
The wealth of knowledge contained within this man is mind blowing. To me, all this is trivial information that I'd never remember. These days, I can't remember what I did five minutes ago. But it's all so fascinating.
@danielroder830
@danielroder830 4 жыл бұрын
The way people mostly use regular expression in programming or at least me is to use it as a language that describes search patterns. One example would be an expression that looks for a date in a specific format like 2020-01-09 in a given text. For example you would write an expression that states: A four digit number, starting with a 1 or 2 followed by a "-" then a number between 01 and 12 one more "-" and then a number between 01 and 31. But you have to write it in that language in a compact form. And then your expression will only find that specific format and you can extend it to other formats, like allowing 2020-1-9 as a first step or 2020/01/09 and so on and then formats from other countries, with names of months in different languages and totally go nuts until your regular expression fills multiple pages. But its and incredibly powerful tool and very hard to master. If you have to make one yourself for a more complicated case you will find yourself always tweaking it a bit to include more matches and have less mismatches.
@MikeMMCC
@MikeMMCC 4 жыл бұрын
I loved how this video tied together regex, automata and formal languages. Watching this I felt the formal definition for regex is really simple, but in real world use things can get messy. Would've liked some mention of the extended symbols like the Kleene plus, or use of subexpressions etc. Anyway great job.
@profdaveb6384
@profdaveb6384 4 жыл бұрын
Hope to do more actual regex examples and more extended regex constructs in a follow-up video
@roberthunter5059
@roberthunter5059 4 жыл бұрын
This was a very "computer science" explanation. I'm not sure how well anyone who hasn't worked with regexes will understand it.
@daniel.watching
@daniel.watching 4 жыл бұрын
If you get deep into regex, it helps to understand FSA. But for basic stuff you don't need to understand the mechanics, just the syntax.
4 жыл бұрын
I think there should have been a real-life example like matching a telephone number or zip code or something. I had a course on formal languages so I understood the video in full and enjoyed the context provided, but there is no way this is digestible by common folk, which is a shame because this might end up showing up in the youtube search for regular expressions…
@zacharieetienne5784
@zacharieetienne5784 4 жыл бұрын
yes i understood some of those words
@FrankHarwald
@FrankHarwald 4 жыл бұрын
For those interested on how to convert a non-deterministic regex (& hence equally a non-deterministic finite automata or non-deterministic left-regular grammar) into a deterministic ones, what you'll have to do is a closure of each (initial state + input state tuple) with each possible subsequent states which in the worst case will mathematically end up being a full power set construction of the initial non-deterministic automata which is why a given non-deterministic regex of length ~n may end up being as big as O(k*2^n) for a positive non-vanishing constant k in the worst case. So yes, succinctness as well as computational complexity of deterministic vs non-deterministic regexes differ exponentially! Another thing: all this video talks about is about regexes, finite automata & grammars without much output besides a singular boolean accepting or non accepting, that is, pure acceptors - while in practice regexes, finite automata & grammars often specify a corresponding output which is why they are called a transducers - & there's an entire zoo of different kinds of transducers - even for just regexes - different forms of output, multiple outputs... you name it!
@chaoslab
@chaoslab 4 жыл бұрын
Quite happy to regularly express that I think Prof Brailsford is a nice chap!
@tedchirvasiu
@tedchirvasiu 4 жыл бұрын
0:43 Professor Brailsford is a real-life Yoda
@wakinglife7355
@wakinglife7355 4 жыл бұрын
/Lol/i
@LittleRainGames
@LittleRainGames 4 жыл бұрын
Aka Coda
@abdulalhazred5924
@abdulalhazred5924 4 жыл бұрын
I'm part of a minority, should I be worried?
@Redentor92
@Redentor92 4 жыл бұрын
Finally a subject I know! There's a lot to be said about Automata and Regex, and personally I think it's a great debt of this channel. One thing is about the Sakoda Sipser problem, which asks about the amount of states involved in the change from non deterministic to deterministic automata of basic operations of (regular) languages like union, intersection, complement and so. Other is the Černy problem, but this is more abstract. Automata are a very interesting subject hidden from the general public.
@Furiends
@Furiends 4 жыл бұрын
Yeah they could have explained why the not so regular expressions are called regular and in fact knowing why its called that and understanding what regular means also tells you when you should and should not use regex.
@petrmalecik5661
@petrmalecik5661 4 жыл бұрын
I agree also It would be great to do something about push-down automata, deterministic and non-deterministic and say something about relation between automatas and languages in chomsky's hierarchy
@noswonky
@noswonky 4 жыл бұрын
If I didn't already know what regular expressions are, I still wouldn't.
@jamesedwards6173
@jamesedwards6173 2 жыл бұрын
Regular expressions are awesome, and in my own experience everyone who's spoken ill of them has implicitly announced their own lack of skill with them rather than establishing anything compellingly negative about them.
@ianmcnaney6528
@ianmcnaney6528 4 жыл бұрын
It still boggles my mind that people know what regular expressions are but don’t understand them, and are so proud of that fact that they’ll brag about it in KZbin comments. If you thought you had one problem before someone used a regex, and then had two problems, well now you have three. You’re unemployable.
@rnoro
@rnoro 2 жыл бұрын
Definitely the best video about regular expression I've ever seen!
@Relemsis
@Relemsis 4 жыл бұрын
this man is one of my favorite youtubers
@ColinBroderickMaths
@ColinBroderickMaths 4 жыл бұрын
Having watched this I feel like I learned absolutely nothing about regular expressions.
@billigerfusel
@billigerfusel 4 жыл бұрын
Same, lol
@SteS
@SteS 4 жыл бұрын
I've known it for ten years and his explanation greatly overcomplicates it and never really gives you an idea of how it works, it was more a history lesson. He does this a lot.
@idjles
@idjles 4 жыл бұрын
@@SteS i came for the history - i know the rest.
@SteS
@SteS 4 жыл бұрын
@@idjles I was replying to Colin as he thought this was an explanation when it wasn't. The closest he got was explaining *b** was matching b 0 times-infinity.
@servenToGo
@servenToGo 4 жыл бұрын
Well, it is about the idea of regex
@suicidalbanananana
@suicidalbanananana 4 жыл бұрын
Regular expressions are the sole reason we have websites like stackoverflow etc, so you can ask somebody else to write your regex :P
@swagatochatterjee7104
@swagatochatterjee7104 4 жыл бұрын
I never knew it was Kleene(Cleany) I always called him Kleene(Clean). Yes I called the operator a "clean star".
@KnakuanaRka
@KnakuanaRka 3 жыл бұрын
Me too. >w
@devttyUSB0
@devttyUSB0 4 жыл бұрын
That epic 'how to parse HTML with regexps'-question on stack overflow.
@NoNameAtAll2
@NoNameAtAll2 4 жыл бұрын
Worst answers on all that website
@Furiends
@Furiends 4 жыл бұрын
Thats an awful use case for regex.
@NoNameAtAll2
@NoNameAtAll2 4 жыл бұрын
@@Furiends Why? StOve question was about finding closing tags in simplest html files Seems alright place for regex
@lawrencedoliveiro9104
@lawrencedoliveiro9104 4 жыл бұрын
@@NoNameAtAll2 It can’t work, because opening/closing tags can be nested inside other opening/closing tags, to arbitrary levels. Regexes cannot handle that.
@lawrencedoliveiro9104
@lawrencedoliveiro9104 4 жыл бұрын
@@NoNameAtAll2 It can’t work, because opening/closing tags can be nested inside other opening/closing tags, to arbitrary levels. Regexes cannot handle that.
@torarinvik4920
@torarinvik4920 Жыл бұрын
The guy who designed APL was deeply inspired by the obfuscation of Regex. If you can express a program in 4 lines, then squeeze it into one! The incredible amount of disk space a few extra lines requires can not be understated!
@stephenm3874
@stephenm3874 4 жыл бұрын
Light bulb lit up @ 7:25. Used regex extensively in early 2000's writing real-time flat file parsers for AIG. Very challenging and enjoyable.
@aasutossh
@aasutossh 4 жыл бұрын
The story telling is amazing.
@programmingguy6081
@programmingguy6081 4 жыл бұрын
I love regular expressions and I include them in all coding projects. It saves me from having to write hundreds of lines of code to capture the same data with a single regular expression.
@marco201ful
@marco201ful 4 жыл бұрын
People wanting a more practical video do not get that this channel is more focused on the mathematical aspects of computer science.
@hatoline4731
@hatoline4731 4 жыл бұрын
The idea that I can describe state machines with regex is somehow mindblowing.
@BaronSamedi1959
@BaronSamedi1959 4 жыл бұрын
And then Larry Wall put regexes into Perl and the world was saved!
@TheUglyGnome
@TheUglyGnome 4 жыл бұрын
Perl is the best programming language ever.
@MSStuckwisch
@MSStuckwisch 4 жыл бұрын
You should see what he did with it in Raku (née Perl 6). Allows for full parsing of something like JSON in a crazy small amount of code (and READABLE code at that). Take a look at the JSON::Tiny module's code. It's actually kinda beautiful
@vitalspark6288
@vitalspark6288 4 жыл бұрын
Ken Thompson's `grep` was also a pretty important in-between step.
@DCFusor
@DCFusor 4 жыл бұрын
Glad to see there are a few of us, still.
@xaviarnl
@xaviarnl 4 жыл бұрын
And you appreciate Perl regexes even more when you see the weird regex implementations in other languages (I'm looking at you, Java).
@geraldbustos
@geraldbustos 4 жыл бұрын
Please allow the automatic captions
@profdaveb6384
@profdaveb6384 4 жыл бұрын
subs have been sent to Sean so shouldn't be too long now ...
@misode
@misode 4 жыл бұрын
While this explains the history and background of Regex very well, it's not a video for regex beginners who want to use them.
@sp10sn
@sp10sn 4 жыл бұрын
What the heck is determinate (deterministic) vs non? I comes up too often and in too many ways for me to infer and I don't understand the somewhat philosophical references that I find.
@DFX2KX
@DFX2KX 4 жыл бұрын
Regex is incredibly useful for searching for and filtering text. It's a feature of pretty much every MUD client for that reason. One long sentence worth of Regex can do with 40 lines of code for a plugin can do. I've used them to the extent that my client's memory allocation for that system seems to have run out and they don't always fire now, lol.
@JNCressey
@JNCressey 4 жыл бұрын
Useful as long as you don't let it become Zed's hair code. > These yellow pets > are called Zeds. > They have one hair > up on their heads. > Their hair grows fast... > so fast, they say, > they need a hair cut > every day. > - Dr. Seuss, One Fish Two Fish Red Fish Blue Fish When code is crunched into a single complex line when many simple lines would be clearer, I call that Zed's hair. Eg, if you're trying capturing all email addresses and phone numbers from a string. Split it into two separate searches, one for emails, one for numbers. Don't crunch it into one line by creating a single RegEx that matches both email addresses and phone numbers. Also, as you mentioned, regex can be inefficient. Crunching down line numbers when it sacrifices both clarity and efficiency is incredibly dumb. That said, simple regular expressions can be much clearer than the equivalent multiple lines of code.
@lunafoxfire
@lunafoxfire 4 жыл бұрын
@@JNCressey Haha that's a great expression. I'm stealing it.
@thomaskember4628
@thomaskember4628 4 жыл бұрын
I have often wondered how the name Kleene should be pronounced since I had only seen it written. This pronunciation is at least something I’ve learned from this video.
@1100000011110
@1100000011110 4 жыл бұрын
A history lesson is fine and all, but I was hoping for a more practical video
@profdaveb6384
@profdaveb6384 4 жыл бұрын
Hope to do a couple of case studies in detail in the next video
@TwentyThreeasy
@TwentyThreeasy 4 жыл бұрын
@@profdaveb6384 it was a great video but must admit I expected a practical video too.
@arthurlevitsky3347
@arthurlevitsky3347 3 жыл бұрын
If you think this isnt practical then you should see my professor explain this stuff
@TheCookieMuncher96
@TheCookieMuncher96 4 жыл бұрын
This is one of the topics we have covered in discrete maths on my computer science degree, could have done with this video a couple of weeks ago lmao, great video though
@brightshadow9480
@brightshadow9480 4 жыл бұрын
If you can master Regex, you can add tremendous power to app for little effort. Seriously, if you need to do text parsing and validation, you are cheating yourself if you don't look into using them.
@raglandasir6885
@raglandasir6885 2 жыл бұрын
There's the Compiler Dragon book in the background there which explains & uses the principles mentioned in this video
@AcornElectron
@AcornElectron 4 жыл бұрын
Go on professor B, nail it!
@davidechiappetta
@davidechiappetta Жыл бұрын
at 6:42 it seems you place more emphasis on regular expressions (type 3) than the more powerful context free grammar (type 2), regular expressions are only limited in recognizing strings in text (pattern matching), and for lexers, or tools like grep (only 2000/3000 lines of code), awk etc..., but they can't do that much, I see you have the dragon book on your desk, and you value regular expressions more than cfg, the real geniuses were Chomsky and then McClure with his TMG, that Ken Tompson was so impressed that he used his principles also in the B language which later became C, same principles but greatly improved by Donald Knuth's inventing the most powerful LR parser followed by Stephen C. Johnson inventing Bison, I'm a parser fanatic, worked on a preprocessor C, contributed to add improvements in binutils and gcc source (bfd for the section elf and coff and dwarf for symbol debugger) and make version 4.x for variable expansions
@mubafaw
@mubafaw 3 жыл бұрын
Sir. These explanations are crystal clear. You're a legend. Thank you so much :)
@Omnifarious0
@Omnifarious0 4 жыл бұрын
Of course, the grammar way of doing things allows you to specify things that cannot be specified with a finite automata or a regular expression (namely nested constructs like parenthesis). :-) Just, the particular set of grammar statements he chose express exactly what's being expressed in the other two forms.
@MSStuckwisch
@MSStuckwisch 4 жыл бұрын
I was about to comment the same thing. A formal grammar allows recursive structures, but most regex implementations don't have a way to do that. Thankfully there are some now coming out that do, and man does it make creating parsers so much easier.
@Omnifarious0
@Omnifarious0 4 жыл бұрын
@@MSStuckwisch - But, it will make the regex handling slower. There's a reason for the very restrictive nature of regexes. It enables a very simple model for the computation. There is, in fact, a C++ library that will generate the C++ code to match a DFA at compile time for super-fast regex handling. Making it as fast as it is if you had to do full LALR or recursive descent parsing would be impossible I think. Regexes definitely have their place. And parsers have their place too. That's one of the reasons that a lot of compilers are written with a 'lexing' phase that uses a regex to tokenize the input, then uses a parser to parse the code.
@MSStuckwisch
@MSStuckwisch 4 жыл бұрын
@@Omnifarious0 True, though the speed will really depend on the nature of the grammar. A fully unambiguous CFG (to eliminate any type of backingtracking) should be able to optimize to virtually the same speed. Of course, virtually no real-world grammars are written like that, and most of the time we'd want to do more than just a yay/nay match. To me it comes down to ease of writing / maintaining. Most of the time the slower parsing using regex grammars is worth it, but if something starts to become truly speed critical, then I'd look to coding it manually for speed. (An interesting speed test for optimizations can be the JSON::Tiny (regex) and JSON::Fast (imperative) modules in Raku. Overtime the Tiny has been catching up a little bit, although the Fast still runs in about 25% Tiny's time
@photobigero8055
@photobigero8055 2 жыл бұрын
Thank you, for the explanation , but especially for the historical perspective on things that are used. I was intrigued by describing graphic diagrams over the phone , that I admit you can't really do that if you only have a microphone and a speaker. The older I get the more I try to learn and use things with a histiorical background and not just use them mindlessly.
@nikodemus7900
@nikodemus7900 4 жыл бұрын
I can't imagine a person sounding more British than this gentleman
@sevilnatas
@sevilnatas 4 жыл бұрын
My question is, do you still have use for that green bar paper or are you using it as note pad paper because you have it left over from back in the day? As a kid, I had reams of green bar paper from my uncle that was a software engineer at Rockwell International, programming avionics in C and who knows what other language before that. That green bar paper was, literally, an unending joy to draw on as a kid. P.S. - I think RegEx is one of the most brilliant, yet least mastered languages in computer science.
@BenMcKenn
@BenMcKenn 4 жыл бұрын
I thought regex was just a syntax for searching for patterns in strings, but this video makes it seem like it's at the heart of programming and computer science... what am I missing?
@scaredyfish
@scaredyfish 4 жыл бұрын
Was not expecting Noam Chomsky to come up in a Computerphile video!
@Roxor128
@Roxor128 4 жыл бұрын
His hierarchy of languages has come up in a couple of past videos. I suspect that among this channel's audience, there's a decently large percentage who only know of him for that.
@bretdavis8097
@bretdavis8097 4 жыл бұрын
PEG is a better solution for complex parsing, but regex is fantastic for simpler cases. All about using the right tool for the job
@leonhardeuler9839
@leonhardeuler9839 4 жыл бұрын
1:14 it’s not a good idea to write zero inside a circle, professor Brailsford.
@Roxor128
@Roxor128 4 жыл бұрын
Only if you forget to put a stroke through it.
@caver1
@caver1 4 жыл бұрын
ab(a|b)b or for a single line ^ab(a|b)b$ I bet there's other approaches that would work just fine too.
@ItsN1key
@ItsN1key 4 жыл бұрын
Grammers and regular expressions are not equivalent! You cannot write a regular expression for lets say a^n b^n (all strings that have n a symbols followed by n b symbols) but you can do it with a grammer: S -> aSb | ab
@lawrencedoliveiro9104
@lawrencedoliveiro9104 4 жыл бұрын
That’s not a regular grammar.
@ItsN1key
@ItsN1key 4 жыл бұрын
@@lawrencedoliveiro9104 of course it''s not, regular expressions are a sub set of context free grammar. Regular grammars are defined as all grammars that can be written as a regular expression. edit: I think that in the video what he meant is that all 3 examples are equivalent, that is true. What I'm saying is that that could be misleading and someone would start to think that all grammars can be written as a regular expression, which is false.
@lawrencedoliveiro9104
@lawrencedoliveiro9104 4 жыл бұрын
@@ItsN1key Trying to equate regular expressions with non-regular grammars is, shall we say, mathematically disingenuous, is it not?
@doom87er
@doom87er 4 жыл бұрын
Regex is my bane. Anything but the most simple expressions are like writing minified code outright! But they’re so good!
@Furiends
@Furiends 4 жыл бұрын
^\(?([0-9]{3})\)?[-. ]?([0-9]{3})[-. ]?([0-9]{4})$ I feel like part of the purpose of regex is lost in its short handedness. If the above looks like an alien language then you should either get really familiar with regex or use an expanded notation thats intuitive. Long English notation: ^ = From start \X = literal X ? = zero or one time ( = capture ) = end capture [X] = any of X X - Y = from X to Y {X} = X (range) times $ = to end From start, literal (, zero or one time, capture (, any of, from 0 to 9, 3 times, literal ), zero or one time, ) end capture, any of - or ., zero or one time, capture (, any of, from 0 to 9, 3 times, ) end capture, any of - or ., zero or one time, capture (, any of, from 0 to 9, 4 times, ) end capture, to end.
@TheNewton
@TheNewton 4 жыл бұрын
what is a regular expression? What is it good? Suppose you want to look for the word "he" in a book a simple search will also give you noisy results "they, she, here, etc". Well to fix that you include spaces " he " though you'll still miss things like typos such as he being right on the end of a sentence ".He said". Regular expression [^a-zA-Z]he[^a-zA-Z] let's you look for "he" with no excess letters on either end.
@b2gills
@b2gills 4 жыл бұрын
Actually you should be able to use \b (word boundary) instead /\bhe\b/ .
@talideon
@talideon 4 жыл бұрын
There are a fantastic collection of articles on regexes and implementing them efficiently on Russ Cox's website. They're a bit more in depth than this, but still pretty accessible, though they come with the assumption that you can read C.
@urbaniv
@urbaniv 4 жыл бұрын
You need to understand C ... Yeah very accessible ;-)
@kallewirsch2263
@kallewirsch2263 4 жыл бұрын
@Steven Tsakiris :-) C seperates the man from the quiche eaters.
@stephenarnsparger5433
@stephenarnsparger5433 4 жыл бұрын
Awesome video! RegEx are super useful!
@samsepiol6069
@samsepiol6069 4 жыл бұрын
I wish this video was up when I was studying towards my theory exam! Great video
@lawrencedoliveiro9104
@lawrencedoliveiro9104 4 жыл бұрын
7:04 Notice the only kind of recursion allowed is tail recursion-there is nothing after the B that occurs in the substitution for B itself. This can be implemented with simple iteration, without a stack. Otherwise, it would no longer be a Type 3 grammar.
@nesmaster14
@nesmaster14 4 жыл бұрын
On my lunch break and here I am watching a video on Regex...But it's by Professor Brailsford so it'll be interesting!
@sleblanc
@sleblanc 4 жыл бұрын
In languages that permit it, parser combinators allow more verbose, but still highly readable regular expression syntax: myParser = do char 'a' many (char 'b') char 'c'
@sleblanc
@sleblanc 4 жыл бұрын
An instance of (char x) is of type (Parser Char). When sequenced, the whole function effectively becomes type (Parser [Char]) which is equal to (Parser String).
@davidusnazarus1700
@davidusnazarus1700 3 жыл бұрын
I could'nt comprehend a single word in this entire video, let alone understand regular expressions.
@perladeluzes
@perladeluzes 4 жыл бұрын
Professor Brailsford, I loveeee you!!!!
@vectrex28
@vectrex28 4 жыл бұрын
I used to struggle with regex until I took a formal language class :P
@carl-marvin
@carl-marvin 4 жыл бұрын
I just tried to search a not completly readable serial code with google today, but regex seems not to be supported. So thank you for substituting my missed oportunity to revise/remember regular expressions!
@safebox36
@safebox36 4 жыл бұрын
I'm doing a lunch and learn on RegEx at work in the coming weeks...this is conveniently timed.
@iphobley
@iphobley 4 жыл бұрын
I recognise the ‘Dragon’ book in the background, but couldn’t find my copy. But I did find Bornat’s book on compiler writing.
@oliverdowning1543
@oliverdowning1543 Ай бұрын
Would these all be equivalent to BNF notation as well? Or am I misunderstanding slightly?
@dandan7884
@dandan7884 4 жыл бұрын
ill never get what people dont get about regular expressions
@josephgaviota
@josephgaviota 3 жыл бұрын
Pattern recognition is the essence of intelligence. Some people get regex, some don't. Therein lies the rub.
@The_Tactical_Taco
@The_Tactical_Taco 4 жыл бұрын
If you write the expression "abab|abbb" as "ab(a|b)b" or "ab[ab]b" it is much easier to see the way to create the state machine.
@swagatochatterjee7104
@swagatochatterjee7104 4 жыл бұрын
Few more videos and we will have Prof. Brailsford's Computerphile course on compilers.
@DerAltruist
@DerAltruist 3 жыл бұрын
Great story bud, but what are regular expressions?
@hkmp5k
@hkmp5k 4 жыл бұрын
Probably 2/3rds of my SQL or PL/SQL coding nowadays involves using the regexp_????? functions (regexp_replace and regexp_like in particular). They are so useful.
@Muzkaw
@Muzkaw 4 жыл бұрын
If you want to explain to people not knowing what regexp is, you may want to start by explaining what it is used for !!
@henry-js
@henry-js 4 жыл бұрын
I've been waiting for this video for so long!!!
@chairwood
@chairwood 4 жыл бұрын
I've always pronounced kleene the same way as clean
@profdaveb6384
@profdaveb6384 4 жыл бұрын
No they didn't get it wrong! Research shows that Kleene himself wanted it to be pronounced "Claney" but I suspect it's a Germanic surname and should be "Clay - nuh" (see Wikipedia entry for S.C. Kleene). I did devote a few mins to this in the filming session but Sean clearly had to omit it because the video is already very long at 17 mins.
@Computerphile
@Computerphile 4 жыл бұрын
Once this finished uploading have a watch: kzbin.info/www/bejne/Y4bCmJqgm7GWZ8k -Sean
@chairwood
@chairwood 4 жыл бұрын
@@profdaveb6384 wow thanks for the clarification :) that's really interesting
@hirakmondal6174
@hirakmondal6174 4 жыл бұрын
@@profdaveb6384 U are L= (knowledge)* ❤❤
@FrankHarwald
@FrankHarwald 4 жыл бұрын
so this is where kleen*ex got its name from? Asking for a friend... ;)
@ChunkyChest
@ChunkyChest 4 жыл бұрын
Omg finally I asked for this 2 years ago
@Simbosan
@Simbosan 4 жыл бұрын
Should have shown the official regexp for an email address. It's enormous
@CalvinHikes
@CalvinHikes 4 жыл бұрын
Thanks grandpa... err, I mean Professor Brailsford.
@ferulebezel
@ferulebezel 4 жыл бұрын
How about getting the Perl and Vim people to agree on what should be escaped?
@DrDress
@DrDress 4 жыл бұрын
I'm watching a series on computation theory on another channel and funnily enough he just covered some of this stuff. But I'm not a computer scientist and I still need someone tell me how this actually relates to real programming or machine design. Unless I truly wanted to build a machine that accept or reject strings of characters. But it does feel like that when I code.
@jestermgee
@jestermgee 4 жыл бұрын
Regex is something one can learn, not something one can teach.
@artit91
@artit91 4 жыл бұрын
Regexp is the shortest way(often the worst) to define state transitions.
@kebman
@kebman 4 жыл бұрын
But the most important question here is of course "Can you use regular expressions to parse HTML?"
@kranser
@kranser 4 жыл бұрын
At 07:40, how can the 3 expression diagrams be equal, one deals with capital Bs and the other 2 do not?!
@zizzu549
@zizzu549 4 жыл бұрын
Regular expressions are hard to read but on *unix you can't live without.
@bextract0
@bextract0 4 жыл бұрын
Thanks, this helped me understand a lot.
Using Regular Expressions - Computerphile
11:39
Computerphile
Рет қаралды 125 М.
RegEx Roman Numerals - Computerphile
17:14
Computerphile
Рет қаралды 86 М.
Кто круче, как думаешь?
00:44
МЯТНАЯ ФАНТА
Рет қаралды 6 МЛН
Can You Find Hulk's True Love? Real vs Fake Girlfriend Challenge | Roblox 3D
00:24
How Many Balloons To Make A Store Fly?
00:22
MrBeast
Рет қаралды 142 МЛН
УДИВИЛ ВСЕХ СВОИМ УХОДОМ!😳 #shorts
00:49
HARD_MMA
Рет қаралды 2,4 МЛН
Essentials: Pointer Power! - Computerphile
20:00
Computerphile
Рет қаралды 466 М.
Parsing Explained - Computerphile
14:58
Computerphile
Рет қаралды 246 М.
Defining Regular Expressions (RegEx) - Computerphile
18:29
Computerphile
Рет қаралды 87 М.
Optimising Code - Computerphile
19:43
Computerphile
Рет қаралды 150 М.
The Most Difficult Program to Compute? - Computerphile
14:55
Computerphile
Рет қаралды 1,4 МЛН
Why C is so Influential - Computerphile
10:50
Computerphile
Рет қаралды 1,9 МЛН
How Do Regular Expressions Really Work?
29:10
Low Byte Productions
Рет қаралды 29 М.
Computer Science - Brian Kernighan on successful language design
1:00:06
University of Nottingham
Рет қаралды 311 М.
Transport Layer Security (TLS) - Computerphile
15:33
Computerphile
Рет қаралды 485 М.
Regular Expressions (Regex) Tutorial: How to Match Any Pattern of Text
37:55
Кто круче, как думаешь?
00:44
МЯТНАЯ ФАНТА
Рет қаралды 6 МЛН