Beautifully written. However I looked at the code today and channels have disappeared. I'd be curious for a tour of the principles today for comparison, and also their philosophy about the parser.
@ScottHessАй бұрын
Probably the answer around 45m. The channel makes sense with coroutines, but once you’re completely synchronous it just adds overhead.
@РодионЧаускин2 ай бұрын
Moore Brenda Garcia Jessica White Michelle
@VickyGYT3 ай бұрын
These talks are so much better than any Cpp++ con talks...
@Cleanser234 ай бұрын
Am I the only one who doesnt love how stateful this solution is? State can lead to tons of bugs, it might be a little nicer if each state function also returned the next state of the lexer instead
@王旭东-l2h5 ай бұрын
Rob you lost your hairs...
@olaifaoluwadarasimiibikunl78208 ай бұрын
Wow! Awesome talk. Can't wait to try this out. Thanks Rob.
@aperson4051 Жыл бұрын
I'm only 20 mins in, but I'm failing to see the "beauty" in this approach. The logic is spread out over codebase. Code should be optimized for (human) reads. A single switch statement where state is kept track of reads way easier.
@aperson4051 Жыл бұрын
I have a feeling this is another case of, when a new paradigm starts to take off (the actor model) everyone wants to write everything in it, and it all seems beautiful until we actually work with it and begin to learn why this new idea is not always appropriate for every task.
@joshring8563 Жыл бұрын
Really appreciate how this talk made state machines more accessible to normal humans :)
@amiraelsayedhassan85382 жыл бұрын
Anyone else think he'll start singing Smooth Criminal by Michael Jackson instead?
@布雷-z7h2 жыл бұрын
very clear talk and the lexical scanning in golang at 2022 is very different
Why did he say the work of Michael Jackson and I immediately thought of Billie Jean
@saptarsihalder78503 жыл бұрын
what is wrong with rob pike. this guy's idea is so simple yet its like a next level powerful idea...I am just amazed by how he did the lexing...
@seltsamerzeitgenosse97973 жыл бұрын
09:26 "We could use a tool. Lex is a pretty famous one. Initially written by Mike Lesk and then redone when he was an intern by someone called Eric Schmidt." ... who at the time of this talk was his Boss (and the CEO of Google)
@mishasawangwan66524 жыл бұрын
10k loc in bash!! lol!!
@bokwoon4 жыл бұрын
So instead of the state machine being implemented as a state variable + a switch statement, it is implemented as functions returning other functions. If state A transitions to state B, it is encoded as function A returning function B.
@shakerlakes4 жыл бұрын
I love the slam against Perl at 4:32. 😉
@blizzy785 жыл бұрын
Very insightful, thanks Rob!
@robertkielty50945 жыл бұрын
The slides are now at talks.golang.org/2011/lex.slide#1
@dlwatib5 жыл бұрын
Too much audience participation without a traveling mic and without the speaker repeating what was said.
@이준범-n7f6 жыл бұрын
This is so amazing talk. thx
@shakerlakes4 жыл бұрын
He's a very good speaker. I do enjoy his talks. Even if you're not interested in the topic, you'll become interested in the topic. You come away with insights that you didn't even know you were missing before watching the talk.
@kalekold6 жыл бұрын
This is now my ideal way of writing a lexer in Go. It's such an elegant solution.
@naikrovek6 жыл бұрын
I like how Dave Chaney (now something of a Golang celebrity) is in the audience asking questions. Looks like him, anyway.
@zgmg92636 жыл бұрын
This is amazing
@hiddenbayes6 жыл бұрын
I was looking at the current version of the lexer and was surprised to find that the workaround shown at 34:23 was no longer there. Turns out that limitation (no goroutines during init) was lifted some time after this talk was presented. Here's the CL that removed the workaround: golang.org/cl/6282043
@Mike-iz9kh4 жыл бұрын
Underrated comment. Great to know, thank you!
@bokwoon4 жыл бұрын
The CL chose to revert back to the initial design because it is simpler, but the workaround is pretty simple too. In fact the workaround seems simpler than using a goroutine, because you no longer have to juggle the execution of two concurrent functions in your head: Original goroutine method: run() function keeps running in the background, occasionally pushing an item into the channel. nextItem() function will block until it receives something from that channel. Number of running functions: 2. New workaround method: Calling nextItem() will repeatedly call the state transition function until one of the state transitions pushes an item into the channel, at which point that item is simply returned. Number of running functions: 1. I think the goroutine method is just using goroutines for the sake of using goroutines.
@jnevercast7 жыл бұрын
Master of Goroutines, still can't schedule :p
@RayPereda687 жыл бұрын
This is an exquisite example of clean code. Lexical analysis code is often hairy but as Rob shows doesn't have to be. Go first class functions and slices really shine here.
@peterarnt8 жыл бұрын
Anyone know where the slides moved to? Link above does not work (i.e. linky-no-worky)
@peterarnt8 жыл бұрын
This appears to work: talks.golang.org/2011/lex.slide#1
@ilcorion8 жыл бұрын
Is there any "Parsing in GO", describing the next step -- using the channel of items in order to build syntax tree?
@Adisaboss7 жыл бұрын
The parser code is there: golang.org/src/text/template/parse/parse.go I did not find any course on the topic either, though
@MORETHANOVERGROWN8 жыл бұрын
Good talk. Thanks
@roylee31969 жыл бұрын
github.com/golang/go/blob/master/src/text/template/parse/lex.go, credits go to Сергей Линник, who had posted the link to repo somewhere in the comments below.
@stovechan78739 жыл бұрын
51:06 They wanted him to stay, be he had to Go. Should he stay or should he go? He decided to Go.
@salvezza27109 жыл бұрын
guys, where can I find go parser for parsing sql files ? because, I found only a single statement parser and one located in influxdb, but it's not what I need.
@rettberg56889 жыл бұрын
Is anybody familiar with the work of Michael Jackson? (sees a lot of hands) Good (goes right into talking about some obscure CS researcher.) This man is the pinnacle of nerd. I'm pretty sure the audience thought you were about to make a joke about thriller.
@AndyHerbert7 жыл бұрын
Jackson structured programming is hardly obscure.
@needlessoptions7 жыл бұрын
Andy Herbet Nerd
@skepticmoderate57905 жыл бұрын
Fairly certain it was a joke.
@ideaparkcc4 жыл бұрын
Go 的成功证明你就是个傻逼,事实证明了你真是个傻逼。
@bokwoon4 жыл бұрын
It was a joke and I'm so sad no one laughed! I sure did when I heard him offhandedly quip "as you know, Michael Jackson developed Jackson Structured Programming".
@someman79 жыл бұрын
A playlist with topics (preferably timestamped) would transform this video dump into an archive.
@AbhinandanNM9 жыл бұрын
Went over my head
@PriyankJainpj7 жыл бұрын
I am interested if you are still interested in helping me out?
Great Golang talk as always. I really wish people would stop using the word trivial.
@Adisaboss7 жыл бұрын
Reminds me the horrible days of Math courses: "We'll skip this demonstration, it's trivial." "IT IS? Gosh I'm lost..." I couldn't agree with you more
@catsass1910 жыл бұрын
great! this is exactly what I need
@MarcChristensen11 жыл бұрын
What happened with this module? Did non-blocking logging ever get added to the logging facility?
@julianorbach580010 жыл бұрын
No, but it is available on PyPi: pypi.python.org/pypi/nonblockingloghandler/
@lukes546111 жыл бұрын
My favourite line: “So we should write our own [lexer], because it's easy, right? Anybody can write code-especially programmers.” (11:45)
@russellchido6 жыл бұрын
@@skepticmoderate5790 lmao bf doesn't even require lexing. Each character is a token. This is the worse qualification to talk about parsing.
@kamilziemian9959 ай бұрын
@@russellchidoCan you explain this in more details?
@goncaloazevedo9822Ай бұрын
@@kamilziemian995 I think he's just saying that brainfuck doesn't need lexing, you just emit each character as a lexeme, don't know why that would make this talk bad but ok
@sirinath11 жыл бұрын
Please add part 1 to you tube also
@ServalLi11 жыл бұрын
I'd rather wanna watch this course, but I can't hear his voice clearly. The record equipment is so terrible.
@Ch05111 жыл бұрын
Why does lex() return a reference to the lexer, and not just the item channel? Is this because the lexer would get garbage collected otherwise?
@Mike-iz9kh4 жыл бұрын
You have to call the "run()" method on the lexer you get back before you would get anything from the channel. I suppose that could be kicked off inside the same lex() function, but that's not how it was shown in the talk.
@DavidFarrellEastBay12 жыл бұрын
@chuanchuanLeo, did you finish your C implementation? Is it available for viewing online? Please let me know if you'd like any assistance.
@DamienPollet12 жыл бұрын
I think we did something like that as an exercise, except each state function would directly call its successors using tail-recursion. That would have been in OCaml, IIRC…
@lisssally144512 жыл бұрын
where can i find source of this plugin?
@mrzac11512 жыл бұрын
but (and i am not saying that i dont agree with you) it is freedom of the net what do you think anonymous is fighting for (even if the gov has branded as a terrorist organization)