Пікірлер
@ghulamhussainkhansherwani6032
@ghulamhussainkhansherwani6032 6 күн бұрын
great work brother
@camjacob8876
@camjacob8876 24 күн бұрын
Second Barber
@malteiwa
@malteiwa 26 күн бұрын
thank you
@squidge2340
@squidge2340 Ай бұрын
Ai is something that both scares me and also makes me excited about the future.
@lordbuss
@lordbuss Ай бұрын
There is a Soviet movie from 1974 called Teens in the Universe. It had robots created to replace the work of humans, and make humans happy, who decided to take control of humans to fulfill their mission (and brainwash the humans by removing their negative emotions). Their catchphrase was "we will make you happy. We will make you happy" in a creepy monotone voice. I think this movie does a much better job than most mainstream Hollywood movies (maybe Space Odessey?) at depicting the more realistic problems with AI alignment (instead of "AI is inherently evil" or "inherently selfish (because it is self-aware or emotional)"). 4:16 The problem is not being too logical. The problem is the clarity of direction. An AI would do the things it is directed to do, and not thing it was not directed to do. Arguably, an AI that is more logical would be *better* at figuring out, for example, what humans need when they ask for things. And technically, humans also don't always understand what other humans need. It's just that with powerful AI, there is much less margin for error. It's possibly to program empathy into AI, i think. It would necessarily have good results, at ensuring it actually does good things for humans. A lot of humans have empathy and use it to, for example, save me for my decisions that they decided harm me. Like, i don’t know, being an atheist, or smoking weed. Also, logic is not the opposite of empathy. That is a very basic fallacy. 6:48 The energy source doesn't make sense, and contradicts the laws of physics. In the original script of the movie, humanities brains were used as a source of computation. Which *theoretically* makes sense.
@marmosetman
@marmosetman 2 ай бұрын
What do you mean it doesnt have enough energy to go to the flag. No mayter how much back and forth motion it does, the energy requirement to move up to the flag is still the same.
@ga8r0
@ga8r0 2 ай бұрын
I discovered your channel tonight and already seen most of your videos. Really a good work, keep it up 💪🏻
@michaelomglol
@michaelomglol 2 ай бұрын
Thanks for this video, helping me a lot with my uni work
@carmellafoster8054
@carmellafoster8054 2 ай бұрын
Codependent motion. Since the larger circle encompasses the smaller, the distances become equal.
@kmishy
@kmishy 3 ай бұрын
very well explained
@TheFuckel
@TheFuckel 3 ай бұрын
Is it correct that sarsa with greedy policy that choses action that have max value is equal to q learning?
@jonaskarlsson5901
@jonaskarlsson5901 4 ай бұрын
does this mean it's not even using a neural network?
@manuelabarcacrespo8298
@manuelabarcacrespo8298 2 ай бұрын
Q-Learning dont use neuraln neutworks, its a table that the agents learns to complete and then uses to solve a problem
@jonaskarlsson5901
@jonaskarlsson5901 2 ай бұрын
@@manuelabarcacrespo8298 is Q learning also used to generate the training data for an NN?
@AsmageddonPrince
@AsmageddonPrince 4 ай бұрын
I don't feel like I understand the principle from your video- what is the purpose of partitioning the state into tiles? How and when are they assigned a Q value and when is it modified? Are the Q values just zero during the first epoch? Does this work for larger state spaces? Does the agent really learn anything substantial from a replay of a 40k steps Epoch?
@marcuskoseck98
@marcuskoseck98 4 ай бұрын
I partition the state into tiles to make a function that relates states with q-values. Think of it this way: I need a relationship between states and future returns. There is no obvious function I can think of to do the job. Instead, I break state space into squares (partitions) and assign that square a random q-value. This is initialization. As the algorithm learns, the q-value will be more representative of the actual q-value. This method doesn't work for larger state spaces. At that point, you would want to use a neural network. For this specific reinforcement learning problem, 40k steps can be helpful in the beginning for exploration. If your algorithm is taking 40k steps after a few thousand epoch, that's the sign your parameterization may be incorrect. Hope this helped!
@gabrielgeller6953
@gabrielgeller6953 4 ай бұрын
The simplest explanation!
@Zetesee
@Zetesee 5 ай бұрын
Hey Marcus. I hope this message finds you well! I recently discovered your KZbin channel while scrolling homepage and found your content to be amazing and incredibly helpful. I have a cooperation proposal for you and would love to discuss it further. Please let me know if you're interested! It will be great if you will give me an email address to send the details.
@ponmuthu..4796
@ponmuthu..4796 5 ай бұрын
notebook ?
@marcuskoseck98
@marcuskoseck98 4 ай бұрын
I will (probably) release a notebook when I get closer to a finished product.
@ponmuthu..4796
@ponmuthu..4796 4 ай бұрын
@@marcuskoseck98 ok
@misnad
@misnad 5 ай бұрын
Good try.
@siddharthvj1
@siddharthvj1 5 ай бұрын
mnist
@onceappuonatime
@onceappuonatime 5 ай бұрын
Helpful, thank you!
@zax6460
@zax6460 5 ай бұрын
I love this! I have been making some of my first bots for games like tictactoe and gomoku in a more traditional way with minimax and stuff like that but i am also looking forward to tackle these kind of learning models as well. you deserve more views.
@lblonzypoi
@lblonzypoi 5 ай бұрын
All circles are proprtionate to each other, by having a fixed centerpoint for both you will have a fixed length for a single rotation because the length between the centerpoint and the surface being rolled upon is the same, youre essentially fixing a varible wich changes the path of movement, try taking to circles, one large one small that can fit in it, roll them both one rotation seperately with thier edges both touching the surface, you will absolutely have 2 seperate lengths
@danichef
@danichef 6 ай бұрын
could you please do a video for monte carlo for chapter 5 from the reinforcement learning book (Sutton) you use please? Got an exam soon and would be of great help. Great videos!
@mechtorious
@mechtorious 6 ай бұрын
I think the distance is not the same. Rather the displacement is the same. So the distance is different for same time period, hence different angular velocity.
@YvonneMayfield-ti2fv
@YvonneMayfield-ti2fv 6 ай бұрын
Before watching the video, I don't know how to prove it mathematically but I think it's because the small circle is within the larger circle and you're talking the dot through a shorter path since it's not rolling flat. It's going to be slight higher when the the larger circle is on the table and when the dot on the larger circle reaches the peak, the smaller circle dot is lower. Therefore slightly shorter path
@camasalan3636
@camasalan3636 6 ай бұрын
Why is he dividing by 2pi. It's just divide by 2 to get the radius, why are you involving pi
@Red-se9bq
@Red-se9bq 5 ай бұрын
Circumference=2πr
@iony_mikler
@iony_mikler 6 ай бұрын
This is very cool progress do u have a code repo for your learning?
@marcuskoseck98
@marcuskoseck98 4 ай бұрын
Honestly, I have a bunch of code stored on my computer for various projects. I need to organize the code and upload them. Eventually, I will upload code.
@O-Kyklop
@O-Kyklop 6 ай бұрын
Yes, the cycloids. But, you forgot to see that by a rolling of 360° the smaller perimeter is covering the same linear distance as the bigger one. It means, both perimeters have the same length as the straight distance they cover with a 360° rolling. This is a big problem.
@officialVduxs
@officialVduxs 6 ай бұрын
plagiarism means the use of another's work, words, or ideas without attribution. key word is another. i would consider another as someone with a conscious mind or thought and would argue that ai is not conscious yet. meaning no plagiarism hasn't occurred.
@sohamprajapati8784
@sohamprajapati8784 7 ай бұрын
Nice job! Helps my understanding. Keep making such videos.
@almonteros
@almonteros 7 ай бұрын
Nice.
@muslumyildiz5694
@muslumyildiz5694 8 ай бұрын
Thanks
@golden4910
@golden4910 9 ай бұрын
i love u man
@viralshorts9596
@viralshorts9596 9 ай бұрын
this really boosted my understanding
@Rody2013
@Rody2013 9 ай бұрын
Thank u for your explanation, keep posting us more videos please! ❤
@lompeluiten
@lompeluiten 10 ай бұрын
what moves more? The centre moves an little. The outerlayer moved an lot more. So they don't go the same speed
@ZZeta83
@ZZeta83 10 ай бұрын
This is the same phenomena as rolling a coin around another coin. The distance and number of rotations is related to the distance the center of the circle travels. Also the two circles, which are connected have the same angular velocity, but different linear velocities. The difference in linear distance can be accounted for by observing the path a single point on each circle takes, called a cycloid. Looking at the two cycloids, it is clear that the point on the inner circle travels a smaller distance.
@kokoshsmusic967
@kokoshsmusic967 10 ай бұрын
Because of the gravitational acceleration do the same in space see the outcome 😁👍
@rossodonnell5933
@rossodonnell5933 10 ай бұрын
Dummy-proof explanation for a helicopter pilot = Same RPM, Different velocity.
@marcusnielsen9674
@marcusnielsen9674 10 ай бұрын
Think about the angular velocity and tangential velocity and compare them. The large and small circles have the same angular velocity, because they both do a full rotation over the same time. However, for that to be the case, they must have different tangential velocities, as their diameters are different. Since the large circle is travelling along a linear path, its tangential velocity will determine the distance, and the small circle will have a lower tangential velocity, making up for the “missing” distance the inner circle has to travel.
@marcuskoseck98
@marcuskoseck98 10 ай бұрын
Both circles are attached, travel the same distance after one full rotation, and have different radii. Also, both circles have the same tangential velocity. I think your comment perfectly captures the paradox.
@SteedDigital1
@SteedDigital1 10 ай бұрын
Because they're connected. If you took a 5mm wheel and a 10mm wheel and roll them along a table the 5mm has to do more totations. But now if you put the 5mm inside attached to the larger, like a hub for example it's elevated above the rolling surface by the same amount all the way around as they roll together.
@marcuskoseck98
@marcuskoseck98 10 ай бұрын
That's true! But what does it mean for the trajectory of each circle? If they're attached, how does the smaller circle reach the end point despite being smaller? Aristotle's wheel paradox is what I explore in the long form version of the video. I could have phrased the paradox better in this short video.
@olivierdulac
@olivierdulac 10 ай бұрын
It travels more by each rotation because it is being brought along by the outer circle. Take the inside circle to the extreme by making it almost like a point, with a 0 radius or close to it: its own rotation don't travel much (or not at all if radius is 0) and the rest of the travelled distance comes from being dragged along by the outer circle's rotation.
@rishavnandi6697
@rishavnandi6697 3 ай бұрын
​@@olivierdulacmy friend u r just partially correct about it but what u r saying isn't proving the point. The exact maths behind it is if u compare it with respect to the linear velocity of the 2 circles, the inner circle travels at a faster speed compensating it for the excess distance. Think of it this way, a large rotating disc, if u touch the innee regions of it feels much faster compared to if u touch the outer regions.
@kedarshiralkar1099
@kedarshiralkar1099 11 ай бұрын
woww, nice visualization and explanation, keep on making more vidoes, u deserve many more views, good luck!
@rogerperez6576
@rogerperez6576 11 ай бұрын
Nice explanation
@DC-rk6xf
@DC-rk6xf 11 ай бұрын
Thanks for this introductory video. It helped me a lot.
@Royal--00
@Royal--00 Жыл бұрын
Wow I never thought about it like that! Cool video
@aleksantoniak5448
@aleksantoniak5448 Жыл бұрын
Hello, where could i find code for that?
@marcuskoseck98
@marcuskoseck98 Жыл бұрын
Hello. My github has the code under the "SARSA-and-Q_Learning" tab. Link to the github page is in the description.
@Royal--00
@Royal--00 Жыл бұрын
Very interesting!
@BPEMETO
@BPEMETO Жыл бұрын
Nice video! Thanks! : )
@williamorrick5348
@williamorrick5348 Жыл бұрын
I've never understood the cycloid explanation, although I've heard it goes back centuries. Just to have a concrete set-up, let's divide the wheels into 360 sectors of 1 degree each. Let's further suppose that the larger wheel has a circumference of 360 cm and the smaller a circumference of 180 cm. So each 1-degree sector corresponds to 1 cm of circumference on the outer wheel and 0.5 cm of circumference on the inner wheel. The outer wheel rolls along a 360 cm long track and, at the same time, the inner wheel rolls along its own (real or imaginary) 360 cm long track. Let's mark off 1cm intervals along both tracks. We might even number the intervals from 1 to 360 (from left to right, with the wheel starting from the left end), and also number the sectors of the circumference (in the counterclockwise direction starting from the initial contact point) from 1 to 360. Here's how I see the paradox (and I think this is essentially how it is stated in the original Mechanica text): as the outer wheel rolls, first the 1 cm long sector #1 of the outer circumference contacts the 1 cm long interval #1 of the track, then the 1 cm long sector #2 of the outer circumference contacts the 1 cm long interval #2 of the track, then sector #3 contacts interval #3, and so on for all 360 sectors. At the same time this is happening, first the 0.5 cm long sector #1 of the inner circumference contacts (the whole of) the 1 cm long interval of its track, then the 0.5 cm long sector #2 of the inner circumference contacts (the whole of) the 1 cm long interval #2 of its track, then sector #3 contacts (the whole of) interval #3, and so on for all 360 sectors. I think a paradox arose in people's minds because they could perfectly well visualize the matching up of 1 cm outer circumference sectors with 1 cm track intervals as the wheel rolls, but they had a hard time understanding how the 0.5 cm inner circumference sectors could match up with the whole of the 1 cm track intervals in a smooth and continuous way. After having thought through the problem in detail I personally don't see any difficulty, but I think I do understand people's initial discomfort. Now if you agree with my framing of the paradox -- and I do believe it's true to the original -- how does drawing cycloids and curtate cycloids help resolve it? The paradox is concerned with what's going on in at the points of contact of the two wheels with their surfaces. If we put red dots in sector #1 on both circles, the cycloid and curtate cycloid show the movement of the red dots, but most of that movement takes place far from the contact point. (The red dots come back to the surface only once per revolution.) To understand the paradox don't you have to examine carefully how things are moving at the point of contact? This involves a succession of different sectors, not one single sector. Also I don't understand how you can go from "the red dot on the inner circle travels a more direct path through space than does the red dot on the outer circle" to "the inner circle travels a more direct path than the outer circle". I don't see the path of the circle and the path of a point on the circumference as the same thing. But the more important point is that the paradox is concerned with matching, not paths. It's concerned with the matching between circumference intervals and track intervals.
@IAMACollectivist
@IAMACollectivist Жыл бұрын
The bigger circle is taking the snaller one for a ride. Its being carried forward at a faster rate than it would if it was driving the rotation.
@pargolf3158
@pargolf3158 Жыл бұрын
Aristotle musta been drinking the day he got stumped on this. The inner circle is attached to the outer circle that's why.