Any one of the functions shown here (image recognition, confidence with converting polar to Cartesian, solving, image processing, writing) are amazing.
Jonas G. My divider is 10 bits, so if i divide 9 by 0, the answer is (2^10)-1 Remainder 9 LOL Shit just got real... Whoever said it's impossible? They lie!
Tyrannosaurus rekt True... The next question is, what can we do with the infinite result? F**k all.... :( And computers just try their hardest to narrow it down as much as possible.... 11111111111111111111111111.11111111111111111111111111111
The first wide scan with the light sensor determines which blocks have a number in them. Then it goes back and does a fine scan on each number, then does some image processing to determine the number, like it shows in the video.
thats simply amazing. that is he single most incredible algorithm i have ever seen on such a robot. how did u create such an accurate movement, scanner, number recognizer, sudoku solver, and number writer? its amazing
you could do the reading in two steps using a light sensor. first you do a rough sweep over the entire board and record any dark regions (those contain numbers) then you split each dark region into an imaginary grid (rows and columns) and move the sensor to the bottom left of that grid (you'll probably need quite alot of whitespace around the numbers), sweep the sensor from left to right (scanning one row of the grid) and record the darkness of each imaginary grid cell. once the first row is scanned you move forward a tiny bit, scan the cells in the next row, subtract the darkness from the cell in the same column in the first recorded row(since the scanner will cover multiple rows) and record the results in the second row, repeat for the rest of the rows subtracting the darkness from the previous x rows (you'll have to tweak that number based on how accurate and close to the paper your sensor is) once all that is done you have a rough black&white image that you can clean up and work with to figure out what number it is.
As a programmer, I have a slight idea of how much work is required to scan the puzzle, resolve the OCR into numbers, apply the solver, then write the solution. I am impressed.
First and foremost, I'm highly impressed generally speaking. It's just impressive. I'm also impressed on another level that the pen didn't dry out and that the battery didn't go flat :D
LEGO Mindstorms motors have a strange "Brake" effect, where they will reverse a bit if they go too far, even a minuscule amount. The differences you see are the motors moving too far and then trying to "Make up" for it.
The high res scans of the numbers take a long time (by necessity, due to hardware limitations) . The robot only does the high res scan of squares with numbers in them. In general, harder sodoku puzzles start with less numbers. I think this means the robot will solve "harder" puzzles faster than easier puzzles.
there exist NXT programs for reading number, they just scan what the case look like and associate it with a previously entered scan of number: it makes it recognize the number
use appropriate filters like a PDI filter, it will be able to recognize the black lines a lot more accurately. If not then make the ambient light really strong so that the reflection of your sensor is less apparent.
the point of this isnt to be practical. its just to show off how someone could take a lego machine not intended for this, and make it solve sudoku puzzles and write numbers.
Nice. Funny how the bit we find hard, it does very fast but the easy bit, reading and writing take it so long. I never knew you could do stuff like this with NXT.
Pretty awesome build! But wouldn't it make more sense to have an axis for a forward movement of the arm and one for a sideways movement? I guess this would make it faster and let it write better. However, it's great and I would probably not be able to build such a machine
I'm working with these NXT bricks in my University, we're teaching school pupils how to program them from a young age, its going really well But bloody hell that program is beautiful, very impressive!
I am a currently taking a degree in programming(java) and when I see what can be done with this kind of toys I feel fascinated. I also would like to learn about robotics, in your opinion what kind of knowledge should I gain to create this type of inventions??
It would then need a way of erasing wrong numbers, writing guesses in pencil, and take about 50 years to run. Actually solving the puzzle is probably the simplest bit of this, implementing optical character recognition, and making a mechanically-scanning camera from light-sensor and a cart with a swinging arm, is genius! I wonder if the Mindstorm's CPU does the character-recognition itself? I'd guess that it does, I think they're quite powerful.
Wow, that's pretty awesome. I mean solving sudoku algorithms have been done before, not trivial and not sure how fast it would be on an nxt brick by brute force. Then there's the number scanning algorithm, I'm sure some library was used here, though still not trivial getting it to work. The most impressive part is the writing part, never thought nxt was precise enough to do printing like that. Amazing stuff.
@powwow151 with some knowledge in programming you can make the NXT regonize numbers with any type of color sensor or IR-sensor(as long as the contrast is right). I assume it creats a x/y coordinate system, ads the regonized numbers and then the missing numbers(will probably go through all scenarios before writing).
Absolutely amazing! Considering it recognises the grid and numbers with just a light sensor mounted on a scara style arm, solves it and also draws the solution. My mind is suitably BLOWWWN
I always knew the NXT system had amazing potential. Now I want to know if this sort of robot can be replicated with the EV3 system. I have yet to buy an EV3 kit, but I hear it's really good.
William Wang You're probably right. In fact, I'm willing to say you're exactly right, because since I wrote that comment, I've become aware of someone else actually doing something like this with EV3. They're even managing to program it entirely using the default programming environment for the EV3. A few weeks ago, that guy reported on the LEGO message boards that he has succeeded in programming the robot to at least be able to read the numbers written down on the paper.
awwwwwwwwwwwwwwww! aside from a couple of other, very personal family moments, I think that's the cutest thing I ever saw in my life!!! :) This is beautiful... I never knew you could so much with lego, I'm buying a set right away!
Tis cool, and I like how it can read (albeit slow :/), but what is it about Mindstormers making novel robots to do tasks that would be super fast for software to do with input from a user (e.g. entering the numbers in the grid). Even then I guess scanning the sheet and running a similar reading algorithm would do the job quickly...
Most of the time was spent by reading and writing numbers. The actual solving starts at 2:26 and ends at 2:27, so if it wasn't speed-up, it only took 1 second. I doubt you can do that.
I am very much impressed with ur project. I am working as a trainee in robotics company. I need the program of sudoko solver. Please i need ur Replay... Thankyou....
if you look carefully, you will see a lot of small moves, so it looks over small numbers for X times and makes a mix of all pictures... so i think, it is posible.
I just made my district's robotics team, and I've been doing some research by looking at web pages and videos about the Mindstorm. Call me a nerd, but this stuff is fascinating!
Hi there - I was impressed by what you achieved with this technology - I'm curious to know how easy/hard you found the number reckonision coding in the lego coding environment, or if you used a Java/C/etc api to code the box. I do have a specific task I think these things would be good at, as well as a desire to play around with the tech which seems cheap for what you get (i.e. a colour sensor, light sensor, motors, etc for less than £200)
Very nice!! Is there a specific dificulty on balancing the angular motion so the algarisms on all rows look the same? is it a physical or software problem? Congratulations anyway!
Scanning -> Thresholding - > Segmentation -> Thinning .... on a lego brick ... truly amazing :)
That moment when it suddenly yells "TWO!" ...it made me laugh for some reason x3
This Lego robot has better handwriting than mine.
Agree
Because it's a frickin' robot!!
not really handwriting because it doesn't have a hand
more like robothandwriting...?
+jayhrod26 RIGHT!!!! LIKE WHAT THE F U EXPECT
i told my dad i could do a Sudoku faster than a computer, he didn't believe me
that motor and color sensor accuracy though...
Yeah it's a pretty neat setup. I have the 2.0 version and used this program on it. It was really cool.
That awkward moment when you realise a machine has neater handwriting than you..
I agree to that
Bladesong0706 I agree too :D
marioccckc yep
XDD so true
XD
Any one of the functions shown here (image recognition, confidence with converting polar to Cartesian, solving, image processing, writing) are amazing.
Could you explain how you made the program for that? In my head that is damn impressive!
Make it divide by 0.
I made a divider, do you want me to tell you what it says when i divide by 0?
DLC ENERGY Does it say "Your human mother."?
Jonas G.
My divider is 10 bits, so if i divide 9 by 0, the answer is (2^10)-1 Remainder 9
LOL
Shit just got real...
Whoever said it's impossible?
They lie!
Tyrannosaurus rekt True... The next question is, what can we do with the infinite result? F**k all.... :(
And computers just try their hardest to narrow it down as much as possible.... 11111111111111111111111111.11111111111111111111111111111
What a joker haha xDD
The first wide scan with the light sensor determines which blocks have a number in them. Then it goes back and does a fine scan on each number, then does some image processing to determine the number, like it shows in the video.
This kind of shit is how Skynet starts.
+Arjun Randhawa laddie?
I must say, very innovative thinking. One of the best mindstorm robots I have come across. The programming must have been so hard!
Some guys have ALL the talent, show off! hehe
Wow. This must have taken some programming. Does mind storm come with ocr or did you have to do that as well?
I am just impressed by how precisely it can move and have high repeatability for a lot of moves.
Just WOW! This is genius!!! How long did it take you to program this???
thats simply amazing. that is he single most incredible algorithm i have ever seen on such a robot. how did u create such an accurate movement, scanner, number recognizer, sudoku solver, and number writer? its amazing
First phase: scanning.
2nd phase: Solving the game
3rd phase: saying game over
It's marvelous!! I can't believe that this sensor can see such small fonts properly. And the OCR!! Great job. You're my MASTER!
If you're smart enough to make this then you probably don't need it to solve Sudoku problems for you anyway.
But why do it yourself when you have robots to do your bidding?
i dont care, its cool as shit
heard about doing stuff when you come home from work because you enjoy it?
awesome comment
I thought it only ha s a color sensor, how do you use the sensor to read the numbers? Or is it another type of sensor? Very Cool
you could do the reading in two steps using a light sensor.
first you do a rough sweep over the entire board and record any dark regions (those contain numbers)
then you split each dark region into an imaginary grid (rows and columns) and move the sensor to the bottom left of that grid (you'll probably need quite alot of whitespace around the numbers), sweep the sensor from left to right (scanning one row of the grid) and record the darkness of each imaginary grid cell.
once the first row is scanned you move forward a tiny bit, scan the cells in the next row, subtract the darkness from the cell in the same column in the first recorded row(since the scanner will cover multiple rows) and record the results in the second row, repeat for the rest of the rows subtracting the darkness from the previous x rows (you'll have to tweak that number based on how accurate and close to the paper your sensor is)
once all that is done you have a rough black&white image that you can clean up and work with to figure out what number it is.
Very Cool!!
The noise it makes sounds better than most modern music.
As a programmer, I have a slight idea of how much work is required to scan the puzzle, resolve the OCR into numbers, apply the solver, then write the solution. I am impressed.
Which sensor did you use for recognizing/reading the numbers?
Great work!
MrFliederLP that would have been the light sensor
TOESKATS is that mumbo jumbo!!!
Jacob Stern yep
The colour sensor
The scanning was impressive. I didn't realise nxt light sensors were that good.
this thing's handwriting would make a good font.
nxt has a light sensor and a color sensor.you dont't have to use a "read" number option, just use a variable
when it said 2 I jumped XD
Can you send me the NXT-G program for this? It's Awesome!
If I get an EV3 for Christmas what model should I do between EV3RSTORM and GRIPP3R
EV3RSTORM!!!
+susan morrow too late I already built everstorm
First and foremost, I'm highly impressed generally speaking. It's just impressive. I'm also impressed on another level that the pen didn't dry out and that the battery didn't go flat :D
How does the OCR works ?
LEGO Mindstorms motors have a strange "Brake" effect, where they will reverse a bit if they go too far, even a minuscule amount. The differences you see are the motors moving too far and then trying to "Make up" for it.
I'll be fun to race this machine.
The high res scans of the numbers take a long time (by necessity, due to hardware limitations) . The robot only does the high res scan of squares with numbers in them. In general, harder sodoku puzzles start with less numbers.
I think this means the robot will solve "harder" puzzles faster than easier puzzles.
Fantastic.
there exist NXT programs for reading number, they just scan what the case look like and associate it with a previously entered scan of number: it makes it recognize the number
Giving a child a fish, I see...
we are programming such a roboter right now, so I can imagine how hard it was to program this. Very nice work, indeed.
HOW!?!?!
math. and lots of it :P
use appropriate filters like a PDI filter, it will be able to recognize the black lines a lot more accurately. If not then make the ambient light really strong so that the reflection of your sensor is less apparent.
Would probably be faster to solve by hand ;)
the point of this isnt to be practical. its just to show off how someone could take a lego machine not intended for this, and make it solve sudoku puzzles and write numbers.
+Shao i know, hence my smiley at the end ... ! Have a good day !
no, the light sensor, you ave to buy seperately. But you could do it with the 2.o kit probably
and i thought i was good
Anyone else smile in amazement when the robot started writing the numbers?
Its amazing how these things can solve the day-to-day routine!
that thing is neat! I didn't know which ones were there at the beginning and which ones it drew
That big program must use all of the memory on the NXT!
Nice. Funny how the bit we find hard, it does very fast but the easy bit, reading and writing take it so long. I never knew you could do stuff like this with NXT.
I really love the simplicity of the machine!
Why are people disliking this video!!?? That was amazing! Nice work!!
Pretty awesome build! But wouldn't it make more sense to have an axis for a forward movement of the arm and one for a sideways movement? I guess this would make it faster and let it write better. However, it's great and I would probably not be able to build such a machine
When I was a kid I was excited to find a cool shaped space windshield in my lego box.
they are called Lego Technique, the Mindstorm pieces only are the sensor and other stuff
You can see that it scans the numbers at the beginning using a light sensor.
I'm working with these NXT bricks in my University, we're teaching school pupils how to program them from a young age, its going really well
But bloody hell that program is beautiful, very impressive!
I am a currently taking a degree in programming(java) and when I see what can be done with this kind of toys I feel fascinated. I also would like to learn about robotics, in your opinion what kind of knowledge should I gain to create this type of inventions??
@SMK963 assuming it was programmed with NXT-G, there's a block called 'sound' where you can record your own sound or use a pre-recorded sound.
It is really cool how it can write numbers very well!
i want to see more of it running :) i like it, it'll help my mom to see if she is totally wrong or in the middle or right (or if she is 0-3 stars)
This is a perfect robot and program it perfect
It was mesmerizing to watch the robot write.
Wow. Just wow.
Nice. The OCR part is pretty slow though. Surely there are errors introduced by the need to scan repeatedly.
I believe they were referring to the programming and design of the robot.
so cool. could you please make a 'how to make' video if possible?
It would then need a way of erasing wrong numbers, writing guesses in pencil, and take about 50 years to run. Actually solving the puzzle is probably the simplest bit of this, implementing optical character recognition, and making a mechanically-scanning camera from light-sensor and a cart with a swinging arm, is genius!
I wonder if the Mindstorm's CPU does the character-recognition itself? I'd guess that it does, I think they're quite powerful.
Wow, that's pretty awesome. I mean solving sudoku algorithms have been done before, not trivial and not sure how fast it would be on an nxt brick by brute force. Then there's the number scanning algorithm, I'm sure some library was used here, though still not trivial getting it to work. The most impressive part is the writing part, never thought nxt was precise enough to do printing like that. Amazing stuff.
@powwow151 with some knowledge in programming you can make the NXT regonize numbers with any type of color sensor or IR-sensor(as long as the contrast is right). I assume it creats a x/y coordinate system, ads the regonized numbers and then the missing numbers(will probably go through all scenarios before writing).
Tomorrow are gonna be 10 years
if you made this,you are a genius
Sudoku as your homework and you have this, let the solver do it
>:3
Absolutely amazing! Considering it recognises the grid and numbers with just a light sensor mounted on a scara style arm, solves it and also draws the solution. My mind is suitably BLOWWWN
how did you get it to recognise numbers, this is possibly the best mindstorms video i have ever seen, it is awesome
There should definitely be a better scanning device like a camera above it or something. But a sudoku solver is just bizarre! congratulations.
I always knew the NXT system had amazing potential.
Now I want to know if this sort of robot can be replicated with the EV3 system. I have yet to buy an EV3 kit, but I hear it's really good.
Turnabout Akamia pretty sure u can make something similar with an EV3 brick since its more powerful than NXT
William Wang You're probably right. In fact, I'm willing to say you're exactly right, because since I wrote that comment, I've become aware of someone else actually doing something like this with EV3. They're even managing to program it entirely using the default programming environment for the EV3. A few weeks ago, that guy reported on the LEGO message boards that he has succeeded in programming the robot to at least be able to read the numbers written down on the paper.
i wonder if i can get it to do my homework
The "2" voice scared the hell out of me!
awwwwwwwwwwwwwwww! aside from a couple of other, very personal family moments, I think that's the cutest thing I ever saw in my life!!! :) This is beautiful... I never knew you could so much with lego, I'm buying a set right away!
The OCR was the most impressive part imo, which I don't think the average person would think. It's all very nicely made though.
NICE MAN I REALY LIKE THIS!!!!!!!!!!!!!!!!!!!!!
but does it also work for mindstorms NXT 2.0?
Tis cool, and I like how it can read (albeit slow :/), but what is it about Mindstormers making novel robots to do tasks that would be super fast for software to do with input from a user (e.g. entering the numbers in the grid). Even then I guess scanning the sheet and running a similar reading algorithm would do the job quickly...
This is an awesome Mindstorm robot!
Most of the time was spent by reading and writing numbers. The actual solving starts at 2:26 and ends at 2:27, so if it wasn't speed-up, it only took 1 second. I doubt you can do that.
I am very much impressed with ur project. I am working as a trainee in robotics company. I need the program of sudoko solver. Please i need ur Replay... Thankyou....
I love it's numbers!
Although it takes quite a long time (no offense) it works beautifully! Well Done!
It was pre-programed to write those numbers the NXT has no way to read numbers like that without a custom sensor which isn't shown
Please make a video how you build it. I have a project on building it and I really like this design...please
i want to build this
It takes longer to determin what the numbers are and to write them in that it dose to comptue the algorithm
What would happen if you put an impossible puzzle in front of that awesome machine?
Круто, никогда бы не додумался такую сделать!
That is an excellent job! My congratulations to you! I will feature this in my site today
The paper reflects more light then the numbers obviously its sensing the differentials between a the two
WAAAAT? FANTASTIC MAN! ;).... I think i will never do that good as you.... GJ...
That number voice scared the SHIAAAT OUT OF MEEE
AMAZING! I dune even want to know how long you need to make that x-x
if you look carefully, you will see a lot of small moves, so it looks over small numbers for X times and makes a mix of all pictures... so i think, it is posible.
I just made my district's robotics team, and I've been doing some research by looking at web pages and videos about the Mindstorm. Call me a nerd, but this stuff is fascinating!
The man had built something more clever than himself.
Hi there - I was impressed by what you achieved with this technology - I'm curious to know how easy/hard you found the number reckonision coding in the lego coding environment, or if you used a Java/C/etc api to code the box.
I do have a specific task I think these things would be good at, as well as a desire to play around with the tech which seems cheap for what you get (i.e. a colour sensor, light sensor, motors, etc for less than £200)
Very nice!!
Is there a specific dificulty on balancing the angular motion so the algarisms on all rows look the same?
is it a physical or software problem?
Congratulations anyway!