Easy Arduino Data Logging and Telemetry

[@breakthebreak966]

You have no idea how helpful this is. I've been searching for a month for this exact video.

[@movax20h]

Good design. Few suggestions: 1) Time instead of samples on x axis. Either absolute time of a day, or relative time from the start of measurements. 2) When reading from serial also dump data in parallel to a file (or files) for offline analysis with other programs. 3) Ability to have multiple different time bases on different charts. I.e. one showing only last 60 seconds, and another showing same data from last 6 hours, with decimated data (min/avg/max).

[@DataLog]

We had a strong earthquake in Croatia, and we don't have money for decent seismology equipment. (it is sad because Andrija Mohorovičić was born here..) Your software will help us to build a web of smaller stations all around the country and track the data. I am planning to upgrade our meteor web (Visnjan Observatory started a project of tracking meteors with web of cameras all around the country years ago). We have 24/7 running servers and cameras on 350 locations. We will now start upgrading those stations to track earthquakes and I will personally make sure that as soon as this project gets going you receive as much money as possible. Thank you very much!

[@Reesespeices918]

Thank you so much, I've been looking so long for this explanation

[@sobreviviendoalau8499]

i signed up just for leaving my like. THANK YOU SO MUCH!!!

[@tomcarroll6744]

Very nicely done. I'll give it a try. It gave me an idea on how to think about my data differently. Helpful for us if you make the code bigger to see from our end.

[@Taran72]

Thank you very much for sharing this! I've been looking around for something like this. I tried to do it on my own but didn't succeed. :) You are the best!

[@burgulize]

This is amazing! Thank you so much for sharing and explaining , you earned a huge like! I wish my java teacher would have implemented something like that to spice up the boring projects he gives us!

[@upgrdman]

Thank you!

[@ollydsouza]

Very useful for a student comparing data transfer speeds!

[@rafaellucas8268]

This is amazing! Thanks for sharing this with us!

[@freeelectron8261]

Very impressive - that must have been a lot of work and time to write . Well done Mr upgrdman!

[@anadack7878]

Thanks you so much !! the world need guy like you

[@VoeViking]

Thank you for sharing and taking the time to make the video.

[@herrkronen9694]

This is not easy at all .. But is amazing!, great programming work ! This inspires me ti keep learning !

[@upgrdman]

Thanks for the kind feedback! Good luck with your projects.

[@leisryan]

Awesome Project...! Clearly laid out...! Thank you for this..!

[@fabienherve5565]

What an amazing soft ! This is exactly what I'm looking for. Thank you so much for this and for your tutorial !

[@rorythompson1070]

Thanks so much, been looking for something like this for ages!

[@nielspaulin2647]

Absolutely EXCELLENT !!! You saved me a lot of time. Thanks a lot.

[@omgkingdano]

This looks like a really great application. Well done!

[@bluehornet6752]

That's bad ass man. Incredible application!

[@samadkhan295]

dude u just made my day love u man...

[@brucea4185]

Awesome app. Thanks. You cleared my thirst from Arduino's serial plotter. Only daring wish is; it would been nice if there was a way to clear data while app is still up.

[@RikerRC]

This is awesome! Thank you for sharing this.

[@gregor.potrebujes]

Beautiful work mate! Thank you for sharing this!

[@PCJAVH]

Muy buen código, simple y concreto. mejor no puede estar. Muchas gracias por compartir, Saludos desde Colombia.

[@penguin0123]

Hey John, podrias ayudarme con algo, por favor? Gracias

[@ECE_Engineering]

Thank you so much. It was something I was looking for. Your work is commendable.

[@paulrobion]

Thanks for this amazing job !! Exactly what I was looking for, even better !

[@DaKILLaGod]

well, i have written my own in python few days back... :-D thanks for sharing video of yours as the inspiration is mind blowing! :-D

[@TheJenkins124]

Awesome video and program.

[@ruslan.zhumabai]

I cannot open the file. Could you help me? Maybe my laptop requirements some settings for opening java file.

[@Elad6k]

That is excellent!!! just one thing missing... connect it to a rtc

[@dileepsenevirathne4329]

DUDE This is awsome!!!!!!!!!!! Thank you for sharing keep up the good work.....

[@danielmacedovilca7820]

Really great job. Greetings from Perú

[@ehsanrohaimi8647]

hi, thanks for sharing. can you specify the data that collected from sensor and equation you used to plotting the graph ?

[@thescienceysworkshop5368]

wow bro!! this is amazing .. we can use this technique in model rocket for seeing the performance of the rocket

[@su18ku12]

The Real MVP!!! Well done!

[@brettlowery461]

Brilliant, and thank you for sharing. Hopefully I can get it working

[@patrickrooney8225]

I hope someone can help me out. I am trying to run the .jar file for this software on windows 10 but will not run on 2 different computers. Double click and nothing happens. I have even install the newest java RE and also tried SDK. Help!!!!!

[@neododo]

how I adjust size of windows, because in small monitor don't show all information. Great work

[@RafaelAlmeida-sl7ef]

Excellent work, thank you for sharing.

[@MegaJoe78]

Hi , great video . Is it possible to log normal rs232 data ? For example . Communication is based on standard RS232 at 19200,n,8,1 .Each data frame consits of 5 bytes typdef struct { ubyte channel; ubyte idChar; ubyte valueH; ubyte valueL; ubyte checksum; } Ive all the needed data . Thanks

[@hamzahansari6900]

Hi there, this is very amazing, the effort, the explanation everything, and pretty useful too! Thank you very much for this. I have one question, how can i see the saved values? I am reading battery voltage every 5 minutes from a 48v system, and saving it in an SD card, and i want it to display the graph of a whole day or so. Thanks again.

[@alinursu9685]

Hello! I can’t run the jar file, can anyone help me out?

[@leandrohugosobrino7741]

Hi, nice project. Is it possible to add Time stamp of computer in X-Axis ?

[@lukievanniekerk4362]

Amazing just what i needed. Thank you so much for the great work. Just one thing how do a add distance and time + speed. Using rotary encoder for speed and pot for distance.

[@uj_tech618]

this made my day!! great work thumbs up :)

[@roxenhs6407]

Amazing work as usual. Just got exactly, what I need. Bundle of thanks.

[@upgrdman]

Thanks for the kind feedback.

[@kimholtz6466]

Thank you very much for sharing......great tool !!!

[@jonvassella1076]

terrific video - thank you very much

[@silentgame8702]

In version 0.6 the screen does not update itself, it is frozen, it is necessary to open a menu so that the time advances on the graph. You can help?

[@fabiov6399]

Thanks for your amazing software. I'm using it to monitor my little greenhouse. Just displaying some moisture, temperature and humidity values. Any chance I can modify it to have the time stamp instead of the sample numbers?

[@francuadasilvacosta5116]

I'm having a problem I think it could be a configuration connection always appears lost what could it be? I'm just putting a potentiometer to test.

[@noushikhsanju8721]

hey it have a saving data mechanism means lke edr(event data recoreder)

[@dipakvarade9212]

Thank you for such a great tutorial. Can you tell me how can I do this telemetry using Esp 8266 (wireless one) rather than using com port(wired one) Thanks

[@vict456]

Thank you so much for sharing you software and code. Just a question (from a java noobie), if i want to make a botton/command that "start" and "stop" the data aquisition for the plots so that i can save then, it would be a simple modification in the code? Thank you again for the work and video.

[@upgrdman]

Just disconnecting and reconnecting to the serial port should do the trick.

[@Lucash90]

Hello! Thank you for sharing this with us, it's very interesting. I would like to ask a beginner's question, the sample code with an "analogRead" I understand, but I have difficulty applying it when the signal is digital. A simple example, when I use an HC-SR04 (distance) sensor, I have a "digitalRead" and I also need to calculate the distance. (distance= int (0.017*time) I tried different codes, but to no avail. Thank you

[@alexandracotoranu646]

I am doing a project based on the transmission of signals through telemetry and your program helps me a lot. By means of the fourier transform, the signal can be visualized in a different way compared to the time domain, for example, or is it also the final form of the information?

[@adlenenafi9976]

you saved me man, thanks a lot

[@chenartahir1865]

Hi. I would like to monitor of 15 sample of MFC for voltage and current for 40 days continuous . How can i do it?

[@oliverpineda7470]

Is it possible to change the code so it will receive from the serial port String values such as the name of a team or some status sent from an arduino in csv and making some filter to save that string values on some database without adding them in the graphs because they will make the program crash?

[@ujwaljoshi3007]

How did u sperate the csv data from arduino?

[@nathanielmcintosh8846]

@upgrdman how do i read the sensor output remotely or wirelessly?

[@drfdfe]

Nice job! Looks like a handy tool. Thx..

[@johnganci933]

Just downloaded TelemetryView_v0.6.jar from www.farrellf.com/TelemetryViewer/ and am trying it out. Ran into a few issues. My PC is running Fedora 30 Linux. Screen resolution is 1600x1200. 1. The initial window is wider than my screen. When attempting to resize the window, it will only resize the top and bottom -- left and right sides will not resize. In order to get to some of the buttons on the bottom, it is necessary to click and drag the window left or right. 2. When entering the initial information for the column names, I accidentally entered the same name and color twice. Did not see how to edit the information. Is there a way to do so? (After typing this entry, I looked at issues on github. Issue #23 may be this item.) 3. After getting all the columns set up and connecting to my Arduino, got a window with the chart in the middle, "Tile Columns:, Tile Rows:, 5 buttons" on left side, "Datasets:, Duration:, etc" on the right side, and a "Done" button on the right side. Nice! Pressing the Done button hides the right side but not the left side. Should it also hide the left side? Also, this window is wider than my screen and will NOT resize along the width -- only the height. 4. The Arduino data is the result of a KZbin tutorial series. Each episode may add additional data to be plotted, so new columns will need to be added. Item 2 above indicates to me that this will not be possible -- I will have to reenter all the column data from scratch. Is this true? You've produced a great program. It appears to provide what I need.

[@penguin0123]

Hi. The gyroscope data in CSV file, I mean gy, gy, and gz, can be set each one in columns? Thank you.

[@mujtabamohammed2530]

Can you provide a schematic of your Arduino and sensor setup

[@MeseretNigatie]

Farrell Farahbod, thank you for your effort and time to code and to make this video. I went through the code and it is amazingly coded. I have some questions if it's not too much to ask. First of all, do you think it is possible to add more codes to include bluetooth device on the communication module?? I do not want to mess the beautifully crafted code. The second is, is it possible to calculate some parameters on the fly for example (velocity, displacement etc from the real time data) received from the comport and plot them?? I know it is possible to calculate on the arduino and send them, but one of the real challenges for wireless communication especially bluetooth is data rate. So is it possible to receive like two or three parameters, calculate some more quantities from the received data and plot in real time??

[@meierthomas]

How is the data cached? Say I plot a temperature graph over a week and then want to switch over to another set of sensors. Can I download/extract the data and reuse/resume that data set if I want to come back to that temp sensor for another set of long term measurements? Is this done through a combination of layout/CSV log?

[@upgrdman]

The layout file stores all of your settings, and the CSV file stores all of your data. You need both files if you want to replay them in the future.

[@RovanRCTube]

I need to find a way to capture the oscillation point of a moving object. To visualize this, Picture a rail with a distance sensor at each end. The target would oscillate between the 2 end points with the center being 180. To the left the max measurement would be 270 and max 90 to the right. When the target moves to the right then switches direction I want to capture the farthest measurement lowest number serial data to trigger a device when the target is at a certain point on the left. Then I want to capture the oscillation point highest number on the left to in turn trigger the device at a certain point on the right. Due to changing loads on the device being triggered the oscillation points will change randomly. Can this be done? Below is a rough draft of comments without any code. //Arduino uno // vl53l0x sensors // distance sensor1 value 181 to 270 degrees //distance sensor2 value 179 to 90 degrees //1 stepper Nemo 17 or 23 //Stepper full rotation 0-359 steps (clock wise count 0 north) //Home 180, max rotation from 270 to 90 degrees. // orientations. 270 right, 90 left. //sensors placed at the ends of a rail with oscillating target. //if sensor1 value oscillates set sensor1 to highvalue of oscillation Oscillation at 172-173-172 would set value at 173 // if sensor2 lowalue is = 178 // run stepper to 183 when sensor1 reaches 182 //1degrees // if sensor2 lowalue is =177 // run stepper to 184 when sensor1 reaches 183 // if sensor2 lowalue is =176 // run stepper to 185 when sensor1 reaches 184 // if sensor2 lowalue is = 175 // run stepper to 186 when sensor1 reaches 185 // if sensor2 lowalue is =174 // run stepper to 187 when sensor1 reaches 186 // if sensor2 lowalue is =173 // run stepper to 188 when sensor1 reaches 187 // if sensor2 lowalue is = 172 // run stepper to 189 when sensor1 reaches 188 // if sensor2 lowalue is =171 // run stepper to 189 when sensor1 reaches 188 //Etc....... to lowvalue of 90 //use < at end max run to 270 //If sensor 2 value oscillates set sensor2 to lowvalue of oscillation Ocilation at 186 - 185 - 186 would set value at 185 // if sensor1 highvalue is 182 // run stepper to 177 when sensor2 reaches 178 // if sensor1 highvalue is 183 // run stepper to 176 when sensor2 reaches 177 // if sensor1 highvalue is 184 // run stepper to 175 when sensor2 reaches 176 // if sensor1 highvalue is 185 // run stepper to 174 when sensor2 reaches 175 //Etc........to highvalue of 270....... //use > at end max run to 90.

[@GiveForaSmile]

Very nice software, thanks!!

[@fasiltilahun8782]

can u develop fishfinder by using ultrasonic sensor datapresentation with netbeans

[@Livevvire9]

excellent tutorial. thanks for sharing. i used this for the string if helps anyone Serial.println(String() + sensor1 + "," + sensor2 + "," + sensor3);

[@someshwaran27]

Hi i am using Lora to transmit the data and receive i need to telemetry the received data , how to separate the data and telemetry

[@ZestyMuffins]

This is really cool. Thanks for sharing

[@chrisdockman7237]

My only question is, will there be a way to record the data? I need to store the data. I have CoolTerm which can record the data but the serial bus won't allow CoolTerm the access the data while telemetry Viewer's open. Hmmmmmmmm, I'm one step closer to ditching labview and Matlab.

[@ammaralghasra9744]

I have a problem installing the software, can anyone help please?

[@nartymmd]

Can I assign an vibration/accelerometer instead of sensors You are using ?

[@meierthomas]

Great way to visualise and understand data - I especially like the different ways to scale so that you may be able to look at data over a particular period of time. Saw on the connection preferences that other than COM ports you also support UDP and TCP methods. Do you have any code samples to use these options? Your robot would've used either I figure

[@meierthomas]

Hey, just found the answer in another of your great tutorials. So all good :)

[@deogjoonlee7279]

I got a warning message which is "Serial connection lost". Please let me know how to connect with my Aruino Serial Monitor. Sample rate, ASCII type, COM port, Baudrate and Arduino sample data are OK.

[@conradsinsua7415]

This is crazy awesome , got it going in no time, how do i store the data when hook up to a laptop?(very new to this)

[@navZ888]

can we save the data obtained in that session with precise time of reading. The saved data could be post processed later whenever needed.

[@upgrdman]

Yes, the data (with timestamps) can be saved to a CSV file. Just click the "Export" button.

[@meryemlaamim6996]

Thank you for sharing with us this amazing program ! i used this program to visualise graphs of an 3 axis accelometer and it works very good but i have a question why fourier transforms is shown up with power(watts) ? (i will be so grateful if you answer my question)

[@Getlofi]

your software looks great! sorry for a dumb question, but how can I make it work with a wifi sensor?

[@upgrdman]

Thanks. TCP and UDP support is planned, but that is not yet possible.

[@mohamedkhaled-qc7kb]

after downloading software there is no file .exe to open the program but there are some folder and some file start with dot

[@javierrinaldi8941]

this is really cool, but i just need a simple window with a six sensor chart, like the frequency domain one. Wich is the most simple way to use this awesome code to iclude it in my window??

[@upgrdman]

Thanks. It's not written like a library, so it won't be easy to integrate into other software. It might be easier to find a chart library for whatever programming language you're using.

[@muhammadaitzazabbasi9817]

Actually I am sending Frequency and voltage data of my sensor on UART using ARM cortex M7 controller. Is it possible to plot voltage according to my frequency data using telemetry view software. if yes then how i can ??

[@fritzschnitzmueller3768]

So you use one thread for each chart?And i suppose you use one or several other threads for data processing / serial port reading?Or are you doing this event based? Whats the max number of charts you can create without starting it all to lagg? And what is the maximum datarate you can achieve with your approach? And was there ever a problem with the arduino not sending data fast enough?

[@upgrdman]

Starting with version 0.2, I switched to OpenGL. One thread to process received data, and another thread handles all of the charts. The main limiting factor is how many samples you visualize, not how many charts there are. On my laptop I can visualize over 500k points at 4k 60hz if antialiasing is enabled, and many more if it is disabled. Your Arduino can send data at any rate. With other microcontrollers I often send more than 10k samples per second.

[@valmirbiazoto9263]

is there any way to make this app saving CVS data for a long period of acquisition? maybe saving every 24 hours automaticaly

[@oentronicneotronic9153]

Hello, I'm happy that you alwas uploading your telemery viewer! Relly good job Woult to be possible to change the BACKGROUD Color to black?, It will look even better at night.. thanx

[@imranshaha5933]

I was trying to read excel data using arduino(numbers only) ,how i can do this?

[@jespernygaard9630]

Fantastic, thanks for sharing! With you presentation and excellent videos I have this up and running, but I have a question I hope you will help me with. I would like to change the "monkey.stl" to represent my own shape. I have made the STL file, tried to call it "monkey.stl" and replace it in the recourse folder, but id does not work. I have also tried to change the filename in the program code, but no luck, just gray screen. Is it a special type of STL file or do you have any idea about how to make it work? Thanks in advance and once again thanks for sharing.

[@upgrdman]

The STL file needs to be the ASCII type, not binary. More details are in the source code comments: github.com/farrellf/TelemetryViewer/blob/master/Telemetry%20Viewer/src/ChartUtils.java#L409

[@evertkramer7518]

sprintf does not work with my Arduino uno. However Serial.println(sensor1); gives a reading.

[@hanshundscheid6284]

Installed Telemetry Viewer 08 after installing JAVA8, all works, except I do not get the "tiles" with the dotted lines. Everything else seems to work great, connect to correct COM port, setup data structure etc. I just have a grey screen with the bottom fields displayed. Any idea why I cannot see the dotted lines? Thanks for a potentially great program.

[@upgrdman]

Hi. The newest version uses some features from Java 9. It should work properly if you upgrade to 9 or newer.

[@hanshundscheid6284]

@@upgrdman Great, that did the trick. Now it works just as I wanted to, so well done! Hans.

[@pauloliver1221]

Is it possible to use an existing CSV file for input to this?? I really like the effort you have put into this and it would be great to have the ability to view the data after the logging session. I

[@upgrdman]

Thanks. That's planned, but not yet possible.

[@bobsponge9792]

Just what i need :D, Thank you so much !!

[@stevenmarshall8639]

hello. is it possible to upload a jar executable file to an Nextion HMI?

[@saneemp]

Good Piece of work and software, which charting library is used

[@upgrdman]

Hi. "Time Domain Cached" and "Statistics" were written by me. "Time Domain", "Frequency Domain" and "Histogram" use the JFreeChart library.

[@saneemp]

Thanks Buddy

[@edgaromarreynatorres3940]

If I use another microcontroller, how do I know which port it uses?

[@kngdrby]

Thanks a lot for this incredible tutorial. But i can not the telemetry program by double clicking after download from the website you share. Is there any problem about program .jar file? Can you explain me how run the telemetry program?

[@upgrdman]

Do you have Java (a JRE) installed?

[@kngdrby]

Yes i have the last java version.

[@slimx4u]

Amazing and flexible program. Thanks for sharing it! Do you use the serial-comm library for Java as in one of your previous videos?

[@upgrdman]

Thanks. Yes, I am using the same jSerialComm library as before.

[@slimx4u]

Thank you! :)