Easier Arduino Telemetry and Data Logging

In this video I show the fourth version of my Telemetry Viewer software. This version focused on making things easier for the user:
Arduino sketch templates are now generated based on your data structure.
Chart settings go into effect live while you create new charts.
Those settings can also be changed after the charts are created.
A cleaner "tile" theme instead of plain white rectangles.
The GUI now guides the user on how to connect and how to place charts.
Updated web site to make it easier to find new versions and read their changelogs.
The charts themselves (line charts, Fourier transforms, dials, quaternion visualization, etc.) have not changed.
Download the software and source code here:
www.farrellf.co...
github.com/far...
Telemetry Viewer is free and open source. If you find it useful and want to "buy me a coffee" that would be awesome: paypal.me/farr...

[@consciousenergies]

I cant thank you enough my friend! You are doing a great service for many makers, and it is very much appreciated.

[@da.b3102]

So useful to me 3 years later, havent found anything better than this, works like a charm, thx u sooo much!

[@AvinashtheIyerHaHaLOL]

Amazing program. Really appreciate this. A couple of suggestions, that others may have commented too: 1) Export of processed data.. like frequency domain etc. 2) Ability to replay the data .. i.e. pull the data from saved CSV .

[@uayewin4203]

I try to use it but it doesnt work with arduino........ It show firmware for arduino to upload.... as demo. But still dont work thank .. Anyone can answer it

[@donkelly36]

Using this for telemetry processing for a drone teststand. Five thumbs up!! Please add serial port commanding, would be fantastic addition! Great program!!

[@upgrdman]

Thanks! That's planned for a later version.

[@lazymouse636]

Excellent, I downloaded the jar and it works! Seeing the esp8266 I bet there will be tcp/udp support in a future version. You have another subscriber :) Thanks a lot for sharing /bow! An option to rescan the available com ports would be nice :)

[@Taran72]

thank you sooooo much! I've been following all your telemetry videos and finally got the most updated one for my project. I don't need the Wifi version for now. :)

[@fukimoto]

Outstanding piece of software. I like the new tile look. Thanks!

[@encorzo6331]

Again an amazing job! I've been using the previous versions and this upgrade is amazing. If you are planning to do newer version I have some suggestions :) Add a new "kind of graph" which would simply be the number in a big font, sometimes I only need to visualize the average. Maybe making a "statistics" block in which you could show the mean, sigma or both at the same time, right now I'm using the dial graph making the font huge. And this brings me to the second suggestion, when I make the dial font huge everything becomes huge, maybe being able to control the font size for each individual graph would be amazing. Also if it was possible to resize the graphs without having to close and open would also be helpful. And one upgrade that would be incredibly helpful, I'm using a wind sensor for monitorizing breath, I would love to be able to extract the breathing period but there is not enough resolution for frequencies lower than 1, is it posible to modufy the DFT algorithm in order to chose the frequency domain you want to make the DFT and the resolution of it? I know this part is harder but would be of huge help. Once again Thanks for your amazing contribution!!

[@stevelong4547]

This is what I've been waiting for. Absolutely brilliant!! Thank for making the world a better place. We can use your software to help Developing Countries.

[@anwarshorts5130]

Thanks won’t be enough for this guy. This guy is a lifesaver . Hats off man . Great work great job .

[@kentvandervelden]

Wow, really nice, a sensor communication wizard with customizable graphing. But, no teapot for the quaternion view? :)

[@soupwell]

Awesome work! I'm extremely impressed and grateful that you've put this together and made it publicly available. If I can make a couple of suggestions without coming off as complaining... 1) I would love to be able to send a timestamp as one of the comma separated values in the serial data, then use that as the x coordinate for the tuple on the same line. 2) It would be cool if I could access the data definition dialog after initial serial connection setup. Maybe I add another measurement or change the ordering for whatever reason. As far as I can tell, I have to start over with a new layout to do that currently. 3) It would be nice to be able to resize charts after they are initially created. 4) Is there a way I can buy you a beer? This may be me missing something obvious, but the scroll rate in my time domain chart seems off to me. My arduino is using a delay of 10ms (and not much else going on in my loop), so the sample rate should be roughly 100Hz. The sample rate setting in Telemetry Viewer is set to 10000, and the Baud Rate to 230400. I am displaying 1000 samples in my time domain chart. By my calculations, that should mean that the entire graph moves across the window in roughly 10s. However, it took 30s to scroll through 500 samples according to the x axis label. Am I missing something silly? I am a mediocre programmer at best, and currently understand very little of your architecture. I understand any of the above may be difficult or impossible because of existing design details or inherent limitations in serial communication protocol, etc. If you don't see any such limitations, and want to point me in the right direction in your code, I would be happy to look it over and give you any code I manage to hack out (I would enjoy the exercise, but wouldn't wager too much on my success...). Again, Awesome Job. The tool is extremely useful to me as-is, just thought I'd throw out my suggestions. Thanks!

[@upgrdman]

Thanks for the feedback! Regarding #1, that's something I've been thinking about. Right now it is assumed that all samples are equally spaced in time. This makes the code a little cleaner and maybe a little faster. Frequency Domain Charts would also be more complex if the samples are not equally spaced in time. But I may add support for this later on. Regarding #2, Good idea. Regarding #3, Good idea. Regarding #4, Thanks! If you feel like sending a dollar my way, PayPal would probably be the easiest method. I'm "[e-mail]" on PayPal. Regarding the "Sample Rate" of 10000, that number is only used in two places. It is used by the Frequency Domain Charts when calculating the DFTs, and it is used when you move your scroll wheel to rewird or fast-forward. One rotation of the scroll wheel is currently set to rewird or fast-forward by 25% of the "Sample Rate." For example, with the default of 10000, one scroll-up of the wheel will rewind time by 2500 samples. This isn't a very obvious way of doing things, and I plan to eventually rewrite that code so it takes into account the chart under the mouse when you scroll. So if you are not using your scroll wheel, then the speed that samples move by is *only* determined by how quickly samples arrive at the PC, and the "Sample Count" (not sample rate) setting of that specific chart. Regarding the source code, in my earlier videos I went over the general source code layout during the last half of the video. It turned out that few people ever watched that long so I stopped doing that in my newer videos. The next version of Telemetry Viewer has many changes and I'll probably cover it's code in the next video I do.

[@OfficialDJNoel]

Suggestion #1 pls. Great vids btw

[@BinjKomisar11]

Excellent job. Very helpful, practical, and functional. Thanks!

[@bears7777777]

I love this software! I do have a couple suggestions though. 1. A serial terminal to SEND data to the arduino. IE for adjusting values or selecting a mode. 2. A way to delete variable entries. Can't count how many times I had to remake the entire legend because I forgot to change a color. 3. A way to reopen the variable entries tab without having to reconnect/reopen the file.

[@bears7777777]

I downloaded the source code and found my 2nd suggestion was in the works. I have to learn more javascript but hopefully I can manage to implement edit and remove functionality for the CSV Packet Table. I think I know why it was left out and its because the "location" variable or row number sequence changes when you remove a row. I'll have to figure out a way to handle this so that subsequent rows get renumbered. Keep up the great work and thanks for a small project to work on during quarantine!

[@upgrdman]

Hi. I have implemented the ability to edit the data structure, it will be in the next release. I'm doing more testing and hope to release the next version within a month. Regarding #1, I have been thinking about how best to support that. I'd like it to be more useful than just a textbox and a send button. It's also more work than it seems, because it affects the UART, TCP and UPD code. Regarding #3, I'm curious why?

[@kiloutoo]

Always excited to get your new version ! The new tile base theme look better than the plain grid. It is awsome to be able to change chart settings live instead of rebuilding the chart itself. Still one remark. What happen to the statistics chart type? Did it got lost along the way ? Any chance to have it back ? Great work. Thanks

[@alanc1085]

239/5000 Great job, thank you for sharing. I've been following your video series for some time and they're all very well done and very helpful. The resolution and simplicity, agility. etc. of your program are perfect. Saudações do Brasil.

[@charlessavoie2955]

Farrell, Thanks for sharing your code. This is awesome stuff. I've been trying to accomplish the same thing using Python for weeks. It's been a real struggle. Your code does exactly what I was looking to do. Now I'm interested in learning Java!!! :-) Question: Is "Open layout" missing a section that restores all of the settings for Histograms, like the frequency settings? Everything else works great! Thank you

[@upgrdman]

Thanks for the kind feedback. The histogram settings should be part of the layout file. I'll double check later on, but those settings should be restored when opening your layouts. Are you using version 0.4, and using layouts created with version 0.4?

[@shuaaibrehmman926]

@@upgrdman Amazing work, Hats off to you Farrell. I have a suggestion for your next version of telemetry software. It would be great to have a small tab to send the data back to arduino on serial port as well just like serial monitor of arduino. This would be great if lets say you want to tune your PID constants using serial port.

[@codeface7448]

This man is a real genius

[@mittaliaf]

Thank you very much for this easy to use program. Impressed my instructor with integration and display of Sensors.

[@jindrichrozkopal9760]

One thing I would add to make this even more awesome is the ability to edit the channel settings so I dont have to do it all again. For example when I want to add a channel or rename or change the colour. Or maybe an automatic channel scan? Just an idea. Great work otherwise! Thanks a million!

[@GregCorson]

One work around is to open the configuration file with a text editor and just edit it, the format is pretty easy. One tip, it's picky about indentions and blank lines.

[@BigHeartBreak93]

Thank you so much, I love htat you keep on improving this project so much!!!! I'll try it out the next week. Is it possible in this version to edit the connecting section, eg. when you might have misspelled or wanted to add something in between? :)

[@upgrdman]

That isn't supported yet, but I plan to do that eventually.

[@donkelly36]

Ferrell, Is there any means to send a command back through the serial port using Telemetry Viewer? For example, say I wanted to send back a gain value for the proportional gain for a PID controller? Guessing not, but just thought I'd check. Program looks great!

[@upgrdman]

Thanks. That isn't supported, but I plan to add that in some later version.

[@Gatchaman__zero]

Thank you ever so much for your hard, from my point of view, work!!!! One question. I'm a noob at arduino but I'm trying learn how to send the telemetry data to an SD card on a cheap uno SD shield as backup just...in ...case the laptop or T V goes down. Would it be possible to add an option to send data to SD card or can you point me to example code so I could do it myself? Been trying other sketch examples to incorporate SD card code into your sketch but it never works.... Hi, I manged to merge your TV code with an SD card/RTC sketch and after quite a bit of //ing I managed to somehow make it work :-)

[@ProtoG42]

Great stuff man!

[@snake5394]

Really Really great! Thank you so much for sharing this for free.

[@user-bj4lp3fr1o]

Amazing work. Thanks for making this and making it free.

[@monizpaul]

Awesome program! In 0.2 your log file had a timestamp in the first column, now it's sample count. Why the change? Is there any plans to offer a time-based x-axis?

[@upgrdman]

The timestamp is coming back soon :) Time-based x-axis is in the works too, but may not be ready in time for the next version.

[@bbreeuwer4577]

Very awesome! One major issue I am missing is making log scales. Which are especially mandatory for frequencies. Same for decibels etc. Also, would it be possible to add some math functions?

[@upgrdman]

Thanks. Log frequency plots and math functions are planned.

[@김홍두정보전자신소재]

Superb software!! you are doing a great job. Could you include the selection button of linear or log scale plot on FFT spectrum in both x- axis and y-axis?

[@upgrdman]

Good idea.

[@GregCorson]

Great piece of useful software! Anxiously waiting for the udp network feature you have rumored. Need someone to help test? It would be really nice to be able to type text and send it out the serial so you can send commands to arduino (ie change pids, modes...etc)

[@oentronicneotronic9153]

Hello, I'm happy that you alwas uploading your telemery viewer! Relly good job Woult to be possible to change the BACKGROUD Color to black?, It will look even better at night.. thanx

[@TheKrakax]

HI, excellent work!!!, now, how can i put a timestamp to samples on the CSV log...?.... Thanks!!!!

[@upgrdman]

Thanks. That is not currently possible, but it's planned.

[@MoreCharactersThanNeeded]

Awesome work! Sorry for the newbie question but is there an easy way to import all the jar-files in to the project in eclipse? I get a lot of dependency errors and its a real pain too google and download all the jar-files manually.

[@upgrdman]

The jar files for the libraries are included in the project. They are in the "lib" folder: github.com/farrellf/TelemetryViewer/tree/master/Telemetry%20Viewer/lib

[@MoreCharactersThanNeeded]

Ah, thank you! I must have missed that. Great! :)

[@paulrobion]

Awesome job on the update !! The only thing bugging me is I can't sprintf float variables, I have to convert them to integers first but then I lose the decimals. Any idea how to fix it ? Thank you a billion times

[@haiqingxia513]

Many thanks! this tool has helped me very much!

[@jackmckeon124]

Amazing piece of software, thanks very much! Would it be possible to be able to look back on data that has been recorded? What would be the best way to store this data?

[@upgrdman]

That's planned but not yet supported. For now all you can do is export the data to a CSV file, which you could open up in Excel, etc.

[@jackmckeon124]

Thank you. I was thinking of adding a heat map to the software

[@argumento99]

Muchas Gracias, usted es un genio! Saludos desde Argentina

[@leonardoarevalo4289]

Como instalaste telemetry viewer ??

[@albertomora4462]

Hello. Two questions: 1) is it possoble to save the data? I think that it is very important this feature 2) Which is the maximum sampling frequency?

[@UlliLawrenceMilanesi]

Thank you dear Sir!

[@jameszhaohai]

This is very good software. I would like to run it without connection device. Where is layout file to open? How can I run it without real connection? Thanks.

[@byounghyocheon7421]

It is great. Thank you for your sharing.

[@NiceKixx]

what transceiver did you use for the self balancing robot? and how did you transmit the values real time for the software to read?

[@upgrdman]

Hi. I used a Bluetooth UART module (HC05) similar to this one: amzn.to/2u8Am1P Check out my other videos, I did a whole series on how I made that balancing robot. Source code is on GitHub, etc. Good luck!

[@kfirmaymon84]

Great work thank you thank you thank you

[@mightymagnum8811]

Any ideas why this 0.4 version only works on certain PC's and not others? I have Java 8 on various PC's and it works great, and on others it just hangs up once I enter the data into initial panel, just when the live data should appear. All systems are 32 bit, and I supply them all with exactly the same data stream to the COM port. Some XP PC's work and some don't. Some Windows 7 PC's work and some don't. All using the same Java 8 download version. Version 0.1 works on all systems I have tried it on. If this is an OpenGL issue, is there anything I can do to make Version 0.4 work on these other basic laptops? Thanks

[@DavidBrown1148-w2y]

Thank you for all you videos tou are incredibly talented. I wish I knew about programming about 50 years ago. I’m learning enough now that I get really confused i’m in the process of trying to develop to a telemetry recorder for our race car. is there anyway I could pay you for time to save me a lot of trial and error Thanks Dave🏁🏁

[@chrisdockman7237]

I'm trying to reduce the amount of data I'm saving. I want 1 sample per second. If I change the frequency to 1 in Telemetry Viewer and change the code in the arduino to 1000, it appears to be the same amount of samples being recorded. Many thousands of samples per minute. I'm looking for 60 data points per minute. Any help?

[@diegoloredobecerra7124]

Hi thank yu very much for the video, and also having this software as open source code. I'm new at electronics, but how I can store this data?

[@bgfost2529]

WoW! i am highly impressed! I have tried to do something similar in Python, but it is sooooo sluggish! I would like to give up for your project. I don't need to be that fast, one update the second is enough, but the viewer should run on a RaspberryPi, having Java 8 installed. Currently the download expands to many, many files and folders, and I just don't know how to start there...

[@upgrdman]

Thanks for the kind feedback. TelemetryViewer does not currently work on the Raspberry Pi, but I am working on that. There are a lot of changes required, so it may be a while before it's compatible.

[@fassesweden]

Can I suggest a udp input or maybe a mqtt input for the data? Maybe that's what you are planning with the esp?

[@upgrdman]

+Fredrik Andersson Yes, I plan to add TCP and UDP support in the next version.

[@fassesweden]

upgrdman feel free to contact me if you need help with this!

[@przemysawsakowicz8857]

Great. Is it possible to plot cycle data so the time line is constant and ech cycle has his own graph over previous and all cycles graph are visible?

[@upgrdman]

Do you mean something like an oscilloscope's "infinite persistence" mode? If so, yes, that is planned. The trigger functionality has lots of planned improvements, including that.

[@hankbrinlee4677]

Good gawd I love this thing...

[@francuadasilvacosta5116]

How would I integrate a radio telemetry with arduino in real time with lora? Could you give me a tip? I want to do a telemetry with water rocket.

[@kotermack]

Very nice!Any idea how to do the same over Ethernet? Thanks,.

[@upgrdman]

TCP and UDP support should be part of the next version.

[@BigHeartBreak93]

Is standard deviation available?

[@tarekibrahim1240]

Hi Ferrell, Thanks so much for the software, it looks great. I am getting some errors when I try to run it. "Exception in thread "main" java.lang.reflect.InvocationTargetException at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Unknown Source)" and a number of other errors. can you help me figure this out. Thanks.

[@upgrdman]

Are you using Java 9? I've had problems with 9 and I'm looking into it. For now you would need to use Java 8.

[@Loyeti1994]

I have downloaded the JRE 8.0 and 10.0 but I can't run TelemetryViewer 3.0 and 4.0. Can you please help me? Thank you for your job, it will save me in my thesis project :)

[@Loyeti1994]

Solved

[@lalinlalote]

Do you know how can i plot something, but in the x axis i dont want time, i want something else, for example i am plotting the speed in x axis and torque in y axis this is of a motor. Do you know how can i do this?

[@renohibrid0]

I am using your program to make a record of electrical consumption, I already have the voltage and amperage sensor, but is there any way to do the watt calculation? I need to tell your interface how it will be recalculated using the values of the two variables

[@renohibrid0]

is a GREAT software BTW

[@upgrdman]

Calculated datasets are planned for a future version.

[@renohibrid0]

I figured out how to do it, in the arduino code, with a variable that have value from formula and not from sensor. now my problem is harder to solve, the DS1302 RTC cant send time correctly to the Telemetry Viewer so when I export the registered data dont have a timestamp

[@donkelly36]

Ferrell, Am trying to get TelemetryViewer connected, but am getting this error on my Windows 10 Surface: OpenGL ES Error Can't find the name of Intel ICD OpenGLdriver Any suggestions on what I've done wrong? Thanks!

[@donkelly36]

Reinstalled java, couple times, looks like that fixed it....

[@upgrdman]

You might have been using a 32bit JRE with 64bit graphics drivers. That would cause problems.

[@donkelly36]

Thx, thought I had, but anyway got it going! Looking great!! I have a drone test stand where I can do all sorts of testing, so this is very very slick. Nice work, impressive!!

[@fabianbello3268]

Is it compatible with a stm32f303k8 microcontroller?

[@김홍두정보전자신소재]

Telemetry viewer 0.1 works OK in my laptop computer. But this newer version did not work . My desk top computer works fine which has a graphic accelerator. Could you help me why this thing happens? My laptop computer is Samsung series 9.

[@upgrdman]

Probably related to OpenGL drivers. If you're using 64bit drivers, you will meed to use a 64bit JRE.

[@김홍두정보전자신소재]

It is due to OpenGL driver. Samsung did not support newer version of OpenGL driver

[@baylinbridges3069]

Is it possible to run this program on a Raspberry Pi 3?

[@upgrdman]

Not yet, but that is planned.

[@baylinbridges3069]

Looking forward to it! Do any of the previous iterations happen to work on RP3? Or could you recommend an SBC that this is compatible with? I'm currently working on building a water brake dynamometer and would really like to use your program without needing a bulky computer. Im considering purchasing a LattePanda to test on. Thank you for your quick replies!

[@upgrdman]

v0.1 might work, but I have not tried it. v0.2 and later use OpenGL (not OpenGL ES) so they won't work with most SBCs.

[@leonardoarevalo4289]

No he podido instalar el programa, lo descargo, lo descomprimo y ningun archivo me sirve para instalar

[@agaelema]

Hi, excellent tool. Sorry by the question, but how to run the tool? I'm lost

[@upgrdman]

Just install Java and then double-click the Jar file.

[@agaelema]

Hm, but where is the .jar file!? I found only those related to libraries github.com/farrellf/TelemetryViewer/tree/master/Telemetry%20Viewer/lib

[@upgrdman]

There's a link in the video description, right before the link to GitHub.

[@agaelema]

yesterday the link was not working, but today was possible to download the .jar Thanks

[@abdalrahman3497]

I can't add two graphs at the same time :( version 5

[@bramastoadinugroho]

Actually, i send a data from my microcontroller every 2 minutes. How to set the software (Telemetry) to take data every 2 minute?

[@upgrdman]

Hi. The software can work with any sample rate, but the frequency domain charts will not have the correct scale.

[@DenisHeink]

What do I need to do to start the program?

[@김홍두정보전자신소재]

You need Eclipse for Java.. You can download for free

[@jranspetrosian9333]

Great software, unfortunately only version 1 works for me, anybody has any idea what could be the problem? I already tried different version of java.

[@upgrdman]

Thanks. v0.1 does not use OpenGL. There might be an issue related to your graphics drivers, or maybe your graphics card does not support the right version of OpenGL.

[@CharmVibe24]

How to install telemetry viewer? I don't find setup file after downloading both TelemetryViewer_v0.4.jar TelemetryViewer_v0.4_src_20170721.zip

[@upgrdman]

Install Java, then double-click the .jar file.

[@CharmVibe24]

Sir upgrdman, .jar file from TelemetryViewer_v0.4_src folder? As I didn't find .jar file in TelemetryViewer_v0.4 folder.

[@CharmVibe24]

I downloaded java from this website java.com/en/download/manual.jsp . After installing java file, I go to C:\Program Files\Java\jre1.8.0_171\bin inside bin I found java application file. Sir upgrdman, do you mean that java application file from C:\Program Files\Java\jre1.8.0_171\bin ? The next problem is I can't open that java application when I double click it. :(

[@upgrdman]

Double-click the "TelemetryViewer_v0.4.jar" file. If you have Java 8 installed, it should just run the program when you double-click that file. You don't need any of the "TelemetryViewer_v0.4_src" stuff, that is just the code for anyone who wants to look at it.

[@sumethingsumething]

Amazing work. I was using the older version and this awesome. Has anyone done a bluetooth version of this? @upgrdman

[@upgrdman]

It works with Bluetooth UARTs. The balanacing robot I demo'd uses a Bluetooth module to send the telemetry.

[@bears7777777]

If your BT module supports serial communication it can. Newer BLE devices don't have this capability

[@ashkananali8571]

How to make Radio control 6ch telemetry and ardunio

[@Elad6k]

Pls add a "real time clock" logging not just readings

[@sagacitytech5893]

Did you ever make a video showing how to use SQL database like you said you would in this video? kzbin.info/www/bejne/rKvSm6p9bLR1bcUm54s if you have not do you plan to make one and when?

[@upgrdman]

I have not. I might still get around to that, but not sure when. Sorry.