Automate your Testing on Devices with Flutter Integration Testing

[@nils.reichardt]

Update: The integration_test package moved into the Flutter SDK (with Flutter 2.0). You should not use "integration_test: ^1.0.2+3" anymore. Use instead: dev_dependencies: integration_test: sdk: flutter

[@marh122]

should have noticed your comment earlier, it would save me around hour

[@andreisas1621]

On VSCode i use pubspec assist extension that adds the most recent dependency version and runs flutter pub get also, check it out

[@ronny-if7ms]

Great video! Please make a complete series on integration testing of flutter apps there are lot of QA folks struggling with this and there is nothing on this topic 🙏🙏

[@FlutterExplained]

Hi Ronny, sounds like a fantastic idea. What would you like to see covered in such an Integration Test Series?

[@ronny-if7ms]

@Flutter Explained complete E2E integration test suit 1. OTP sign up 2. Smoke test 3. Test cases for switching between web browser and App 4. CI/CD 5. Report 6. Parallel execution using firebase test lab or AWS device farm 7. UI data validation with Api response Appium for flutter apps(I guess appium dosent support flutters but if u can cover this topic) A course specially for QA folks will be great and there is no content on these topics

[@ronny-if7ms]

Thanks a lot for replying!

[@ronny-if7ms]

And if possible please cover flutter gherkin aswell.

[@BrunoCodeman]

I could expect learning sociology from Max Weber, but I never thought I would learn flutter from Max Weber.

[@FlutterExplained]

Yeah the world is a small place and my namesake is everywhere :D

[@KraasRas]

Thank you for this good tutorial. I have two questions: 1. I want to take a screenshot of the current frame, if a test fails. How could I do that? 2. What is the difference, doing integration tests with the 'package:integration_test/integration_test.dart' + 'package:flutter_test/flutter_test.dart'; vs. 'package:flutter_driver/flutter_driver.dart'; + 'package:test/test.dart';?

[@FlutterExplained]

If you are interested in more testin videos, checkout the Testing Series Playlist: kzbin.info/aero/PLq83k-ITj6lSISMo6JOGkcOBcio_zEeAB

[@mdshihabuddin129]

The playlist not exists!!

[@FlutterExplained]

@@mdshihabuddin129 Thank you for letting me know, I renamed it and probably it lost track, I will update the link right away.

[@andreisas1621]

Great great great tutorial. Very clear and comprehensive explanation, thank you!

[@FlutterExplained]

Thanks for your fantastic feedback!

[@vijaybabaria3253]

Awesome tutorial, thanks for sharing and hope to see more on integration videos.

[@mannembhavya4872]

Thank you for the nice explanation on flutter integration testing. Could you please make video on how to inject a mock client in integration testing. In the example you have shown, we know the flow but in some apps it all depends on the response of the app. Please make a video on injecting Client and testing with that.

[@Eileen-in-the-coding-maschine]

Thanks for the video! Are you using AndroidStudio? Which plugins would you suggest to use for a beginner?

[@johngod35]

fucking awesome, thank you so much for this flutter testing tutorial series

[@ivanyoed]

You produce excellent content Max. Thank you so much.

[@robinn1337]

gutes Video! hab mich schon gefragt, ob du deutsch bist, bei 5:20 war es mir klar :D hast du dich schon mit dem Thema Test-Lab Robo-Test beschäftigt? Finde das Konzept hinter den Monkey Tests richtig geil, sind ja quasi schnelle Integrationstests, um einfach mal bei z.B. größeren oder kleinere strukturellen oder architektonischen Änderungen am Code zu überprüfen, ob alles noch so klappt Tests sind halt teuer und zeitaufwendig... da konnte ich mich mit Unit- und Widget Tests noch nicht so anfreunden. Da haben für den Anfang Integrationstests und evtl. auch Monkey Tests(zukünftig) schon einen besseren Kosten/Nutzen Faktor, oder was denkst du? VG aus Sachsen, Robin

[@FlutterExplained]

Danke dir für dein Feedback! Immerhin konnte ich es für 5 minuten verheimlichen :)

[@Findmanish09]

@FlutterExplained Very nicely explained except the thing which I was looking for. At the timestamp 11:59 you mentioned that we can put Key but how to find the exact widget to put key in a fully developed app and we have no idea about it. How to search and reach out to that exact widget to put key..? if you can help me in this.

[@FlutterExplained]

Sure to set a key for a specfic widget you can give the widget the "key" property with a unique key. This tutorial has a minimal setup for this: docs.flutter.dev/cookbook/testing/widget/finders#2-find-a-widget-with-a-specific-key

[@iansmith3301]

Any tips or ideas on how to do unit testing / integration tests for parts of your app that use voice recognition? :) I've thought about using pre-recorded audio files but I'd need some type of set up that would stream audio through a virtual input. Maybe there's some integration software that has already done this? Bespoken might be an option but it looks pricey.

[@FlutterExplained]

Hi Ian, that is a great question, to be honest this is the first time I have to think about something like that. If you find something in that direction I would be super interested.

[@psy8428]

Did you come up with any solution to this?

[@OICG]

I am loving your videos ❤

[@FlutterExplained]

Great that you like them, if I can do something that you like them even more, I am all ears :)

[@pedromartin3766]

Hi nice video, thanks :). But, at the end, you mentioned that one thing learned is how to run multiple integration test and it didn't show in the video... could you please give more details about how to do it? thanks

[@FlutterExplained]

Hi you are most welcome, I am glad you like it :). At the last part of the video I explain that. It is not possible to run multiple at once but you can prepare a script that let you run one by one. kzbin.info/www/bejne/jYGopKGAnLxsb68

[@frx-michael-widjaja]

Thanks for the video. Btw do you have any suggestion for testing tool which support flutter for black box testing?

[@FlutterExplained]

Mhhh sorry, not really.

[@iDujii]

So I've been trying to read about UI and Integration testing (specifically for iOS development). I always though these tests were different, but a lot of the integration tests example I see, appear to be what I would call UI testing. So now I'm curious, what is the difference between UI and integration testing?

[@FlutterExplained]

At the moment in Flutter there is basically no real difference.

[@brightworld7550]

Thank you so much for this tutorial, it was very helpful.

[@FlutterExplained]

You are most welcome, I am glad that you could use it!

[@anatoliipipko7258]

Great tutorial! Thanks a lot!

[@ivanvotchel1604]

Thanks for the video! How i can divide my tests without repeating previous steps? For example, I should always created an account in my app's first step. I wrote tests for this logic, but I want to keep tests for another logic in other files. And I should repeat the creation account in all test files. Is there a solution for this?

[@darlinmanuelcasadoperez1092]

thanks for the video, it was very helpful

[@Ajaysharma-ri9xi]

Thanks a lot for your tutorial, its an awesome tutorial, I have also started with flutter test automation i am struggling to automate the file or image uploading from device automation part do you have any suggestion or help for me ,Thanks in advance!!

[@FlutterExplained]

Hi there, I am glad my video helped you. That is quite a specific use case. Let me see if I can have a look and would directly produce a video for that. It could be that it is to late to answer your question. In general you want probably using a Flutter Integration Testing helper like Patrol in this case because you want to access native elements (the gallery). This video gives a short intro: kzbin.info/www/bejne/aJ-oaKSJjL6snJY patrol.leancode.co/native/overview I hope that helps :)

[@anupamaprabhu9819]

Can you please share an example how to select radio button in integration test.

[@WilliS1651686868]

Thank you for this explaination! One question: How we can check all checkboxes instead of only the first one?

[@Nithin.Raaj.J]

find.byType(Checkbox).at(_index); use this to check the specific checkbox

[@sarharmiha3184]

thank you

[@SEGVeenstra]

Great video and great explanation, thx! The app I'm working on has to react on getting disconnected from power. I found out that you can use 'adb shell dumpsys battery set ac 0' to simulate it from command line, but I need to be able to do this during the test. Any idea on how to achieve that? Kind regards.

[@Robin.Backer]

How would you work with semantics because sometimes really long name content must be entirely described to avoid duplicated. Especially if this text is a variable

[@mahmoudadel1542]

Hello, I got this error Target file "\" not found when running flutter drive \ --driver=test_driver/integration_test.dart \ --target=integration_test/app_test.dart \ on the terminal, how can I solve it? I googled it but I couldn't solve it

[@FlutterExplained]

It looks like your line breaks are not able to execute \ is only working on mac or windows (not sure which system anymore) therefore it tries to exectue \ which is not a correct target file.

[@ahmedadnan5875]

it was an awesome tutorial

[@FlutterExplained]

Thank you for your feedback, I am happy that you liked it!

[@rommelmalqued4580]

Great introduction. Question, can the test code and the app being tested live in two separate codebase? Thanks

[@FlutterExplained]

Mhhh good question, never tried that.

[@rommelmalqued4580]

yeah, I'm new to flutter testing and haven't explored it either. Since QAs are responsible for the integration test, it's a little risky if they will be working on the same codebase with the devs. Just wondering.

[@kamalakannanmuthu4274]

@@rommelmalqued4580 hi i am also new to flutter testing you can help me and clear the doubt

[@adbysantos6603]

Good job, sir :D

[@FlutterExplained]

Thank you :)

[@dhavebarsalote810]

what's the use again with integration_test_driver? Can't we run integration_test without it?

[@FlutterExplained]

The video is quite outdated and needs a new version. In former times with Flutter 2 I believe you would need it and nowadays you still need it but it is created differently. Checkout the following page to get all the info you need. docs.flutter.dev/cookbook/testing/integration/introduction If you have more questions please let me know :)

[@anassa6737]

when i move to next page the testing stop why and not complete the rest of code

[@NItaboEstrada]

Hi, I am trying to test a flutter project, but this project is just web, and when I run the integration testing doesn't works, do you have some recommedation or idea? I really will appreciate it.

[@ivanivanov-lu5wm]

Thanks for video. Could tell how to get green play icon in .sh file, is it special extension for that? PS I don't have it

[@FlutterExplained]

Yep if you work with mac and shell scripts .sh I have the following plugin installed: plugins.jetbrains.com/plugin/13122-shell-script

[@saileshverma1942]

can u explain how to test out a drop down menu widget used in a form

[@kavithap4620]

Thanks a lot for this video. Can you upload Advanced flutter automation series?

[@pnutalapati]

Is there a way, I can down load the source bundle of the demo project ?

[@FlutterExplained]

Yes the code should be available in GitHub

[@ankara9594]

How can we change location (latitude , longitude) with this intehration test? And is it possible to test terminated mod background test?

[@sandormartin4549]

Thanks for the video. One question. How can we handle the modals that require permissions to use geolocation, camera or any other service of the phone?

[@FlutterExplained]

Hi Sandor, thanks for your comment. Honestly I am not sure, sounds like a great topic for a future video. I will look around if I find something I will let you know.

[@sandormartin4549]

@@FlutterExplained thanks I will be waiting

[@MatthiasSchippling]

This is an open issue for the flutter sdk. There are multiple workarounds described in the issue. The one that works for me is this: github.com/flutter/flutter/issues/12561#issuecomment-782150327

[@petroniobonavides3530]

Please, one question. Should I have the 'Android Emulator' opened? Or The script will OPEN the Android Emulator, instead.? Thanks

[@FlutterExplained]

The script should start the emulator actually.

[@petroniobonavides3530]

@@FlutterExplained thx for the answer. But how? I couldn't do that in IntelliJIdea. Could you please give some tip?

[@rakhichhettri7086]

Running the flutter integration test i just see "test starting" on my mobile device. Is there any reason this happens. would you know of any solution? Great video

[@FlutterExplained]

I will take tomorrow some time to investigate. Thanks for letting me know and I will give you a heads up if I find something odd.

[@ramkumaarmurugesan2217]

Hi brother, Flutter widget test does not trigger DropdownButton.onChanged when selecting another item

[@karthikeyanjayamani121]

is there a way, that we can reuse the flutter mobile scripts for flutter web app? or do we have alternate way to automate the flutter web application?

[@ExtraTerrestrials]

I have a test build APK file. How do I import it to project to start testing by writing tests?

[@raieshghimire9916]

please provide the full execution code for the ps1 extention

[@aqibjaved5120]

how do i pick image while integeration testing

[@tanoth1pl]

Hey i encounter one issue. When i have 3 tests and the first one fails, then it stops the execution of the next tests. It should print error to the console and try to do other tests. Do you encounter this issue and can help me somehow?

[@FlutterExplained]

Hi Hubert, I guess this is wished bahaviour, I will check if there is a solution so that tests will run further even on an error.

[@BooSgu]

Hey Hubert. If you run 3 tests, The app would be installed 3 times, right?

[@BooSgu]

Hi teacher, is it possible to put 2 "testWidgets" within a group?

[@FlutterExplained]

I guess you mean in a Integration Test? No unfortunately not you will always run the whole suite

[@BooSgu]

@@FlutterExplained That means we cannot 2 widget tests within a group. That's not handy. Thank you for your explanation!

[@AzeUnkn0wn]

do you integrate test authorization/sign in?

[@alex_terente]

Can you have multiple testWidgets under same group?

[@joaocorreia6593]

How can I select one email in selector natvie google account?

[@salmasiala3340]

can we test flutter with selenium ?

[@deiv319x]

Quick question: will testing solve the extremely relevant animations jank on iOS? I’m desperate 😞

[@FlutterExplained]

Hi Dave, no, unfortunately not. According to most GitHub Issues that I saw around that topic, we will have to wait for a solution. But feel free to check out this tweet where I discussed the topic already with the Flutter Community. twitter.com/flutter_exp/status/1362315607673352193

[@deiv319x]

@@FlutterExplained Thank you so much for the answer, I’ll check out the post for sure 😊 I’ve been working and exploring various solutions for this problem and I found some interesting and possibile solutions short term at least. I’ll share everything with the community once I’m sure they work! Do you find this being problematic for you or you mainly develop for Android? Thanks again, have a nice day 😊

[@FlutterExplained]

@@deiv319x @Dave RiseUp I saw the problem and I had to explain it also to one of my customers, but he is not really concerned about it and me neither. The small lags are not business crucial at the moment and he decided to wait until the Flutter team found a solution to the problem.

[@mdnaim4569]

PumpAndSettle is not working with infinite animation. It would be really helpful if any alternate to do. Thanks

[@FlutterExplained]

Good point, you can also just use pump and add a duration for as long your particular animation needs to display the correct part of the screen. `pump(Duration(seconds: 1))` With that you avoid regressions too :) api.flutter.dev/flutter/flutter_test/WidgetTester/pump.html I hope that helps!

[@shivz732]

This is all cool and stuff but when your app gets too complicated with lots of screens etc, I really can't see how this is better than manuelly testing (speed is the only thing I can think of).

[@FlutterExplained]

Excellent question, and actually, I am a bit sad that I could not bring that point over in my video. There are a couple of advantages, but the major once are: 1. Money, Testing experts are usually pretty expensive. 2. As you already mentioned, speed 3. Consistency, manual testing tend to test different scenarios differently, good/bad 4. Manual Testing is biased. People usually test positive and try to make the app work 5. Overnight and Weekend Testing, you can let your tests run whenever you want.

[@mohammedashique8923]

Anybody know how to choose value from dropdown

[@marh122]

i think this video is little bit outdated

[@FlutterExplained]

Thanks for the feedback. Good point, I will take it into account and try to create a newer version soon.

[@marh122]

@@FlutterExplained perfect thanks :)

[@sanuhara1375]

Great explanation but disagree with this video editing style. Please stop switching into the full camera view. Had to pause like 100 times to keep up with what you type on the editor.. It's really frustrating... 😩

[@FlutterExplained]

Hi thanks for your feedback, I will see if I can improve it in the future.

[@saharatphotongkham8382]

Thanks