Machine Learning with Qlik Sense

[@MrDavisv]

This is the first video I’ve seen that does an excellent job explaining SSE with Python and Qlik. Really great, thank you so much!

[@davidking8125]

Great work and great efforts, Nabeel. An awesome demo with great and useful use cases with localized real data and self-developed extensions.

[@adityachoudhury293]

What an insight, good job. I have just started python SSE with Qlik and this is going to help me implement/apply ML models to my datasets. Thank you much!

[@markmonfort29]

Have just started working with this great set of tools today - works fantastically well so give it a go!

[@joshuabradshaw1647]

Thank you for this great share!!

[@ScrewedUp]

Thanks for sharing, very nice examples and video.

[@Walleggwp]

I’m super impressed. I want to be as good at analytics like you.

[@Eli-xk2qg]

Hi Nabeel, Awesome demo!!! Do you know if this extension is available for Qlik Cloud (SaaS)? Thanks

[@Luca-ee9ym]

Thank you for this tutorial!

[@sungkuan6982]

Good job, thanks for sharing!

[@josecardenas3682]

Simply fantastic.

[@shyambutani8618]

I am super excited :)

[@David__]

Nice work Nabeel! Thanks for sharing :)

[@nabeelasif7662]

Thanks David! Glad you saw it.

[@shiwaniers_]

Hi Nabeel, your demonstration of the Python SSE looks amazing! Really awesome work! I am trying to deploy your solution on our Qlik Sense server, however when I run the Init file, it says that it is not possible to install HDBScan. A week earlier I did not have this problem on my local machine. Would you know how I could solve this? I already tried installing HBDScan via the CMD and pip. This works succesful, but I am not sure where to put the file in the virtual environment.

[@nabeelasif7662]

Hi Shiwanie, can you raise an issue here: github.com/nabeel-oz/qlik-py-tools/issues. The issue template will ask for some additional details which will help me diagnose the problem.

[@dominikkeller6453]

Hey Nabeel, awesome work! But i have one question. can i use this only in an qliksense enviroment? We are using qlikview.

[@nabeelasif7662]

Hi Dominik, Thanks! Server-Side Extensions work with QlikView as well. There's more information available here: github.com/qlik-oss/server-side-extension

[@dominikkeller6453]

@@nabeelasif7662 Thank you!

[@domiho123]

Very nice, thank you

[@pratik6447]

Hi Nabeel, Is there any step by step guide to install this in QlikSense Server from scratch,

[@dvadithala]

Nice one. I take you are still training your models in Python? What kind of data volumes have you tried? Is there a sweet spot with the data volumes and SSE integration?

[@nabeelasif7662]

Thanks! Yes the model is being trained in Python using scikit-learn. Qlik is calling certain functions in the SSE that automate the ML pipeline. The communication between Qlik and Python is using gRPC, which is quite performant. The transmission of data takes much lesser time than the training itself.

[@shivajichowdary85]

Nice work Nabeel can we start building our own custom script ... if we can please publish a video that would help us a lot :) :)

[@fabiofernandes1075]

Great Job!

[@meeslow]

Thanks for sharing this. In your video you mentioned that you've used expressions for the upper and lower limits for the forecast. Are you abel to share the format of such expressions?

[@nabeelasif7662]

Sure, you can find that information under the Usage section on the GitHub project: github.com/nabeel-oz/qlik-py-tools#usage. You'll find documentation and sample apps at the link. To answer your question, you can control what the function returns by passing parameters e.g. 'return=yhat_upper' to get the upper limit.

[@elliotkaye3773]

Really want to begin using this solution, however when running the Qlik-Py-Init batch file I encounter the same errors during the installation of packages, namely spaCy and HDBSCAN. When I run Qlik-Py-Start, i get error message in cmd window: File "__main__.py", line 30, in from _clustering import HDBSCANForQlik File "..\qlik-py-tools-5.1\qlik-py-env\core\_clustering.py", line 16, in import hdbscan ModuleNotFoundError: No Module named 'hdbscan'. Can you tell me where I may be going wrong ?

[@nabeelasif7662]

Hi Elliot, you can raise an issue at github.com/nabeel-oz/qlik-py-tools/issues. I'll need to see the errors from Qlik-Py-Init to tell you what's going wrong. First thing I'd check is if you're using the right version of Python (this SSE uses 3.6.x) and whether you have installed VS Build Tools with the C++ compiler.

[@xixill6382]

Hi Nabeel, thank you very much for sharing! An error happened to me and I do not know how to solve it: when I initiate the Qlik-Py-Start, it showed " ERROR: fbprophet: Importing plotly failed. Interactive plots will not work." Do you have any idea of solving that? Thanks!

[@khnabeelasif]

Hi Xixi, you can ignore that error. One of the libraries I use has had a new release with functionality that's only relevant for interactive Python notebooks. I expect they'll have a fix to remove the message in the next release.

[@xixill6382]

@@khnabeelasif Thank you for the prompt reply! I really appreciate that! I copied your fbprophet function in video, but it did not show any plot graph after applying it... Probably it does influence?

[@nabeelasif7662]

@@xixill6382 , I'd recommend you head to the GitHub page for this project and check the documentation on forecasting. You may have missed some steps to get the forecast working: github.com/nabeel-oz/qlik-py-tools#usage

[@niteenkumar9251]

Hi Nabeel, amazing stuff to increase productivity. I am facing issue installing the extension v.3.8 on my desktop version of QlikSense (Novemeber 2018). I followed each step mentioned by you to install the extension on Qliksense Desktop. I executed (run) the bat file. As expected, 3 folders are created 1.0 qlik-py-env , 2.0 core & 3.0 generated. I also changed the setting to (SSEPlugin=PyTools,localhost:50055;R,localhost:50050). After doing all the steps I, would expect to find the extension under custom objects. However, for some reason, i cant see the extension when i open QlikSense desktop. Could you kindly guide/help me, please?

[@nabeelasif7662]

Hi Niteen, this is a Server Side Extension so it will run as an independent application that provides capabilities to the Qlik engine. Continue from installation step 5 to run Qlik-Py-Start.bat.

[@niteenkumar9251]

@@nabeelasif7662 Thanks for your prompt reply. Much appreciated.

[@Guilopes99]

Whole day of work doing amazing Excel graphics, just to come home, watch this and feel like shit. Amazing clip! What's your source for Qlik tips?

[@nabeelasif7662]

Haha! For Qlik in general try out Qlik Community. There’s also free content on the official Qlik KZbin channel and the Qlik Continuous Classroom. For server side extensions you can start with the GitHub page for the project: github.com/qlik-oss/server-side-extension

[@Guilopes99]

@@nabeelasif7662 thanks! how would you rate Qlik vs PowerBI? I cant get along with qlik because it's not easy to properly format and design everything.

[@nabeelasif7662]

@Guilherme, I work for Qlik so shouldn’t comment on that! But do check out the “What’s new in Qlik” videos on KZbin to see how the platform has been evolving.

[@Guilopes99]

@@nabeelasif7662 okay, thank you for your honesty. I was introduced to qlik on a business intelligence course and I find it really useful, but I was so used to the ease of formatting stuff in Office that I felt I couldn't do such data visualization in Qlik as I did there. I'm way too much of a beginner to have a valid opinion already anyways hahah

[@ccrecoakpal805]

Hi Nabeel, I am new to this python SSE integration I followed your installations steps to install for the extension v.4.0 on my desktop version of QlikSense after installing when I open qliksense desktop, in function editor/expression editor pytools function is not showing can please post installation video for qlik sense desktop

[@nabeelasif7662]

Hi AkPal, I don't quite have the time to do an installation video at the moment. For your issue, check that you have Qlik-Py-Start.bat running without errors and that you configured the analytics connection for Qlik Sense Desktop: help.qlik.com/en-US/sense/February2019/Subsystems/Hub/Content/Sense_Hub/Introduction/configure-analytic-connection-desktop.htm

[@sangeethantonysamy-dhs-con5554]

Hi Nabeel, I am trying to integrate the Python with Qlik sense desktop with the steps you have mentioned in the Github (github.com/nabeel-oz/qlik-py-...) After installing the required prerequisites (Python 3.6 version, Qlik Desktop and Microsoft Visual C++ Build Tools), I am still facing the below issue, after I execute the Qlik-Py-Init.bat, windows.bat file "error: Command "C:\Program Files (x86)\Microsoft Visual " failed with exit status 2" Please suggest any solution, if you could help me out on this!! Thank you so much for the support and great work

[@meriembelaiba6809]

Hello nabeel, can i get your email please? I really need your help.thanks