Beginner's Crash Course to Elastic Stack - Part 2: Relevance of a search

This workshop is Part 2 of the Beginner’s Crash Course to Elastic Stack.
Beginner’s Crash Course is a series of workshops for all developers with little to no experience with Elasticsearch and Kibana or those who could use a refresher.
Join Elastic Developer Advocate Lisa Jung(@lisahjung) to understand the relevance of your search with Elasticsearch and Kibana!
By the end of this workshop, you will be able to:
learn how precision and recall are used to measure how well Elastic search engine is searching
understand how scoring is used to rank the relevancy of search results in Elasticsearch
master how to send search queries from Kibana to Elasticsearch to finetune the precision or recall of your search results
Time Stamp:
- What is the relevance of a search? 4:20
- What is precision? 7:47
- What is recall? 8:22
- What is ranking? 9:29
- What is a score? 10:19
- What is the term frequency? 11:20
- What is inverse document frequency? 12:32
- Add data to Elasticsearch via File Data Visualizer 14:28
- Retrieve information about documents in an index 22:56
- Track_total_hits 25:22
- Range query 26:44
- Aggregations 29:10
- A combination of query and aggregation request 31:19
- How to increase recall(match query) 33:50
- How to increase precision("operator": "and") 36:54
- Minimum_should_match 38:35
Resources
Table of Contents for Beginner’s Crash Course to Elastic Stack:
ela.st/beginners-table-of-con...
The link above includes the table of contents for all repos shared during the course.
These repos contain all the resources shared during the workshops including the presentation slides, the recording, as well as Elasticsearch requests.
Be sure to check out Part 2 repo as you follow along!

[@thegreatsilence1081]

I really do not know why I have been watching this content 😁. We are not even using ELK stack. maybe content is so good I can not resist watching it.

[@mrc1500]

Really enjoying these, Lisa. Thanks for de-mystifying with these nicely accessible workshops.

[@ChrissiE]

These courses are really just awesome: so easy to follow and very informative! thank you!!

[@SM-yx1vp]

Kudos to you Lisa for such a wonderful tutorial. I am prepping up for Elastic Engineer 2 training and this is just what I needed to brush up/learn.

[@nicologalia3091]

Great tutorial, complete and clear. Good job Lisa!

[@vivekrao3450]

Excellent series of videos. Very well explained Lisa!

[@jeremyng1021]

really enjoyed the content and energy. thanks Lisa! :D

[@romankokhatskyi8137]

Thanks for the tutorials, really helpful!

[@almeDineshNaik]

Brilliant tutorial, thank you.

[@julietteoh5238]

thank u for this course

[@daviddonadze221]

Thank you so much

[@paulchibueze5319]

Thank you Lisa ❤

[@shine-odtsolmon1299]

Thank you very much

[@kelvindervishllari9935]

Great content !

[@sandeeps9158]

fantastic

[@vuhaiang2852]

So great

[@endernator]

so good ms 😻

[@leman9326]

Merci Lisa

[@sabihaali7962]

@40:34 there were 2 docs matching with all 4 terms then why did we get count 1 in the recall query Wonderful presenter and content

[@vytran7661]

thanks for your tutorial, it's really fantastic. But I wonder if you can explain for me that will there be a difference in searching speed if all query types are sorted in different order?

[@OfficialElasticCommunity]

Hi Vy! The comments of this channel aren't monitored by developers but discuss.elastic.co and our slack workspace (ela.st/slack) are! I recommend asking your question in either of those places. Thanks!

[@erhanalankus]

I can't find the file upload link shown at 19:18

[@matross3097]

How to enable Ingset data piepline option? I am unable to view it

[@fantasticloud1297]

I've installed Elasticsearch (ver 8.2.2) & Kibana (ver 8.2.2) from source. And I've downloaded and un-zipped the .json data set from Kaggle and imported it using the drag-and-drop feature of the M/L Visualizer. ;) But there doesn't appear to be an "import" button ANYWHERE (@20:42 thru @21:01)! Have I overlooked something, Lisa?

[@fantasticloud1297]

SOLUTION: The "import" button becomes visible AFTER clicking the "Analysis Explanation" link (in the Summary area) and then closing the slide-out window that appears.

[@justinhu351]

Hi I have trouble uploading data when importing, any way to solve this issue? (request time out)

[@OfficialElasticCommunity]

Hi Justin! That's a great question for discuss.elastic.co or our public slack workspace (ela.st/slack). Both of those spaces are monitored by technical folks, unlike this comment section :)

[@nameunknown007]

True negative is truly negative that means it's the one marked F sitting outside. False negative is falsely negative, that means its sitting outside but is a T. You have it reversed. But thanks for the video series.

[@fantasticloud1297]

And the term "Precision" is also incorrectly applied - "Accuracy" would be correct.

[@sheereenhamza3700]

@@fantasticloud1297 No... Accuracy is (TP+TN)/(TP+FP+TN+FN)... while Precision=(TP)/(TP+FP) Accuracy -> measure of ability to correctly distinguish and identify relevant and irrelevant documents Precision -> proportion of relevant documents in the entire documents returned

[@muditsaxena3640]

I think she has interchanged true negative and false positive