LinkedIn Metric Interview Question and Answer: Tips for Data Science Interview Success!

[@cming6108]

The FIRST ever channel that I won't skip any minute when viewing for all the video you upload

[@imerareru]

l

[@linhe5896]

I really like how you take up two roles by changing your voice, background and clothes. Smart strategy, keeping using it, it definitely made me feel very engaging.

[@songxiyou2347]

We finally have someone who aces all those DS but not PM style product sense questions!! And I am tried of 100 metrics for one case study. Love, love, love it!

[@SwatiTirthramGulia]

This is among the most exceptional content I've ever encountered. Thank you Emma! Keep posting and enlightening us.

[@nileshjayswal6233]

Hi Emma, I wanted to ask something regarding the success metrics. I was thinking that for new users who signup, if they have uploaded their profile photo, there would be a higher chance that the connection requests they sent would be accepted as the profile would look more genuine. Since, one major goal of linkedin is to enable users to build connections,। think Percentage of connection requests accepted should be one success metric. The other metric that I was thinking could be number of jobs applied per user, since users also join LinkedIn to apply to job opportunities. Wanted to know your thoughts on this. Am I thinking in the right direction?

[@calebnguyen9803]

Awesome video! I would love to hear how you think about tradeoffs between different metrics before you recommend 2 success and 1 guardrail. Don't ever stop!

[@jeoffleonora4612]

This is exactly what I'm looking for! I have been preparing for DS interviews. I haven't found other videos talking about the metric questions in details. I will check out the book you recommended!

[@sophiezheng4850]

This is so helpful! I just failed one product sense interview. But with that failed experience and this video, I know how to improve!

[@jiayingyou8277]

This is awesome. In the past I would just answer the question without hesitation and maybe only cover 1 straightforward point or 2, your answer is so complete and flawless! Thanks Im learning a lot here!

[@mr_jacklu8014]

Hey Emma, I was one of the commenters who thought you should do these types of videos. And I'm so happy you did! I definitely think these videos are very helpful to aspiring data scientists who are interviewing at these big tech companies. Keep it up!

[@dtjiangutube]

You are awesome and lovely. High quality production level videos and lectures.

[@robbiedeegan3121]

Wow! Very helpful - your video gives me hope, thank you!

[@littlemida]

Hey Emma, just had a metrics interview yesterday and then saw your video. Looking for another video that need to come up with many metrics to keep tracking and show how to probe using the metrics. Good job, Keep it up!

[@jessieshao1397]

This is the best resource I have ever found! Thanks so much!

[@ss-ur9zr]

Interesting video. Your postings are always helpful and what I'm looking forward to every week.

[@hohhhhhhhhhaaaa]

Great video, and you have organized it very well throughout! one quick question, in terms of a true engagement metric would #connections per new user (e.g., by first week or first month) be more telling than #invites sent per user per day. The idea is that the user photo will also lead to more acceptances of user's invites and they are also likely to get more invites from other people.

[@emma_ding]

Yes, absolutely you could use #connections. I don't think it's a more "telling" metric compared with # of invites sent. Connections is one step down the funnel after sending/receiving invites and imo we should track all of them.

[@hohhhhhhhhhaaaa]

@@emma_ding Yep makes sense

[@chiplovesdale]

​@@hohhhhhhhhhaaaa I have the same idea. Thanks for bringing this up! Agree that making connections is one step down the funnel after sending invites.

[@mijikim7115]

So clear. That's so helpful. All of us would be happy to see more! Thanks a lot!

[@abtestingvideos2259]

Emma, your video is one of the things I look forward each week. Thanks so much for spending so much time and effort to make such awesome videos! I have recommended your channel to everyone in my network who are looking for DS jobs.

[@ajaykumarreddygopireddy7705]

Thank you for this video. Can you please upload some multiple testing videos. Thank you Emma!

[@emma_ding]

Absolutely! What specific questions on multiple testing do you have in mind?

[@shrutisinghal8556]

Thanks for your hard work Emma. I am looking at all your videos today and yes loving the content ❤️

[@geoffreyz5466]

3:08 gold 6:56 Invites sent per user per day

[@shelllu6888]

Found your videos are all extremely well-thought and applicable in interviews and day-to-day work. Thank you very much for doing this Emma!

[@Theartsygalslays]

One very important guardrail metric here needs to be around quality of the engagement. I.e., whether the lack of a photo (or its addition) causes more invites that are *not accepted*. This could be an indicator of spam activity.

[@byronhan8961]

Thanks for sharing, Emma! Your video helped me a lot. I'm sure you will help many more people like me. Keep up the good work!

[@chiplovesdale]

Awesome content, thanks so much Emma!

[@alpapaca9332]

I have no excuse to fail a metrics interview after watching this

[@MatthiasEkundayo]

Thanks Emma for these videos on Data Science interview! Do you mind making a video on why and how you made the switch from Data Scientist to Software Engineer?

[@emma_ding]

Thanks for the idea! There are people ask me the same question. It may be an interesting topic but I feel it may be a bit tangent of the content of the channel so far. I want to make this channel more about how to help people get their dream jobs (by sharing interview guidance) and less about me :) But feel free to message me if you have any specific questions.

[@gabrieldurkin7366]

It is interesting you are prepared to sacrifice the sign up funnel for content generation. It suggests LinkedIn should be considered as just another social platform rather than a tool for getting a job. Focus is on the benefit to the platform, not benefit to the user. Making posts won’t get you hired but possibly having a profile photo will. I’m surprised by the “engagement” metrics being seen as the North Star here. Profile photos create transparency and trust, and make you more memorable. Those are things you want on a job platform. Did you actually measure what fraction of people uploaded photos? That seems a more primary goal - rather than speculating about whether photos help with engagement. The latter is something you can determine from an off line analysis of existing users. In summary I would say the focus of your AB test is not to determine the value of photos (driver of engagement or job offers) but to see if changing the sign up flow results in more complete sign ups and more new profiles with photos included.

[@mussdroid]

🚀 Above and Beyond ! Emma Thanks for making impact !

[@sitongchen6688]

Hey Emma, thanks for your great video! For this question, if there is a follow-up question asking us how we can resolve this conflict metrics result? Then will it be the type of Diagnose the program question, and do you have some good idea in terms of answering this question?

[@jiehu1337]

Really would like to see you to come up with both success metric and counter metric at different business phase(AARRR).

[@emma_ding]

AARRR is another interesting framework. Stay tuned for future videos!

[@only_dejavu6889]

Solid content!

[@rongzhang3242]

Hi Emma, I am a beginning learner of A/B testing. When I saw you mentioned 'guardrail metric', I though you are talking about invariant metrics for sanity check. I supposed you would say that the experiment setup is incorrect since we didn't pass sanity check. But actually you didn't treat it as invariant metric. Could you explain more about it?

[@emma_ding]

Guardrail metrics are not invariant. They can change unexpectedly, which we want to check during or after the experiments. Eg. when rolling out a new feature, we want to improve say the revenue (goal metric) but don't want the latency (guardrail metric) to be worse.

[@janicejiang5247]

for measure user engagement, is it better to add a time constraint? eg, average invites sent out per user per day (within the first 30day)

[@xiaoxiali6134]

Amazing Chanel!!! I wish I found it earlier. QQ how would you think uploading profile photo will help detect fraud can you elaborate?

[@emma_ding]

Linkedin and facebook may have ML models checking profile photos. It will increase the difficulty registering accounts for non-legitimate purpose.

[@akshitabatra2500]

This is great! thanks

[@miagong416]

Thank you so much for this sharing! I have learned a lot! Moreover, there are lots of metrics for performance and A/B testing. Do you have any recommendations about learning metrics and their real-world practice? Is the book you showed in the video a great resource? Thanks!

[@miagong416]

For example, you have mentioned the SUCCESS Metrics & GUARDRAIL Metrics. where could we find the sum-up of different kinds of metrics? Thank you :)

[@emma_ding]

For real-word practice, I highly recommend Trustworthy Controlled Experiments by Ron Kohavi, Diane Tang and Ya Xu. For your 2nd question, I wonder why do you want to find the "sum-up"? Different metrics can be used to measure different things. I guess you mean if we can combine different metrics into a signal metric? It's possible but difficult, there are a few examples in the book in Chapter 7.

[@chihiroa1045]

Just failed my LinkedIn interview… I wish I had seen your video one day earlier…

[@jiehu1337]

Hi Emma, do I always have to run an experiments to find out causal effect.

[@songxiyou2347]

Hi Emma, me again! Saw an interesting question the other day: Suppose DoorDash is ramping up a feature that could allow merchants to set promotions (such as free delivery, 10% off) at certain period of time, how do you measure the success of the feature?

[@songxiyou2347]

It would be great to see how you would tackle this question! Thank you~

[@emma_ding]

As mentioned in the video, before defining metrics, it's helpful to start with the business goal. In this problem, the goal could be to increase revenue and/or number of users, which can help you define metrics. For running A/B tests, you can refer to this video kzbin.info/www/bejne/jmnYZ56oacurjsU and my blog post towardsdatascience.com/7-a-b-testing-questions-and-answers-in-data-science-interviews-eee6428a8b63

[@taha5754]

I took help of gpt to come up with the success metrics for this feature with the goal of increasing revenue: During promotion: 1. Increase in Order Volume 2. Average Order Value 3. Merchant revenue growth What do you think on them?

[@wongkitlongmarcus9310]

so useful

[@Namelessdad83]

For success metric, would average number of job candidate matches a good metric? I am guessing companies would like genuine candidates and the matches might go up?

[@emma_ding]

It would be a good metric as long as it aligns with the goal and the data can be easily collected. For more about defining metrics you can check out this video kzbin.info/www/bejne/iaa7lGiZoNufgJo.

[@bash8622]

I am currently applying for a CSR position in a BPO and an interviewer asked me "What are your metrics?" Can you give an example answer please? I need to know if I responded correctly.

[@sanson143]

Really usefull. Thanks

[@akshaychauhan2757]

Hey Emma, while describing 2nd success metric i.e. "Usefulness of the feature", you said that "this metric should be significantly larger than that of control group" I didn't get it. It would be very helpful if you could rephrase it.

[@emma_ding]

The metric should be able to measure whether the new feature is useful. And we want to see the value is much larger in the treatment group to prove it is indeed useful.

[@cindyzixinzhou3438]

@@emma_ding Hello Emma. I have a clarification question for it. The percentage of users uploading photos includes uploading during signup+afterwards, or just during sign-up. If it's the latter, then we cannot have control group. Thanks.