High Level Client/Server Architecture

[@ntran04299]

Hi Mike, I recently got two offers for a Data Analyst & a Junior Backend Dev. If my end goal is to become a MLE or DE, which one should I pick? Which one is easier for when I make that jump to MLE / DE? I feel so thankful for having these two offers and also thanks to your channel, I've been on the right path so far!

[@thedatajanitor9537]

Take the data role. Without SQL skills, you'll never work in applied machine learning.

[@Cahangir]

Hey Mike, good to see that you're back. Job market is so brutal nowadays that I don't even receive a call back from a vacancy for which SQL is a good plus. Why? Because of an incompetent hiring manager who thinks someone with a year of experience on Excel/Power BI is more valuable than a math nerd who is also good at data extraction. Thanks to your videos i went hard on T-SQL in the past 10 months and now im even able to solve streak(gap & island) problems on my own without assistance, on database samples that i myself have designed. I have one last thing on my to do list though. If that doesn't work either i don't know what will.

[@TwwnnTwwnn]

Mike, great to have you back!

[@thedatajanitor9537]

Thank you!!

[@datacleaner743]

Glad to see you back. Good video as always. I am interested in Azure. Can you makre a video/ course for ml and data on azure?

[@wise6469]

Good to see you on KZbin

[@thedatajanitor9537]

Hey, thanks

[@alexanderpotts8425]

Welcome back

[@thedatajanitor9537]

Thank you.

[@nabeelsohail458]

Hey mike where have you been ? it's good to see you

[@thedatajanitor9537]

Moved. What a pain in the ass.

[@jorgemendez481]

Hey Mike, how do you gather unstructured data for a Computer Vision or NLP model?

[@thedatajanitor9537]

For CV, you create a collection of images to train against. For NLP, it's all about documents. Often times the documents are text files.

[@jorgemendez481]

@@thedatajanitor9537 so you do not have to use SQL for NLP or CV? what programming language you use?

[@jorgemendez481]

​@@thedatajanitor9537so you do not use SQL for NLP or CV? what programming language do you use?

[@thedatajanitor9537]

Nope. You do not use SQL for either. For CV you images in folders. For NLP, you use document stored in folders.

[@jorgemendez481]

​@@thedatajanitor9537so the only programming language used is Python?

[@Specialstorm]

Bro i need your guidance as you're an experienced person many KZbinr are saying ML and DL is obsolete in 2024 it's mean a person wish to pursue career in this field will have to struggle to secure any job as per them this field has no future. What is your opinion? I know having strong background in data understanding and coding knowledge is must.

[@Sankalp_359]

No way, this field is only evolving and not decaying!

[@thedatajanitor9537]

There are over 400K open jobs in machine learning. It's probably the third most in-demand role outside of the full stack dev and the data engineer. The problem isn't the job, it's finding the skilled candidates.

[@miv_cleric]

There's also the whole issue of security, HTTPS, OAuth, forward and reverse proxies, load balancers, VPC, subnets, CIDR ranges, firewalls, etc.

[@MatW1lson]

Yes, but Mike's a data engineer; not a network engineer. He doesn't need to go too deep into all that. But it's definitely good to know what all that is; to a certain degree.

[@thedatajanitor9537]

Not for data professionals there isn't. Not there side of the fence.

[@miv_cleric]

@@thedatajanitor9537 Not until you need to ETL from or into a Postgres instance in a VPC different from the one your servers are in. I'm a data professional, by the way.

[@miv_cleric]

@@thedatajanitor9537 I can fix it, but you can file a DevOps ticket.

[@LuisGonzalez-m4e]

is a Machine Learning engineer also a Software Engineer since AI is software? and how important are software engineering techniques in Machine Learning?

[@MatW1lson]

No. Software Engineering is a completely separate field. Machine Learning and Data Engineering are top-level IT roles. Software Engineering is developing software (whether that's videogames, webappps or AI). IT is using software to keep the business operational... Software engineers will develop AI software or a RDBMS like MySQL or SQL Server; IT professionals like Mike will apply those tools to a particular business' needs. It's why Mike says all the time that the MLE never writes any AI models because the SWEs already did so.

[@thedatajanitor9537]

No. The models are already written. You don't write any of them. You clean data and then pass that data to the model. Software engineering is a small part of the job.

[@LuisGonzalez-m4e]

@@thedatajanitor9537 Mike I was asking because I am a python developer (i build websites and automation programs) and I also know a little bit of sql and I was thinking of switching to Machine Learning. Do you think is possible to change from Software Engineer to Machine Learning with my skills and knowledge?

[@MatW1lson]

​@@LuisGonzalez-m4e The answer is, yes. But you gotta know and apply SQL very well and should be using it heavily at your job. Because like Mike said: most of the time spent is sourcing data from a company's RDBMS and/or data warehouse. 2-3+ years of heavy SQL skills on your résumée and then passing a technical interview. Python is a general, all-purpose language. So for example, writing Django webapps may not help so much unless you are writing actual SQL as opposed to relying on an ORM. Anyway, I'll let Mike answer you but just watch ALL his videos and multiple times. And read all his Q. posts too.

[@dawudhussain274]

does a data engineer need know about rest API

[@thedatajanitor9537]

Nope.