When You Give Programmers a HUGE Database

Рет қаралды 28,394

conaticus

Күн бұрын

Пікірлер: 57

@conaticus 11 ай бұрын

The first 500 people to use my link will receive a one month free trial of Skillshare: skl.sh/conaticus12231

@phusicus_404 11 ай бұрын

Hi, is this project in production now? I'd like to actually search courses.

@AquaQuokka 11 ай бұрын

Inaccurate, no thigh-high socks.

@ClasicRando 11 ай бұрын

Not sure if this was considered, but the postgres COPY command would have likely made the first part of the video much easier

@Ta9i 11 ай бұрын

or asking chat gpt to make seeding script

@haydra9380 11 ай бұрын

i love your progress of never tried c# to start knowing it in a prev video to actually rating it the best backend lang and now; writing a whole API with it

@karlkarlsson9699 11 ай бұрын

Instead of dijkstra you could use A*, its easier to pronounce. But you really dont need to do pathfinding as the nooks and crannies of roads will even out and some would take the train so it wouldnt be a good comparison anyways.

@unicodefox 11 ай бұрын

and then you end up downloading the Network Rail open data feeds to find the duration between the nearest train stations to

@bigerrncodes 11 ай бұрын

Its just deek-struh for pronunciation sake

@unicodefox 11 ай бұрын

@@bigerrncodes dyk-stra*

@w花b 11 ай бұрын

@@bigerrncodesdjeek-strah

@zwwz1424 11 ай бұрын

@@bigerrncodesthe way non dutch people pronounce his name is so hilarious

@mwguy 11 ай бұрын

Just use postgis extension to postgresql for filter/sort by geo location

@BradenJohnYoung 11 ай бұрын

Is this what qualifies as a huge database these days?

@Laflamablanca969 11 ай бұрын

Only for the soy devs

@Dom-zy1qy 10 ай бұрын

2:25 What are we caching ? The data that was returned from the users query? What would the key be ? Would we just use the request params as the cache key and cache the response to those params? Then perform the distance filtering? Havent used redis or any cache layer before so just trying to figure out what is going on here.

@yjawhar 11 ай бұрын

Could have loaded the data into SQLite through the CLI, cleaned it there, then moved it to Postgres. Could have even left it on SQLite since it's mostly read operations taking place on the data

@Yassinius 11 ай бұрын

2:10 You should pronounce it as "Daykstra" you silly Brit.

@olgierd245 11 ай бұрын

Waiting for more! Keep up the good work, I'm curious what comes out of it.

@borhaneddineguemidi6402 11 ай бұрын

For a quick a dirty way to calculate the distance you could use the openstreet/osrm open source project

@ph03n1x_dev 11 ай бұрын

you should've asked me how to pronounce "dijkstra's algorithm" 😂 it's a dutch name. great video btw❤

@conaticus 11 ай бұрын

😂thanks, i hope dijkstra doesn't see this video

@ph03n1x_dev 11 ай бұрын

@@conaticus i think it's impossible for him to see this.... 😂

@baxkill 11 ай бұрын

@@ph03n1x_dev What happened to him? is he having problems with his KZbin account?

@AndrewTSq 11 ай бұрын

I think there is a new API for storing files on the users harddrive now, so you could probably send more than 20MB with ease :D

@Strawberry_Htet 11 ай бұрын

I also once calculated the geocoordinate. Bruteforced to map out the house numbers to lat and long😂. LoL

@neoplumes 11 ай бұрын

If you're going to store the database in redis, why not use persistent redis and get rid of postgress?

@lutzmmobil 11 ай бұрын

For sending data to the frontend, why don't you just consider using a type of pagination meaning x entries per page, page offset by x * pagenumber something like that. You don't NEED too get all results at once, that would be horrible, but you also don't need to let that limit yourselves in showing more results.

@cxarra 11 ай бұрын

If you are using your own path-finding algs for mapping, you might as well write a separate front end for it and *boom* mapping app. That is to say, you should almost certainly not take this approach and instead leverage an existing services' API such as google map's. If you really do want to go down the route of hosting and running your own mapping algs, you're going to need far more data and compute than what you're currently working with not to mention hosting it at scale will wind up costing you a TON more than just leveraging an api (which will be far more accurate in any event).

@Yett1hhh 11 ай бұрын

using Djnago for the backend woulda save alot IMO

@0xsixneufquatredeuxzero 11 ай бұрын

What is the music from 1:27?

@denitechYT 11 ай бұрын

HUGE database eh Con?👀

@kehan6252 11 ай бұрын

1:14 can someone please tell if this is bad code or not? It seems alright to me

@delofon 11 ай бұрын

2:11 "daixtra" or smth like that

@ikbenwelthuis 11 ай бұрын

Please tell me you're using Data Transfer objects because I didn't see them anywhere.

@Rami-fq4lr 11 ай бұрын

we're using result sets which contains the data we need that way we don't have to use auto mapper or map one object to another

@fullstack_journey 11 ай бұрын

wouldn't it be easier to use elastic search.

@GdeVseSvobodnyeNiki 11 ай бұрын

You should check google S2 or similar lib for querying entities within the range on a map. It's crazy efficient because you store coordinates as a bigint instead of real latitude and longitude. There are shitload of underlying math, but lib pretty much abstracts you from it.