Appreciate you for listening! If there are other topics you'd like to see us cover in a future episode, let me know here :)
@TexMurphy977 күн бұрын
To Kate’s point of the value of sometimes taking a step back reducing features. Look at a AWS Lambda written in Java and a spring boot app. So much dependencies and libraries removed. The code becomes simpler, more explicit and the entire footprint is reduced. Less is more both in app and in database.
@doitintl5 күн бұрын
Exactly - the simplification mindset totally applies both ways! As Kate mentioned, AWS deliberately (we think, at least) stripped down DSQL to push developers toward simpler, cleaner database patterns. For apps that need massive scale but can live without fancy DB features, going minimal makes a lot of sense.
@eranchetz14 күн бұрын
Yay cloud masters is back! 🎉
@mandarumare299019 күн бұрын
Hey while testing we are experiencing 99% cpu utilisation and connection are also very high after upgrade to MySQL aurora 3
@doitintl14 күн бұрын
Hey there! This is a very common scenario that we see across our customer base. Here are some things to look for in your database and application: > Review performance insights for your top queries, perform `EXPLAIN ANALYZE ` on the queries and compare the query plans between your test environment and production >> Be sure to review your database code for any index hints, query plans should be reviewed with and without index hints. >> Review your sql statements for large `IN (....) ` predicates, refactor these queries to use a different approach (eg: JOIN, temp table, etc) > Make sure transactions are as short as possible, and that your application is not holding them open for longer than necessary > Batch transactions together where possible > Review/implement the Amazon Aurora enhanced binlog feature, this can significantly reduce CPU but be aware of the limitations of this feature >>aws.amazon.com/blogs/database/introducing-amazon-aurora-mysql-enhanced-binary-log-binlog/ >> docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraMySQL.Enhanced.binlog.html#AuroraMySQL.Enhanced.binlog.limitations >> AWS DMS is not compatible with enhanced binlog > Review custom parameters and make sure they are still relevant > Review your application's connection methodology. >> Is connection pooling in use? >> Often, a spike in connections is due to queries running for longer, creating a backlog of tasks and an increase in connections >> is the database driver up to date? > Review open bugs for your MySQL version and see if any apply to you. >> bugs.mysql.com/search.php?search_for=&status=Active&severity=&limit=10&order_by=&cmd=display&direction=ASC&bug_type%5B%5D=Server%3A+Optimizer&os=0&phpver=8.0.32&bug_age=0 If you'd like to book a call with our team to dive deeper into this use case, please see www.doit.com/ and "Book a call"
@BR-lx7py23 күн бұрын
Fastly bw pricing is much less than AWS
@avikeinan861623 күн бұрын
When you compare apples to apples, Fastly and CloudFront have very similar characteristics. Additionally, when the origin of the files is S3, you need to account for the Data Transfer Out cost from AWS to Fastly. When using CloudFront, this cost is $0.
@doitintl23 күн бұрын
Piggy-backing off of @avikeinan8616 - Here's a clip from the episode of him describing the savings in data transfer costs when serving data from S3 through CloudFront vs. a 3rd-party CDN: kzbin.infomBF71w00IO0?feature=share
@BR-lx7py23 күн бұрын
@@avikeinan8616 Understood that of course you pay twice with a non-AWS CDN. For well cachable objects the dominant cost will be the CDN bandwidth, not the origin one. Plus Fastly has a much better feature set.
@oleksandrlytvyn53227 күн бұрын
Thanks
@JoshRenton9129 күн бұрын
Thank you for this really informative deep dive. Can you help me understand what determines whether a set of IO op are sequential or random? Is it just that sequential come immediately one after another?
@CiaraMcMahon-p8f28 күн бұрын
Hi @JoshRenton91, glad you're finding the videos helpful :) For an Amazon EBS volume, the determination of whether I/O operations are sequential or random is not about the timing of the operations, but rather about the pattern in which data is accessed. Sequential I/O operations typically involve accessing contiguous blocks of data on the storage device.This means that the data blocks are located next to each other on the storage device. On the other hand, random I/O operations occur when data is read or written in a non-continuous, scattered manner. This means that the data blocks are not located next to each other on the storage device.
@JoshRenton9127 күн бұрын
@@CiaraMcMahon-p8f Thank you so Ciara, forgive my ignorance, but how would one determine whether one is writing to contiguous blocks or not? If I instruct my application to write a file to disk, how will I know if it has written contiguously or not? And then in the context of EBS, how would I know if EBS as stored the blocks contiguously?
@superaafrank29 күн бұрын
Any chance I can watch the whole video or it's complete series?
@lunarchant.studiosАй бұрын
Can you share sample code for this use case?
@doitintl22 күн бұрын
Thanks for your patience! Here is the repo with the sample code: github.com/doitintl/genai-kyc
@BradieBarnettАй бұрын
OH YEAH!!! thats my dad!!!
@chrissedrick3071Ай бұрын
Is there a link to the full session?
@doitintlАй бұрын
Yep: kzbin.info/www/bejne/hajQqWdmpJh6odksi=QV5V2pHfoI-W-kqQ Also check out the episode description for some additional resources mentioned during the full episode :)
@agooodolecoderАй бұрын
typical cloud advertising.
@Themo47812 ай бұрын
Great video Dustin!
@gary22552 ай бұрын
This training is exactly what I've been looking for! The content is not only engaging but also delivered with expertise. I appreciate how straight to the point everything is, making it easy to absorb and apply the skills. Thank you for creating such valuable resources!
@philaningcobo97293 ай бұрын
Thank you, i went through many videos seeking someone to explain in a manner I would understand. take your 🌻.I
@doitintl3 ай бұрын
Appreciate your kind comment! Enjoy the rest of the series :)
@eranchetz3 ай бұрын
Happy 16th birthday EBS!
@amittweetsnow4 ай бұрын
DoIt doing it brilliantly:-)
@srinivassripathy14394 ай бұрын
Create a KEDB service for version upgrades to have a near line understanding.
@srinivassripathy14394 ай бұрын
For any DBA , application team would be the first customer. He should be there in this IT ecosystem.
@RickBeacham4 ай бұрын
Our migration has been straight forward. The BLUE/GREEN method should work well on AWS. MySQLshell tools for migration really helped to confirm any issues. Development > Staging > Production.
@juancamilovaronalozano91804 ай бұрын
Incredible service!
@Monica-x3k4 ай бұрын
Wish you would make videos about technical terms
@doitintl4 ай бұрын
Could be a good idea! Can you elaborate a bit more? And which terms that we used this video did you have in mind?
@Monica-x3k4 ай бұрын
That was real good Kate thanks
@KatsumiSato-y5w5 ай бұрын
This is so good Gen-AI & Attribution Groups features to be easier to touch with FinOps Journey!
@eranchetz5 ай бұрын
Not sure who’s more amazing, Ava or Francisco 😉
@franciscodelacortinaminder27435 ай бұрын
😂
@tundesoetan5 ай бұрын
Looking forward to the pt2
@doitintl5 ай бұрын
Thanks for watching/listening|! Anything specific you'd like us to dive deeper into?
@itannamalai6 ай бұрын
Hi. Currently we have workloads only in the morning time from say 4 am to 12 noon. And we are paying 35k for bq. Do you think we can move to flat pricing to save cost. The max slot we use is about 2000 during the peak time
@doitintl6 ай бұрын
As of July 5th 2023, you can't switch a project to be on flat-rate pricing, so your options for BigQuery are either on-demand or Editions. Some follow-up questions to help us make a recommendation: Are you consistently using 2000 slots during 4am - 12 noon, or is it very spiky? If spiky, are the spikes at the same times during that timeframe? Additionally, how many TiB of data is being processed per day during that timeframe? Last question, are you using anything like Looker or dbt? If so, there could be some tricks you could do to bring your slot consumption down from 2000.
@SatyamGupta-yh6jw6 ай бұрын
Loved it guys
@baligo37606 ай бұрын
Interesting content, thank you! Couple of times I had performance issues with Aurora Mysql. I tried increasing the class of the db instance, I also tried adding read replica but it didnt help at all - the app was running long queries without parallelism and it was only using one core of the RDS so the more powerful instance did not change the times at all. For that case (and another similar one) switching to RDS MariaDB worked out. It turned to be 2-3 times faster than Aurora Mysql with same instance class. Could you comment?
@doitintl6 ай бұрын
Thanks for watching the episode + glad to hear you liked the content :). Now to answer your question (via Kate from the episode): "MySQL is in general a single-threaded database designed for high volumes of queries as opposed to large analytic or data warehouse type queries. MariaDB and MySQL are optimized for different types of workloads. Something that works well in one may not work well in the other. MySQL tends to excel at complex joins and sub-queries whereas MariaDB is often better at recursive CTEs and analytics. If you wished to stay using MySQL rather than MariaDB, then you can look at parallel query on RDS Aurora MySQL. This allows you to run complex queries directly against the storage layer in a parallel fashion. docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-mysql-parallel-query.html"
@baligo37606 ай бұрын
@@doitintl Thank you, perhaps we will give it a try
@AhmarAhmar-mk9uw7 ай бұрын
Hi
@muralipollam31548 ай бұрын
Where can I find the link for the blog post?
@doitintl8 ай бұрын
Here you go: engineering.doit.com/aws-public-ipv4-price-increase-the-complete-guide-73c4c62ae18e I've also just updated the episode description with it, so thanks for asking!
@tommyantony86408 ай бұрын
Quite educative even for people who are not tech oriented…. Good job.
@angelarosemaria64298 ай бұрын
Great work Alfred ❤🎉
@xiwang28559 ай бұрын
Thank you for the explanation of EC2 pool. This is a small concept but no one said it clearly like you did before.
@annmaria45599 ай бұрын
Great job, Alfred! Loved your insights! 🎉❤
@eranchetz9 ай бұрын
What tools are available other than LLMStudio? Are there any industry standards already?
@ZaarsShed10 ай бұрын
Thank you Matthias! Looking forward for Part III!
@_AKA_ThaScientist10 ай бұрын
Thanks for the video. I am completely green on this generative idea topic.
@satishtripathi664610 ай бұрын
What’s that tool called ? Is it alternate?
@doitintl10 ай бұрын
AlterNAT - github.com/1debit/alternat
@najrulmondal16410 ай бұрын
good video
@doitintl6 ай бұрын
Glad you enjoyed
@andrewbateman2282 Жыл бұрын
Thanks, good explanations.
@ADV-IT Жыл бұрын
Very informative, thanks!
@ADV-IT Жыл бұрын
Please record screen with at least 1080p resolution as in 720p it's blurry.
@eranchetz Жыл бұрын
Watched just the first 15 minutes and already learned a couple of things, can't wait to watch the rest and the next episodes 🧑🏫
@dalefixter Жыл бұрын
love this video, super clear, value-add to an already awesome platform. I will be using this information feed internally too :)
@traciestamm2572 Жыл бұрын
Great video, love this format! 😀
@eranchetz Жыл бұрын
It’s such a pleasure working alongside those amazing engineers, we’re so lucky to have you on the team 💪