My Tips on How to Start a New Project in a way that Improves Your Chances of Success, in this FREE Guide ➡ www.subscribepage.com/new-project-guide
@rainerausdemspring8942 жыл бұрын
In my experience - 40 years of Software design and development - I can tell you that almost all projects go as follows: 1) The customer decides what it will cost. 2) The customer decides when it must be finished. 3) The users tell you what they think they need. 4) You make an estimate based on 1) 5) You start designing the software 6) The users change their mind every week. 7) The customer's project leader - who doesn't know anything about software development - asks you if it cannot be done faster and for less money. 8) Go to any of the previous steps. By the way, I am talking about global players. Thank God I am almost 68...
@thewiirocks3 жыл бұрын
"We should be, by definition, always be working on new problems." - I'm always amazed at how this confuses managers and developers. They think their job is to crank out the same thing over and over again. To which I reply, "We have these devices that are very, very good at repetitive tasks. I think they're called Computers? If a task is repetitive, a computer should be doing it."
@MrNathanstenzel3 жыл бұрын
Right. If they want to have someone do the same coding done in many different applications, let the developer work on making proper and complete solutions and libraries and hire some kids right out of highschool to work under them to do the repetitive grunt work.
@thewiirocks3 жыл бұрын
@@MrNathanstenzel If you’re doing it right, grunt work doesn’t exist. Or at the very least, it dries up very fast.
@MrNathanstenzel3 жыл бұрын
@@thewiirocks regardless, having new workers do the grunt work and then get assigned more difficult tasks will let the main programmers focus. They can recieve training or self train if there is not much for them to do.
@thewiirocks3 жыл бұрын
@@MrNathanstenzel It is really, really, REALLY hard to assign out grunt work that doesn't exist. If you're doing it right - GRUNT WORK DOES NOT EXIST. It gets automated out of existence very rapidly. Self training is nice. Directed training is better. Paired programming in a highly effective team is unstoppable.
@MrNathanstenzel3 жыл бұрын
@@thewiirocks you must have worked for a place that allowed proper programming instead of essentially forcing you to do the same thing over and over in a copy and paste fashion. Doing things right takes more time than doing it stupid and quick.
@slayemin3 жыл бұрын
1) Software engineers tend to give estimates based off of an optimistic idea on how long it will take to implement something. They don't tend to factor in unanticipated problems and what it'll cost to overcome them. It's these unforeseen problems which throw estimates off. 2) Not all software engineers are equal with levels of proficiency and talent. If you take your standard developer and assign them a productivity value of 1.0 as the standard baseline, then the range of developers will be anywhere from -10.0x to 10.0x. You might ask, "How is it possible to be negative in productivity?". Some "developers" are going to cost other developers time as they need to have someone hold their hand through development, or they introduce so much sloppy work that it costs another developer significant time to refactor it. Always factor in the talents and abilities of the people working on the project. 3) I tend to look at features and try to assess if its going to take days, weeks, months, or years to implement. These are the orders of magnitude, and if you look at the problem as variations in orders of magnitude and each order of magnitude is treated as a standard deviation, then the true time cost is going to be within one order of magnitude of the estimate (with a bias towards a pessimistic estimate). If you think its going to take 1 week, it'll really take anywhere from a few days to a month to implement. 4) The other factor that's often overlooked is the organization / company which is implementing the software development. I worked at a big tech company recently and I was finding that 75% of my day was spent attending meetings. The other 25% was for actual development. I was amazed that anyone could ever get anything done. The larger your team is, and the more surface area you get with feature exposure, the amount of time spent on new development seems to decrease exponentially to an asymptotic zero. So, estimates can't be done in a vacuum because organizational dynamics will affect productivity.
@BuffNerdInCa2 жыл бұрын
Well said and quite true.
@devopsbytes2 жыл бұрын
Well said sir. The first point is the most crucial. Even if it’s a single line of code change, you never know what kind of errors are you going to cause because of it. Estimating anything is pure delusion.
@aloha276 Жыл бұрын
Do you charge for estimates ?
@rosomak82448 ай бұрын
I have found that in case 4) most of the work gets done by those people on not paid overtime. Run.
@GeoffGroves3 жыл бұрын
I ran a dev-ops shop at ATT for 4 years with 150+ devs in four cities. Dave, I wish I could have played this video to the stakeholders every Monday morning. Damn sure would have made them sign an awk that they "viewed and understood" the content of this video.
@issussov Жыл бұрын
I recentlu found this channel and just spent this weekend to watch as many videis as I can! Being in the field for more than 20+ years already thought me about 90% of the things, though now is the time to say a HUGE thanks for validating most of the ideas I came up with and dismissing others. Every video I watched was to the point, presented with great examples and explained in a "as simple as possible" way. Thanks again here, for being a great example on how this is done! I strongly believe that everyone in our industry should benefit from the knowledge base here. Further more every C-level person(or maybe everyone in the industry) should sit back, take their time and listen closely. I do believe the content here could be a game changer and a reason for success. Thanks! (again and again)
@ContinuousDelivery Жыл бұрын
Thank you for the very kind feedback 😁😎
@VidkunQL3 жыл бұрын
There was a "Blondie" cartoon I saw in the newspaper years ago and didn't save. Dagwood: How long will it take you to paint these rooms? Painter: Two weeks. Dagwood: I could do it myself in one week! Painter: Are you going to do it? Dagwood: No. Painter: Well if I weren't going to do it, I could do it in three days!
@ContinuousDelivery3 жыл бұрын
I can do it in two! (as long as I don't have to)🤣
@cavorkehl67773 жыл бұрын
3 days times 4 is about 2 weeks, that seems like an accurate estimation!
@twinkytwinklier40473 жыл бұрын
@@cavorkehl6777 My current proj took 5 months, and possibly need another 2 to finish. Initially I thought it wouldda took 1-2 lol. This is surprisingly accurate!
@FreedomMoped3 жыл бұрын
@@twinkytwinklier4047 Currently on week 4 of a “2-week sprint”. One of our (genuinely) genius mentors that I went to for help completely overhauled the approach, then had to bring me up to speed which put a bomb under everything time-wise. The point is that something like this, something completely unpredictable, seems to happen almost every time!
@AnthonyJackman3 жыл бұрын
Awesome Quote!!!
@jaadow773 жыл бұрын
Rule of thumb I leaned once: Take your best guess. Double it. Go to next higher unit of time. Seems to work out right for my home improvement projects.
@DudeWatIsThis3 жыл бұрын
1. Take your best guess. 2. Double it. 3. Go to the next highest unit of time. 4. Lose the job to some other company who will just do step 1 and then figure out the best ways to tell the client they're sorry.
@Metaspace23 жыл бұрын
You forgot to add a zero at the end and then square the result
@Swordfish3932 жыл бұрын
Then some new guy shows up, writes it in an afternoon, and makes everyone look bad.
@petebrown63563 жыл бұрын
I also use the "small-medium-large" process, usually with a multiplier upon submission :) People expect software estimates to be nothing more than a combination of known tasks, like your example; making coffee, or changing a tire, grilling a burger, etc.. - except it isn't like that. The REAL DIFFICULTY is providing estimates around a large project for an external customer, it decides whether or not you get the contract. No two companies will estimate the same, nor make the same assumptions. A naïve customer may go with the lowest bid and experience endless project change requests demanding more money, all because stated assumptions were broken. Having more experience only helps but doesn't guarantee a thing, you just have more projects to compare to. That said, if what the customer wanted already existed they wouldn't be coming to you to create something new. We've all seen and heard about very large software projects going way over initial estimates. This video is helpful to anyone, not just software developers.
@shavais332 жыл бұрын
This was a very interesting listen. In my previous job, at a very small company, the owner was very insistent on getting estimates for entire projects at a time and was very upset if they turned out to be inaccurate but was also very upset if they were too long. Now I'm consulting for IBM, and it is as though they'd heard this exact talk some years ago and have built these ideas into their processes. You can easily guess which job is less stressful and more productive.
@ZlothZloth3 жыл бұрын
I was often told that, as I gain experience, my estimates will get more and more accurate. Well, it's been decades now. I guess they are a little more accurate, mostly because the design I think up initially is closer to what gets implemented in the end, but I still consider myself lucky if I'm within a factor of two. Getting within plus or minus 10 percent, even in an "ivory tower" situation, is still way beyond me. I can't possibly speak for everyone but I suspect what managers are actually seeing when they see estimates become more accurate is that the people doing the reporting are learning to lie more effectively. They think project A will take 10 hours and project B will take 20, so they tell you A will take 35 hours and B will take 50. Project A actually takes only 15 hours but they still tell you it took 35 because B ended up taking 100. The other 15 hours came from working over the weekend without telling you.
@ianmiles25053 жыл бұрын
That is the truth and the most hated aspect of it.
@matthewbrightman33983 жыл бұрын
The truth shall set you free. But first it’s gonna piss you off.
@petebrown63563 жыл бұрын
...because the software you're developing has grown in complexity over the same period of time. You're constantly estimating what you've not done before. Your experience does help but I believe most have the same problem.
@HumblyServingGod2 жыл бұрын
Nailed it
@azzyfreeman2 жыл бұрын
Yep, ask extra time on simple tasks to get time on complex things
@ItsTheMojo3 жыл бұрын
I once had a manager who insisted on coming to my desk with an idea for a feature or something for which a client had asked. From the very first time they did that I told them I couldn't even give a meaningful guess (and by meaningful I mean something that is not just obviously ludicrous) without more information about the idea or feature. That didn't stop them pushing me then and there for an estimate (with the false promise that they wouldn't hold me to whatever I said). Nor did it stop them coming to me and doing it again. What eventually worked was that I started responding loudly with, "One million years!". It still took three or four times, causing everyone in the office to look up and wonder what was going on each time I belted it out. I understand that managers want to know so that they can budget. And project managers want to know so that they can allocate resources. What they fail to understand is that needing to know something doesn't make it possible for the knowledge to be made available. And then, after agreeing that the estimates we give are just guesses and will always have significant margins of error, they get upset if software isn't delivered at the time given in the estimate excluding any margin of error. The only time I worked anywhere that had anything approaching accuracy in estimating was one where the task of estimating was so involved that what we did was go through the code, figure out exactly what needed to be done, down to which lines of code needed to be changed or added, what tests would need to be written and anything else that might be needed. We'd sometimes spend days coming up with estimates, coming fairly close to doing the actual work to come up with an estimate for the effort required to do the work. That company continues to be very successful in their part of the industry, but I think that it's more because the charge a lot for their software (which is very good, to be fair) than because their approach to software is good.
@Name2608122 жыл бұрын
Can i say i have a word to word situation as well. This is not what Agile rulebook says about what to do in this scenario. Because it is agile, it is expected that we can just do it on the go.
@bekliev3 жыл бұрын
I've made a mistake when I've once gave optimistic and pessimistic estimates - 'cause business took optimistic estimate and ignored another which led to bad circumstances and I became scapegoat. And I warned many-many times that they shouldn't rely on optimistic one. But they didn't listen So now... I don't give 2 estimates anymore - only 1 - the pessimistic one
@pwuk3 жыл бұрын
"It is difficult to make predictions, especially about the future." (Various)
@brahmcdude6853 жыл бұрын
Manager:”how long?”. Me:”I don’t work with deadlines”. Manager:”then maybe you should not be working here”. Me:”way ahead of you”.
@danielschulz73913 жыл бұрын
I laughed way to hard about that xD
@ContinuousDelivery3 жыл бұрын
🤣
@pwuk3 жыл бұрын
"When its ready"
@someoneelse50053 жыл бұрын
some serious Dilbert vibe here
@FreedomMoped3 жыл бұрын
Nice.
@gpzim9813 жыл бұрын
This is the best channel on KZbin for software developers
@fedos3 жыл бұрын
The "throwing estimates" routine is actually an informal form of the Delphi method. This is one of the best ways to get a forecast from a group of experts.
@zapazap3 жыл бұрын
I will watch this video after first mentioning my approach. I want, from a developer trying to write a deliverable product, two numbers: an interval of time, and a probability of delivery on the end of that interval . By setting the probability low, the developer gives himself/herself increased allowance for having missed it. My assumption (good or bad) is that if the product is not deliverable at that end of the interval, the same interval and probability reapply. I do this for estimating my own time in producing something for myself. I estimate (say) that I have a 90% chance of completing this in an hour, with the thought that if I fail to do so I will have a 90% chance of completing it in the next hour. This lets me, as a planner, create a probability function over time for product delivery, and reduces pressure on my programmer to have to live up to one single number. By allowing them to choose duration and probability, they have more flexibility in expressing a commitment.
@MrNathanstenzel3 жыл бұрын
"How long will it take" was always a big challenging question for me. Damned time quotes. I do not know much about a time estimate until I start. This video got a "Subscribe" from me.
@MortenSlottHansen3 жыл бұрын
I've given up estimating as the specifications changes as we progress - so it doesn't really make much sense to spend time up front. Trust is key - just work and get things done.
@MikeStock883 жыл бұрын
I always think the question is what is the value in trying to be accurate up front by spending time figuring it out vs actually doing it
@alex_chugaev3 жыл бұрын
Exactly. But business-wants-estimates-to-calculate-budget. I guess it's a major reason why we still doing this crap.
@MrNathanstenzel3 жыл бұрын
@@MikeStock88 Sometimes making the estimate would take longer than doing the work. I think they should alot an hour of automatic billable time for every estimate request. That could perhaps actually get clients to choose not to ask for an estimate and pay less.
@MikeStock883 жыл бұрын
@@MrNathanstenzel Exactly! If you want accuracy it costs time and sometimes that time would be better spent actually doing it :)
@anoopmahadevan58896 ай бұрын
03:14 🎯 Accuracy vs. Precision: Focus on accuracy over precision in estimates to avoid misleadingly detailed predictions. 07:45 ⏳ Small Steps Approach: Break down work into small, manageable features to increase prediction accuracy. 12:30 🧩 T-Shirt Sizing: Use t-shirt sizes (small, medium, large) for estimates to limit precision and encourage breaking down work. 19:02 📈 Track Actual Performance: Track recent performance to extrapolate future estimates based on realistic data. 25:10 🎯 Fixed Date vs. Fixed Scope: Understand the difference between aiming for a fixed date or fixed scope in estimation. 29:45 🔄 Continuous Learning: Software development is an iterative process of learning; adaptability and flexibility are key in estimation. 32:18 🚀 Continuous Delivery: Continuous delivery allows for releasing at any time, providing freedom in development and adapting to user needs.
@m.x.3 жыл бұрын
And ex-manager once asked me: "What's the part that you struggle the most with?" I responded "time estimation, do you have any literature or advice on that?". Then, he went "It's indeed the most complicated part of our profession. I sometimes use a simple trick: your realistic estimation times 2 (at least), or even 3 if the system is very complex or you don't have enough information". My face was like "oukey :v", but it kinda works xD. If you want to do it properly, I'd suggest tracking your time taking into consideration all possible variables. For instance, type of task, technology, complexity, unit tests, integration tests, lack of information, level of dependency from other colleagues and teams, etc.. Also, the number of interruptions (meetings, etc.) or level of insulation from distractions (colleagues interactions, noise, etc.), and even your physical and mental condition. There're already apps and tools that could be integrated in order to apply time estimation formulas.
@arasiyalpesumilaiyor2 жыл бұрын
One of the most valueable video i have watched in youtube so far. Love this guy.
@harag93 жыл бұрын
As a developer I hate giving estimates, especially when I'm working on large old projects. Sometimes I have a rough idea, e.g. a week but I will use the "scotty principle" and multiple it by 4. Then when I do finish it in a week I'm a genius, if issues happen and it takes 4 weeks, they (I told you so)... Scotty Principle is from Star Trek - Scotty always multiplied by 4 when Cpt Kirk asked him how long repairs would take... Great video though. Thanks!
@stephanklein2573 жыл бұрын
Best summary on "how to estimate" I've come accross so far. Thanks for sharing !
@ContinuousDelivery3 жыл бұрын
Glad it was helpful!
@mhzprayer3 жыл бұрын
15:50 "..is an exercise in learning and one of the things we learn as we proceed is what the target actually is" Now that is PROFOUNDLY accurate
@shishirsonekar5661 Жыл бұрын
Wow I have spent around 3 hours watching this video, reading some references in the video, by making my ultimate notes. I think it's worth it because, from now onwards I'm sure I am not going to feel extremely overwhelmed after watching my JIRA dashboard every week.
@kozlovskyi5 ай бұрын
Jira is a joke
@HansPeterWillems3 жыл бұрын
90% of the work takes 90% of the development time, the remaining 10% of the work takes the remaining 90% of development time 🤣
@roostbait3 жыл бұрын
Another twist on the same topic is that 90% of software projects are 90% complete 90% of the time...
@edgeeffect Жыл бұрын
A reliable estimate will take 110% of the delivery time.
@hishamelfangary722 Жыл бұрын
This is painfully true
@rykro19753 жыл бұрын
You understand how it works and you say it. What you are saying is the obviousness I have felt in my bones for 25 years of work, but so much misunderstood by business. I wish my bosses would pass exams on what you say. I want to work for you, be my boss :)
@ContinuousDelivery3 жыл бұрын
😁 😎
@destroyonload34443 жыл бұрын
When I free lance I tend to estimate and educate. I have a previous background in global business supply chains and was at a director position before I stepped down to fully dive into app/api engineering. If the potential client is essentially a start-up, I tend to speak in terms of sunk cost, opportunity cost, MVP, and risk/reward potentials: since that's the language they understand. They don't understand dependency inversion and creating proxies and have no intention of learning the concepts. I will happily give them the reality of how long a project could take based on known knowns, known unknowns, and unknown unknowns in terms of cost and talk about budget. If I can see myself EASILY (keyword) hitting that budget with dev time, I'll let them know that upfront and help them avoid a business-killing decision where the risk far exceeds the reward. It takes good communications skills to establish trust to get as close to the real numbers as possible, because the first budget they tell you is a lie when their defenses are up. I'm sincere in wanting to protect their business and not unfairly enrich myself at their expense. I can guarantee this is much harder to do with larger projects as a member of a team without access to financial data. Besides, there's too many hands in the cookie jar to figure this kind of thing out with any kind of real accuracy. I'm curious how different companies manage their projects' timeline goals and budgets for core and desired features. My guess is, from my experience, they don't and essentially have no idea what's going on. That goes into another topic of the systemic failure of properly knowledgeable managers and visionary leaders. It's rare. You care more about them than they do you and their own business, and they exploit it.
@ContinuousDelivery3 жыл бұрын
Yes, I have seen a lot of similar things. Where there is sufficient trust established, my preference is for "venture-captial" style, incremental funding, "We think we we see an opportunity here", "here is enough cash to explore, come back when you know more" and so on. I also agree with you that most orgs don't even track this stuff and make decisions based on hunch and "we have always done it like that" rather than data. I also agree that there is often a dearth of leadership, with many people in big orgs focusing on personal, tactical advancement, rather than the real outcomes of the org. Sigh!
@firassallam92522 жыл бұрын
Dave, the bad news is that despite the very "Accurate" and "Precise" facts you've mentioned, senior management and businessmen still need an "Estimate”, so, my advice, sell them an optimistic estimate (in the feels and looks), but very conservative from the inside, this is the best approach. Unfortunately, scientific approach does not apply to how most businessmen think or practice. And they are right, sometimes. You still need to have a margin for gambling. This narrow margin can make or break the company (I know), but when it works, the businessmen will take all the credit, if not, it’s the developers' fault...!
@danielwilkowski5899 Жыл бұрын
This channel is absolute gold.
@JavierSevilla3 жыл бұрын
Keep up the good work, I love your videos. By far the most accurate representation of real world development.
@ContinuousDelivery3 жыл бұрын
Thank you 😎
@HughCStevenson1 Жыл бұрын
Yes! I am an electronic hardware engineer and have been designing high technology products with HW, FW and SW for a long time. People try to do what I call "Estimation by Synthesis" where they break stuff ddown and say "That bit will take 2 months", etc. This gives hopelessly optimistic estimates. I do "Estimation by Analysis" where I try to find a recent project that is somewhat comparable and use that as a gauge - multiplying and divivding to allow for differences. This usually gets within a factor of 2x up or down, compared with >5x for the synthetic estimate! Syntehtic estimates usually need to be multiplied by Pi to improve them... :) Estimating a whole SW project by creating stories and scoring them is totally fatuous, IMHO. It is completely against the principles and ends up with a hopeless estimate.
@ContinuousDelivery3 жыл бұрын
What other 'software project management' questions would you like to see answered on the channel? LET ME KNOW 👇
@euge03 жыл бұрын
How to foster teams that can make decisions about the product instead of waiting for the "decision maker"? I've always wondered about that one.
@ContinuousDelivery3 жыл бұрын
@@euge0 I will think about that, good idea - my quick tip though is to make the Biz-owner, PO (whatever you call them) a member of the team and try and get them more engaged. It makes them see what it really takes to make the SW and it allows the team to learn more about the product and debate it with the PO - it starts the move in the right direction.
@euge03 жыл бұрын
@@ContinuousDelivery Thanks, Dave. Making the PO part of the team would definitely alleviate that issue. I think there's a lot of variation to this bottleneck problem that can be explored, so would love for you to do a deep-dive into it. Always look forward to your content. Keep it up!
@1myfriendjohn3 жыл бұрын
Great video, I tend to work more on the infrastructure side of a software company so it is always important at the very first conversation to get as much info as possible so I can hold them to it without "scope creep" becoming an issue. It becomes a fine art after a while. I also have that t-shirt!
@pedrolopez80572 жыл бұрын
I've used function point analysis a few times and it worked for me. Overtime you can fine tune the function point weights to get even better estimates for your specific environment.
@chrisneff78 Жыл бұрын
This video is so spot-on, I'll need to share this with my whole team.
@Sjwnbszhbsjnbvvs3 жыл бұрын
Thank you for this summary. There are many good ideas but what was left out are the real world problems. You said you estimate only, if you are forced. But being forced to estimate complete projects is common because managers learned it that way and customers require it. The question is how to resolve this natural conflict. You cant say "don't estimate".
@ContinuousDelivery3 жыл бұрын
I try to have a rational conversation of avoiding fixing time & scope, and ask which is the priority. That allows you to start with a rational plan instead of a fairy tale. If you can't make any progress with that, then cross your fingers and give them you guess, but ideally with some error-bounds, a best and worst-case guess.
@Sjwnbszhbsjnbvvs3 жыл бұрын
@@ContinuousDelivery Thank you for your answer. There are projects where this strategy works. But those projects are probably no fix price projects. It is just the nature of fixed prices that you want to shift the risk to someone else. But you right giving this a try is always a good idea because a working result is in every case better than being feature complete.
@henrikvendelbo11173 жыл бұрын
I fully agree with the stated impossibly of estimation. Even SP is of limited value. S/M/L is about the possible precision. Unfortunately this leads people to insist that you can’t plan what you want to make in any detail
@thigmotrope2 жыл бұрын
I was brought into new to a new team and was being "forced" to estimate a large project once. The team had no history, and no one on it knew much about what all needed to be done. I analyzed the work and produced an estimate that I was very unhappy with. I told the manager "here you go but it's b*******". She was pretty unhappy with that response, and I felt bad about it. I found McConnell's 2006 Bill "Software Estimation" and it really helped frame the problem. We re-estimated and reframed the estimate with a lot of his material including the Cone of Uncertainty. It went down much easier this time. There are reasons people want estimates, and they are not terrible because they want them. And estimates do provide an opportunity for the team to understand the work. It takes time to do that though and McConnell does stress that and has a take on diminishing returns of re-estimation. Overall, for most software projects it's art not science. McConnell states this as well and does a great job at looking at the science of estimation and how it only applies to a narrow set of cases.
@matthewbecker28872 жыл бұрын
What is typical or good value for a team's velocity volatility that you have seen? To make sure our definition of volatility is aligned: volatility = stdDev(of: velocity, over: 4+ previous iterations) / expectedTeamVelocity. Example: my team has an expected velocity of 7pts, their observed velocity has a standard deviation of 2pts when looking at the last 4 iteration's velocities. So their volatility would be: 2pts / 7pts = ~28%. In my limited experience of teams that actually bother to measure and quantify such things, this is the best value I have ever seen. Most teams are in the 40-60% range. I hope I'm not so late that you won't see this question, I would love to get some thoughts about where you think 28% sits even if that comes with all kinds of assumptions. Love your content! Without fail you are able to clearly articulate something about software engineering craftsmanship that I completely agree with and couldn't say better myself! My co-workers and I are a small fan club of yours.
@roostbait3 жыл бұрын
Excellent talk. Thanks again. I'd like to suggest a few related matters that you might want to look into as well: The relationship between software cohesion and coupling with the ability to estimate large systems. The effect of integration (people and components) on estimations of large systems. The identification of critical paths of dependencies of both tasks and the people executing them (TOC throwback).
@colinmaharaj3 жыл бұрын
I told a group in my company that I will write an ETL tool for them and give me a few weeks. So far Im into month 3. This ETL thing is complex to write but its designed to be easy for the user. Making anything that's easy for the user, is hard for the developer.
@JorgeEscobarMX2 жыл бұрын
Bro, just point them on an AWS glue/SQL integrations services/informatica power center course and be done with it.
@colinmaharaj2 жыл бұрын
@@JorgeEscobarMX don't know much of these things, will look into it.
@Name2608122 жыл бұрын
use kafka - unsolicited advice :)
@kostasgkoutis85343 жыл бұрын
I agree on everything you said 100% and it's very inspiring that people start talking about the burden of "estimates" - guesses as you said - to the industry. But I think it's also important to name as well the elephant in the room, the magic word that is to blamed for: Budget. This all happens because of "budget restrictions". The fact that someone signed at some point in time a paper that locks down the scope to a fixed date preagreeing everything without consulting you first, most times without even consulting other members, experience from other projects etc. And now you have to pay the price about it and deal with it however you can. Budgeting seems to me a very dated idea that cannot stand the challenges of software development. Yet it somehow persists throughout the industry as some (managers mostly) see it as the only possible tool to do business with, however catastrophic its results prove to be.
@ContinuousDelivery3 жыл бұрын
Yes, really common for orgs to be a bit agile in developent and totally waterfall in terms of governance, budgetting and org-structure - doesn't work very well. There are other models for governance, some described in the "Accelerate" book, but all of the ones that I have seen have been iterative and more like "internal venture capital" than "planned budgets".
@ZlothZloth3 жыл бұрын
Management probably just wants to be able to do price comparisons. Feature A is going to cost $50,000, feature B will cost $80,000, and so on. What happened where I worked was that estimates were "fairnessed" away. You clearly can't be developing while you're helping with some other emergency, so the estimate only covers hours spent on the feature set, not calendar days. Also, if the requirements are off base, obviously you can't be expected to estimate the time spent going from what they asked for to what they really ended up wanting. Oh, and who's going to do the coding is a big deal, of course - junior developers can't possibly work as fast as senior developers. By this point, though, the estimate really isn't useful for doing the planning that management wants to do. I don't know why those went over well while "it's really not possible to say" didn't, but there it is. Don't be too harsh on the management side, though. The other side of that price comparison is figuring out how badly the business needs the feature, which is at least as nebulous as our estimates. They are essentially being plopped down between two clouds then asked to figure out which one is heavier by sticking one hand in each. Still, what happens when programmers are forced into these estimates tends to be really ugly, both for the programmer and the company as a whole.
@alex_chugaev3 жыл бұрын
Totally agree. Broken estimates is the one of major reasons of burnout
@kmac4993 жыл бұрын
In answer to this question from a renowned slippery business analyst in my then company who always blamed the programmer. I said "well if you can tell me how many words will be in your specification" His sharp answer was "I can't tell you that I haven't written it yet.." This was many years ago before 'Drops Mic' was a thing
@TheSecondMessenger3 жыл бұрын
Great video. Surprisingly interesting! Love the Solar system shirt too. 🌞
@csati3 жыл бұрын
I got super super excited when I heard the name Steve McConnel, the author of my all-time-favorite programming book: Code Complete. I'll start reading Rapid Development ASAP.
@ContinuousDelivery3 жыл бұрын
Yes, both are excellent books
@00Trademark002 жыл бұрын
I find that the best way to estimate is to forget all specific details of the current project/task and to think about similarly complex and small/large tasks/projects in the past and how long those took. Then just take the maximum of those previous ones and that will be a fairly good estimate. If you are doing something genuinely unlike everything you've done so far then ask people who have such experience. The beauty of this method is that it does not rely on any specific project details. Of course the aim here is a ballpark estimate - 1 man-day vs 10 man-days vs 100/1000 man-days...not an exact number of days. So in this way it is like the T-shirt size method.
@ultimategames66703 жыл бұрын
the trick here is to manage expectations. so also to tell the client/manager what they get with the budget and timeline they offer. so tell them the truth. or else you will have to meet there expections which will be very hard to meet.
@gilfreundlich43503 жыл бұрын
I just "discovered" you on KZbin Absolutely EXCELLENT (maybe it reflects what I *have* been finding on KZbin). (I, too, have read "Rapid Development" back in the day)
@tudor18993 жыл бұрын
You are so good. I'm a complete beginner as a developer but everything you say strikes me as incredibly invaluable based on my experience in other fields. Thank you very much for your sharing your thoughts.
@ContinuousDelivery3 жыл бұрын
You're very welcome!
@JustLetMePickANick3 жыл бұрын
"The hardware is mostly in place...." Classic red-flag.....
@petebrown63563 жыл бұрын
...depends on industry. In mass production automotive, silicon (HW) contracts are done before the SW is barely started. I'm not saying it's good or bad, just what it is. In general though I'd agree...you know what HW you'll need once the SW solution is well understood.
@ThekillingGoku3 жыл бұрын
Only one problem ... We are forced to make the estimate anyway. Sales wants to sell projects and customers want a budget proposition. No two ways about it really. On top of that, you're never just the only one bidding for the project. So you simply will not sell 'we shall see when we get there' when the competition is like 'gimme 50 days'. Even on internal projects management always requires an estimate. Yes ... They really are the bane of any software development team.
@raulraul813 жыл бұрын
This is valuable. And the format is unique. Keep it up!
@f1amesoff Жыл бұрын
I like how my manager asking me every day "how much time left", despite the fact he received storypoint estimation for this particular task just yesterday. 🤦♂
@mattiasthalen3 жыл бұрын
Great video! Recently had a conversation with a stakeholder. Was forced to give an estimate on a feature and guessed 1-2 weeks until it was in production. After 1 week, I get an email about me being late on a deadline I apparently committed to… 🙄
@ChrisAthanas3 жыл бұрын
We all learn this the hard way My CS professor told me to estimate as large as I could possibly imagine And when the customer balks, talk about reducing the feature set or defining the problem more and then pair it down by 10% each time
@SolidousMdz3 жыл бұрын
It sucks I didn't have you as one of my CS teachers.
@ContinuousDelivery3 жыл бұрын
😉
@IntraFinesse3 жыл бұрын
When I was a CS undergrad, we had a professor who wanted each function/procedure so well documented it became a disincentive to making small functions. You were better off with a huge function because of the time savings in documentation.
@ContinuousDelivery3 жыл бұрын
@@IntraFinesse Yes, it is not uncommon outside accademia to say such things, but I believe that comments are often used as a crutch to support poor code, but to write good, readable, code. I think focusing on minimising the need for comments helps focus our minds to write better code!
@IntraFinesse3 жыл бұрын
@@ContinuousDelivery I agree. I have found that using long and descriptive function names, and modularizing code, its much easier for others to follow. "go read the massive and outdated documentation" doesn't help much.
@cavorkehl67773 жыл бұрын
Unless you have many chances to practice software engineering in school, or you probably won't understand what the teacher is talking about. More likely one recieve these ideas too early would become too defensive in work place, I think.
@gilbertusac2 жыл бұрын
This is something I have been looking for a long time! Thanks for sharing your expertise
@ContinuousDelivery2 жыл бұрын
Glad it was helpful!
@romeli19413 жыл бұрын
Oh my god. This channel is so informative and helpful. Thank you so much!!!
@markemerson983 жыл бұрын
im with you on the estimates. i detest the question. but what to say to the product owner who is pressuring the team for estimates in the next sprint? what to say without causing a stir? as we all know telling the ceo there are no estimates will result in "theres the door" also what if we dont have past estimates vs actuals? its not acceptable to a client that we dont know when we will deliver - does any of this makes sense?
@ContinuousDelivery3 жыл бұрын
Well first step is to get the PO to watch my video 🤣 🤣 The advice that I have given here is my best take on what to do to gain those estimates. I think that it is useful to think in terms of "error-bounds" and one way to do that is to ask the team for "best-case' and 'worst-case' estimates and give those to the PO. If they are dumb, they are only going to hear the 'best-case' but otherwise it will help them to see the degree of uncertainty. You can use the "Steve McConnell" numbers, "4x at the start of a project" for the case where you have no actuals, though as I say in the video no-one will like estimates this pesimistic. The only other thing is to think of past experience of similar work. The closer to your situation the better, if this team did something similar together, use that, if individuals from the team did something similar use that and if you did something similar in a different team or org, use that. But be conscious that as you trraverse this list, your accuracy, inevitably, goes down,
@spuriustadius50343 жыл бұрын
Never give a casual estimate to answer the question "When will it be done?" Any answer you give, no matter how conditional and off-the-cuff will be taken as a hard deadline by people who see your task as yet another empty checkbox in a long list of checkboxes. If someone is asking you to estimate something complex and expecting an on-the-spot answer, you're already in a precarious position. It means you haven't educated them on the nature of your work. It's OK to refuse to answer. As much as it pisses them off, it will piss them off FAR LESS than giving an under-estimate and causing project slippage, regardless of how hard you work. I had to learn that the hard way earlier in my career. No one cares about heroic efforts which miss an unreasonably low project deadline estimate (especially if you quoted it yourself). It's always seen as a failure. Much better to give phased target dates for pieces of the deliverable and adjust subsequent targets if any previous targets slip.
@ferdibra3 жыл бұрын
The lengths that we must go to for project funding and the amount of diplomacy to hide the fact that Estimating = Guessing. This is especially true when this type of work has never been done before with a team that has only just met.
@jasper2virtual2 жыл бұрын
I love all your videos. Best source to practice interview questions
@walterbaltzley45463 жыл бұрын
Estimation, like design, is as much art as it is science -- it involves being able to account for both known and UNKNOWN variables... The larger the number of unknown quantities and the greater their impact on the critical path of development, the wider the range of probability will be. The key to successful estimation is to separate the known from the unknown quantities, and estimate each separately. Due to the high level of uncertainty in some projects, we should engineer our process to absorb failure. The beautiful thing about software development is that it is not an all-or-nothing proposition. Code that is developed for one project can easily be repurposed for another, if it is documented and well-organized. Every project should be seen as an opportunity to develop a knowledge-base that can be leveraged for future development, consulting, or as a product in itself. Known Quantities should be kept to a tight budget and schedule to maximize time and resources available for unknown quantities. We should also assume that any unknown quantity will require time for additional research. Projects with large number of unknown quantities should be treated as exploratory expeditions --- you don't know what you are going to find. You may find that your original goal is infeasible. You may find an alternative goal that is even more profitable. Or, you may find that you have hit a dead-end. Again, unknown quantities mean that you DO NOT KNOW how much it will cost or how long it will take -- You are going to discover these values as you progress.. The key to a successful PROJECT in this situation is NOT an accurate estimation, but to look for additional value beside your central goal. Do not pass up platinum or silver in your quest for gold. Every challenge is an opportunity, every set-back a new path forward.
@torousisme3 жыл бұрын
I really enjoy this channel, the topics are spot on. Thanks!
@alanweber6753 жыл бұрын
I had a professor that said when estimating times, take into consideration everything you know and then double it and then double it again.
@richardcoppin53323 жыл бұрын
"The infinite fractal coastline of estimation", I love that term.
@reagang80383 жыл бұрын
Estimate = guessing. Planning, researching and breaking down the features into tasks (WBS) would help with this. Ideally, the manager should sit with the developer to map out all the tasks and the scope of the project before you can assign time to each task. This should help with the estimation. The problem is that managers are lazy and think that their job is to forward emails to developers.
@rishatsharafiev2 жыл бұрын
BS
@reagang80382 жыл бұрын
@@rishatsharafiev great response 👍
@rishatsharafiev2 жыл бұрын
@@reagang8038 there is no point to estimate, you will waste each other’s time, when actual problems of customers will be frozen. I tried all this things, it’s basically became group masturbation session.
@HughCStevenson1 Жыл бұрын
I have not found that adding detail makes the estimate more accurate and it is a waste of time. Just look at smaller chunks and get started. Or compare with a comparable project in the past and guess based on that.
@TheCalvinSkinner3 жыл бұрын
Great video! Your experience is appreciated, it's great to be able to hear these broad concepts expressed by someone like you.
@ShreksSpliff3 жыл бұрын
Wow your advice is gold. Thank you for being real x
@ContinuousDelivery3 жыл бұрын
Thanks.
@fededevi19853 жыл бұрын
I decide how to do it: 1 week, we decide how to do it: 10 weeks, you decide how to do it: 100 weeks, your boss will decide how to do it: 1000 weeks
@toppkaffe5272 жыл бұрын
As à Product manager I often get to see both sides. Contract worth big money (and commission), verses fluffy specs and a “ideological” approach to estimate are Satans love child. What tended to work well was to make t shirt estimates and then ask customer to pick key ones. We would commit to those by date X. Other t shirts delivered and paid for in a soon as ready. Company got a commitment to revenue, customer had a promise of essential delivered on a certain date. Did we always get it right….. no. Specs change, surprises happen, but there was less panic and heat. It brought sales and development working together rather than beating each other up. Best day was when head of sales turned down a contract based on an estimate. Trust was key. The big fish contract we were working on came home on time.
@DaveInPA2010 Жыл бұрын
Good content! And I like your explanation of precision and accuracy. Personally, my estimate multiplier is Pi. It's worked out well so far.
@HughCStevenson1 Жыл бұрын
Not e?? :)
@carldebilly3 жыл бұрын
I'm french speaking and I just realized we're using the same word - in french - for both accuracy and precision.
@g3ff013 жыл бұрын
A Hungarian here: we too. However, sometimes we use words coming from other languages for these.
@AllanKobelansky3 жыл бұрын
100% plus or minus 100% spot on. New subscriber here. And my new guru.
@ContinuousDelivery3 жыл бұрын
Thanks and welcome
@JohnDavidDunlap3 жыл бұрын
My response frequently resembles something like: "It takes as long as it takes." This position makes me very unpopular.
@MrHaggyy3 жыл бұрын
Well from a good product standpoint thats viable. But from a buisness side certainty about some uncertainty makes it easier to get money in the right places.
@paul-bouzakis3 жыл бұрын
How would you about resource planning for a year? How many engineers should we hire?
@virtusoroca77243 жыл бұрын
I think planning is about carefully choosing what to discontinue under some sh*t storm that will sure come. Great channel.
@GeorgeTheGreek_3 жыл бұрын
Your videos are always very interesting because you are transfering your experience from industry and are not just academic knowledge. Because in most of your videos you mention the need of continuous learning i would like to ask you to make a video about effective learning strategies and tactics for software developers-engineers.
@ContinuousDelivery3 жыл бұрын
Thanks, I will think about that.
@thehandofjibreel87563 жыл бұрын
@@ContinuousDelivery That'll be very helpful, please.
@Metaspace23 жыл бұрын
So good, so concise, so on point!
@viniricardoferrera3 жыл бұрын
Aways brilliant! Thank you mr. Farley. I've been learning so much with you.
@ContinuousDelivery3 жыл бұрын
Thanks 🙂
@sideshowlol3 жыл бұрын
What a gem! Thank you very much, Dave 🙏
@ContinuousDelivery3 жыл бұрын
Glad you liked it!
@cbrunnkvist Жыл бұрын
16 minutes and 30 seconds in and still no word about how long it will take to get the teleporter working. The customer or client project manager will not accept that. 😂
@ToadalChaos3 жыл бұрын
Dave Farley: "...it relies on the people doing the work to stay focused on the work that really matters, and not get distracted" Me, getting distracted on KZbin: "...touché."
@MrNathanstenzel3 жыл бұрын
my last programming job was up to 90% distraction from account managers so I burned out and quit.
@jamstawildman3 жыл бұрын
This is another great video, from a great channel :)
@neilregan24883 жыл бұрын
Paraphrase: A reasonable estimate is 4x your guess, but don't tell your client because they won't buy or begin the project if they know the truth.
@yutubl3 жыл бұрын
You're Planning is the art of thinking to reduce waste of peoples work. An estimation believe is an estimation believe for the expected conditions, which tends to be uncomplete unaccurate and change over time (changing requirements, daily learning curve about new aspects). Its like the biological brown moving: so don't estimate that an estimation continues to be accurate. Estimations approximate to accuracy when repeated for same or similar enough tasks, so you'r planning will get better if you plan the same task twice, three times, four times, ...
@ndeoligence83 жыл бұрын
Best value for time, this video! Thanks 👌
@nwalsh33 жыл бұрын
I've never encountered a place that would accept "when it is ready/when it works" as a reply. Same applies as development applies to solution design (my area), just because you have put together a design, it is assumed that you'll just snap with your fingers and it's online and ready.
@ContinuousDelivery3 жыл бұрын
Sorry to hear that, but they do exist. It takes a while to build that level of trust in the organisation though.
@musicman35693 жыл бұрын
@Nicholas Walsh, I know what you mean. It took years for me (I am Director of IT at a medium size business), and I only recently found that the best way for me was to shift the emphasis from deadlines to prioritization + transparent collaboration so they still have something to hold onto. I've also been a business owner, so that helps with understanding their perspective. Keeping stakeholders involved and seeing the incremental progress helps so there is less fear that "nothing is happening". As I thought about it, the demand for estimates was really an attempt by the business to shift risk from the business (aka. equity holders) where it rightfully belongs to the IT employees/contractors. But it was a false illusion. They must embrace and accept risk (especially on green field projects) and view it as a series of acceptable small investments. So I worked it back to the question, "How much are you willing to incrementally invest/risk in terms of man hour costs towards the first step of your goal, regardless of outcome? That is a business choice, and not a technical one." This encourages smaller goals, which is good for everyone, where you "touch base" and assess the next move at the end. The "control" they retain is the priority, as in "What comes next?". However, it took me years to gain that sort of rapport and I work with a very open-minded CEO, so I realize it won't work for everyone in all situations. The other challenge is to convince them to stop "future-gazing" their releases, schedules, and partner conversations so much and instead wait long enough for the back of the pipeline to start outputting steady feature releases. Once there is a steady output of finished/working features, there is less need to pressure the future so much due to fear of the business looking unprogressive. It's the first and only time in my career I've had any luck with this, so I'm waiting to see how it goes. Regardless, best wishes with your own ventures! Cheers!
@ContinuousDelivery3 жыл бұрын
@@musicman3569 Your experience sounds like it is very close to mine. The best that I have seen was after building the trust to the point where everyone realised that the "future-gazing" that you mentioned is really an anti-pattern. It is a kind of superstition that that is what must happen. These days I often mention Apple, who are the most successful company in the world and don't pre-announce. Of course they plan, internally, but the don't publish their plans. It seems to me that the healthiest state is where the reality that we can't accurately predict the future is recognised by everyone and everyone understands that it is important that we work, as efficiently as we can, on the things that seem to matter to us now. It is important to have a vision for where you want to go, but that SHOULD be intentionally a bit vague. Enough so that you can tell of your current ideas are moving toward or away from it, and vague enough that you can change it without invalidating all of your work.
@somewhereinyorkshire47823 жыл бұрын
My mantra is - a job done well is a job that is done quick enough - I think this is from Marcus Aurelius, not known for his coding text books, but i picked it up when it was re-used in a computing textbook (may have been McConnell's).
@ContinuousDelivery3 жыл бұрын
@@somewhereinyorkshire4782 Yes, I think it is important that 'economic constraints' are recognised as an important part of engineering. I Marcus A was great at Perl though 🤣
@rajivr19442 жыл бұрын
This was a very good video on estimation with some good points a s/w developer can covey to stakeholders on why estimates are just guesses. Thanks for the video.
@donaldhobson88733 жыл бұрын
If the new task is very similar to what you did last week, expect to be faster this time. Practice. And familiarity with the concepts. This doesn't apply much if last weeks project was also the same as the week before.
@ДаниилРабинович-б9п3 жыл бұрын
the example in the beginning was so out there that I though "teleport" is a fancy term for direct connection or something.
@heymega47793 жыл бұрын
Another brilliant video!
@ContinuousDelivery3 жыл бұрын
Thanks 😎
@MrKrishnanandaKHegdeАй бұрын
Wow superb video Sir!
@mgpmul88463 жыл бұрын
Most experienced engineers know that estimates are 'guestimates' and have little predictive value. Personally, I feel a knot in my stomach when being asked the question 'How long will it take?'. As an engineer, sec, I would gladly discard estimation right away! It is just that accountants, budget responsibles, managers, sales, consultants and customers want to have an indication. As an engineer that is part of an organisation, I cannot ignore these roles in the chain of software creation and delivery. These people need the information to do their part of the job. Discarding estimates completely is therefore not an option. The best we can do is to tell them to use the estimates wisely (and refer them to Dave Farley's video!).
@markemerson983 жыл бұрын
watched again - still gold
@vishalsinha51483 ай бұрын
I reviewed the video and tried to implement it in my estimation technique. But the major challenge I am facing is client does not provide very detailed requirement and he expects a fixed time and cost estimation. If we try to convince him that doing any features have multiple ways and the estimation varies based on that in the between of development. But still clients expect fixed estimation otherwise they do not show interest in moving forward. Secondly in this competitive market, we have to mostly keep the estimation at lower side regardless of prior experience of that work and any kind of risk. Please suggest what should we do in this scenario? Thanks in advance
@ContinuousDelivery3 ай бұрын
There isn't a rational solution! What you say is true, the commercial decision making around software production is irrational and based on guesswork and sometimes active falsehoods. We can't predict the future! The most rational, optimal way to organise SW dev is to make progress in many small steps and fund it that way too. Rather like the venture-capital funding model for start-ups. Try something out, see if it works, and then commit to more money. But the reality is that buyers of software development *are irrational* so you either have to lie, or make your best guess even though you know it will almost certainly be wrong, and then get ready for the unpleasant arguments later, when you are late - because we are nearly always late - It turns out that SW dev is more complicated than most people think. This has been true from the start, Fred Brooks wrote about it in the "Mythical Man Month" in 1970 - a still surprisingly readable book!
@jan-lukas3 жыл бұрын
Somehow I know think about estimating if I need a jacket by looking at the weather forecast. Sometimes the forecast is wrong, sometimes the sun is shining enough to make a big difference etc.