Association for Project Management
The 21st century project challenge: leading with data
Blog posted by: James Lea, 09 March 2020.
As we move through the 21st century, data and the insights it gives us will change how we see the world. However, it's chaotic. It is particularly frustrating for project managers tasked with delivering projects on time, to cost and scope. As we stand at the edge of the proverbial data lake, we ask ourselves: how can we swim across?
We implore our organisations to play their part and set the stage for successful delivery. However, this can feel like an uphill battle. Traditional ways of thinking and behaving hinder our attempts at digital transformation.
I believe that a significant responsibility falls on the project delivery profession. We must take the very best of what we know, of how to comprehend scope and uncertainty, how to gauge and price work, and how we deliver the work, manage stakeholders and control change – and we must lift our game in all these respects, using data. I call it data-driven project management.
Lead through example
By leading through example and communicating the art of the possible, we can set new standards. We can set the expectation that data leads to change and delivery. I'm heartened to note that a wide range of developments is making this possible.
From a tool and technology perspective, we are now awash in distributed, computational power. The giant online retailers demonstrate just how effective modern database-driven systems are. Our telecommunication networks are not far behind either, and the impact of the internet is undeniable.
Where the gaps lie are in the processes and people making use of these technologies. Project managers will need to include a new wave of data architects, data scientists and data engineers in their teams. These professionals describe capture and reason about the world in a way that makes project delivery smarter. Project teams must overcome data bias, our tendency to cherrypick the data that supports our hypothesis and discard the elements that do not.
The same engineers will ensure the data is clean and as accurate as possible, so we do not experience 'negative training' - training in the wrong thing.
Join the dots
In parallel, we must build organisations and cultures that no longer operate in silos. The most successful organisations will be those that can exploit data across the business.
These new organisations will set the expectation that every project will be better than the last because every project learns from all of its predecessors. The word 'all' is deliberate here. Through machine learning, mathematics, statistics and careful modelling of projects, we can use the past to inform the future.
Organisations that choose not to collect and examine their data exhibit systemic data bias. They err toward overconfidence or – just as damaging - timidity in pursuing commercial opportunities that they could take.
With lack of knowledge comes false confidence in the outcome, sufficient at times to jeopardise not just the project but at times, even the business.
To overcome this, we must develop a data-driven learning cycle. For this work, we must systematically measure all aspects of project performance.
We must measure much more than financials – that's the tip of the iceberg. The organisations we work within must provide the right foundations (quality systems, culture, training and support) to enable the business to be self-critical and learn in an unbiased way.
Every element of the learning cycle must operate at the same level. Another trend is emerging: machine and project manager side-by-side, each bringing their strengths to bear.
By placing and exploiting machine knowledge at the heart of project delivery, we can replace optimism bias and selective recall with a relentless focus on using past data to predict the future. We're not looking for a scenario where: 'computer says no'.
Instead, we're seeking guidance, where the algorithms operating on big data tell us where our predictions need improving, and – critically – the reasons why. When we use applied artificial intelligence (AI) techniques such as machine learning, we must insist upon 'explainable AI': systems that can give the ideas and probabilities for their conclusions.
Build better cultures
Finally, we must set the cultural expectations. Operations and portfolio staff can no longer hand-pick "high risk" projects to review.
The business must look at all projects uniformly, in-depth, regularly and in real-time. Similarly, citizens will expect the government to master data sets across all their realms. We are seeing the rise of data trusts in which data is shared for collective benefit, overcoming the commercial silos that hinder learning, optimisation and the markets in general.
If we can do all these things, then we will master the role of data within project delivery. We will move into a world of prescriptive analytics, where the data informs our decisions, learning at scale from the countless projects driving that knowledge. With uncertainty contained, the ensemble of projects will become more efficient and predictable, driven by data, in which every loss that is systematically modelled and recorded is a gain for the future.
I welcome and look forward to this future. I encourage all project delivery professionals to explore what this new world looks like, and to play your part in the 21st century, exploiting data to deliver your projects.
You may also be interested in:
- Five ways to keep your project on course
- What does AI and data mean for the project profession?
- Projecting the Future: the fourth industrial revolution
Brought to you by Project journal.
About the Author
I am passionate about a new approach to projects, programmes and portfolios: placing data at the heart of project design. This will enable us to apply AI techniques to give rise to a new generation of project that truly learns from the past and delivers with greater predictability, reducing project write-downs and delivering value for money.
I deliver projects and programmes with a high integrity and ultra-low defect approach. With 19 years' experience across high-tech complex engineering projects and programmes, I bring together key stakeholders to ensure successful low-risk delivery. I use my energy, passion and inspirational leadership techniques to build, lead and govern high performance delivery-oriented teams.
Latest News from
Association for Project Management
How to make better critical project decisions06/05/2021 16:20:00
Blog posted by: Natalie Marguet, 05 May 2021.
We asked our volunteers: Q&A with Manish Khanna05/05/2021 10:20:00
Blog posted by: Caspar Bartington, 04 May 2021.
Volunteer with APM SIGs! in 2021/2204/05/2021 16:20:00
Are you currently looking for volunteering opportunities to play an important role within APM by creating and disseminating new knowledge to the project management community?
Creating a community of practice within the Bar Standards Board (at zero cost)30/04/2021 12:20:00
Blog posted by: Jaspal Kaur-Griffin, 29 Apr 2021.
Achieving APM chartership through consultancy work28/04/2021 16:20:00
Blog posted by: David Jones, 28 Apr 2021.
How to manage structural change in turbulent times28/04/2021 10:20:00
Blog post by: Robert Blakemore, 27 Apr 2021.
Six ways to stand out in a crowded project jobs market27/04/2021 10:20:00
Blog posted by: Dave Waller, 26 Apr 2021.
APM supports the future of project research26/04/2021 16:20:00
APM is supporting the next generation of project academics and professionals by helping people to attend the upcoming British Academy of Management (BAM) conference.
“Targets must be backed by serious investment": APM response to UK government's climate announcement26/04/2021 13:20:00
Association for Project Management (APM) has welcomed the UK Government’s announcement that it will speed up targets to cut carbon emissions, but advises that investing in the skills that will enable project managers to meet the climate challenge will be an essential part of the process.