The second in the October series of blog posts from Logikal Projects expands on the theme they opened at the start of the series: Big Data.

The construction industry in the UK has begun to harness big data to better deliver projects and to monitor and maintain the assets produced by them.

Despite the challenges, and the somewhat unfulfilled promise of big data in the project controls space, there is plenty more to do as we prepare ourselves for its eventual arrival. Most importantly, the construction industry must improve its data management practices from top to bottom and project controls is uniquely positioned to support this process.

Fortunately, we have the advantage of looking outwards to the industries that have paved the way to big data. We can harness the practices they have pioneered along with the modern tools that they have created. From these lessons, we have been able to put together the 5 steps to applying big data to project controls.

1. Know your who, what why

This first step in any big data initiative is to know where you are going, what you think you need to measure and why it’s important. Rather than focussing on eventual outputs and where the information will be positioned in a report, it is far more valuable to identify all the stakeholders, their business objectives and the key metrics and measures that they believe will help them in their decision-making process.

By building a dictionary of all the measures, it will then be possible to assess your existing sources of data and determine the readiness or identify a roadmap to reach your desired endpoint.

This process will also help your organisation clarify exactly what the roles, responsibilities and expectations are across the organisation and will potentially help to identify misalignments that need to be addressed.

2. Understand the ‘Golden Thread’

Understanding how all your organisation’s/programme’s information relates to each other is also an important step in the process. This process requires you to identify the classifications or breakdowns that segment all your information.

Once a number of breakdown/classification schemes are agreed upon, these will form the lowest common denominator across all of the information sources that will be implemented in the business. It will then be possible to review everything currently in existence for compatibility and will form a minimum set of requirements for any new information systems and processes brought online in the future.

This ‘golden thread’ throughout your organisation’s data will also simplify the data collection and transformation process for future and current integration projects.

3. Maintain a Structured Systems

Efficient processing and analytics rely on high-quality information. The more repeatable the end to end process of inputting, tracking and utilising information across your business processes, the more reliable and trustworthy the analysis results will be.

The construction industry needs to make a much greater commitment to move away from stop-gap data management solutions such as Excel, Word and PDF as its primary stores of business data. These systems are convenient as everyone knows them and there is no additional cost, but it can become prohibitively expensive when you factor in maintenance, error-correcting, data collection and summarisation and incompatibility across the wider organisation.

Instead, advances in cloud services and modern rapid application development mean that organisations should have little difficulty either identifying an off the shelf product that will meet their needs or implementing a solution at an acceptable cost.

4. Use Automation Technology

The way that information is recorded in a source system is not always fit for purpose in a reporting system. Sometimes information needs to be rolled up higher, sometimes it needs to be filtered. In other scenarios, it may need to be joined with other datasets from across the organisation before it will make sense.

In true big data applications, with regular reporting/monitoring, none of these processes are done manually, it would be too time-consuming. Instead, Data Transformation or Extract, Transform, Load (ETL) toolsets have been developed to support the automation of these processes.

ETL tooling should be picked up by the project controls team as an opportunity to introduce a greater level of standardisation for information gathering and report generation. The toolsets with graphical design capabilities also provide a level of self-documentation on how data is collected and what is done with it which can provide a level of assurance against the analysis processes.

Getting up to speed in this technology will also enable the project controls team to prepare for future big data initiatives, giving the team the capabilities required to act as business analysts and implementers for new analytics requirements

5. Implement Organisational Change

The construction industry and the project controls function will truly not be ready for the wave of big data until such time as information management and data analysis are embedded as core functions both within programmes and within the organisations running the projects. This extends well beyond just the selection and implementation of software systems, also influencing how an organisation should recruit, train and manage their staff, and how they should assign management or ownership of their data.

The vision for how data is managed within an organisation must also be pushed up into the corporate space. It is simply not sustainable to allow projects and programmes to implement their own standards and processes without overarching coordination. This does not mean an organisation must completely lock down their systems. However, a well thought out model needs to be implemented.

We see project controls and Project Management Offices’ (PMO) as having a signification influence in this space. Within project-driven organisations, these bodies are well placed to sponsor and influence the adoption of better practices. Each of these functions has a wide reach across organisational units and collect and report significant amounts of data. The project controls/PMO function should look to align itself as the business owner or business representative for the organisation with respect to project and performance data and may also have a role to play in becoming the initial business analysts for the organisation.


There are numerous lessons from the realm of big data that can be learnt and applied to project controls that will enhance data-driven decision making and ultimately, improve project performance. The good news is that these can be applied to a fledgeling project at a fraction of the cost and complexity of big data players and consumers. It will require strong leadership to generate a culture that values a modern technology infrastructure and data-driven decision making. It will also require one or more consummate professionals to own the design, implementation and management of systems, data and related processes for the duration of the project and beyond. Organisations who desire to remain relevant in the future will need to start investing in the development of staff and technologies within the data management space at a corporate level, not as a “nice to have” project-level expense.

Read the first blog in the series.

Read the third blog in the series. 

Read the fourth blog in the series.

LogiKal Projects

LogiKal is an award-winning consultancy specialising in planning and project controls solutions for projects, big or small.

LogiKal provide expert advise and performance management solutions to improve operational performance, reduce cost and mitigate risk. Effective decision making is faster and easier with our unique mix of specialised and proprietary systems and services integrating your project controls.

Visit the LogiKal Projects website