Getting a handle on ESG datasets

The approach to sustainability is undergoing a noticeable shift globally because of evolving regulations even as adoption levels have been varying.

Consequently, relevant, accurate and defensible sustainability data has never been more important.

While few asset managers are adjusting their strategies in response to the changing mandates, all of them continue to view sustainability as a core component of long-term value creation

But all are facing the growing challenge of managing large volumes of ESG data, including unstructured ones, from varied sources that may or may not be governed by differing taxonomies, definitions and methodologies.

Many asset managers still lack the internal systems and talent needed to ingest, reconcile and analyse complex ESG datasets as regulatory expectations evolve.

To navigate this landscape effectively, asset managers are increasingly investing in strong data management strategies, including data quality and governance frameworks, underpinned by advanced technologies and deep domain expertise.

With polarised sentiments and rigorous debates globally, sustainability remains resilient and adaptable. Investors, regulators and companies are embedding ESG data into their strategic decision-making processes, recognising that sustainable investments would be an important competitive advantage if not in the short term, then definitely in the long term. 

Embedding ESG insights into investment processes requires more than just access to data-it demands robust data infrastructure, standardised approaches, and validation mechanisms to ensure quality and consistency across portfolios.

Firms must adopt tailored strategies that balance flexibility with standardisation to manage ESG data effectively. The illustration below highlights the key focus areas.

• Alignment of the vendor data: Customise ESG data from multiple vendors to align with  firm-specific investment frameworks. For example, net-zero aligned portfolios may prioritise carbon intensity and temperature alignment metrics when selecting data providers
• Firm-wide ESG data dictionary: Establish a centralised reference for ESG definitions, benchmarks and methodologies to minimise interpretation risks and ensure consistency across internal and external reporting
• Granularity assessment: Not all ESG data hold equal value. The granularity and reliability of sustainability metrics can vary widely; some datasets are derived from audited corporate disclosures, while some are extracted from estimates or self-reported figures. Rigorous quality assessment frameworks, supported by regular audits and benchmark comparisons, help distinguish high-confidence data from potentially misleading information
• Data quality and controls: Robust data validation protocols are essential to maintain data integrity. Automated quality checks embedded in ESG data workflows help prevent inconsistencies and errors that could distort investment analysis. By integrating these validation rules directly into data ingestion systems, asset managers can uphold transparency and reinforce stakeholder trust in their sustainability metrics

Once ESG data is effectively consolidated within a firm’s infrastructure, the next challenge is to transform it into actionable intelligence. The sheer volume and complexity of ESG datasets call for advanced data processing, sophisticated analytics and automation.

Organising datasets within scalable infrastructures, such as cloud-based platforms or centralised ESG data libraries, allows for dynamic updates and seamless integration of diverse data sources. 

Further, given the complexity of ESG data processing, automation is key.  Algorithm-driven models can process vast datasets to uncover ESG trends, assess sustainability risks and generate dynamic reports. For example, predictive algorithms help decode shifts in key performance indicators, such as carbon emissions, enabling better buy/sell decisions and alignment with net-zero targets. Automated workflows not only reduce manual workloads but also ensure that insights are timely and aligned with regulatory requirements. An automated risk alert system monitors ESG data feeds and flags potential quality issues, such as a decrease in coverage for specific ESG metrics or null inputs for key data points.

Firms can confidently navigate the changing environment by incorporating ESG into their core strategy to improve sustainability and financial performance and not just for compliance.

As regulations evolve and demand for accurate, scalable data continues to increase, the integration of technology and domain expertise will be critical for turning ESG data complexity into clarity.

Asset managers investing in scalable, technology-enabled ESG data strategies will thus have a significant advantage.