Analytics on Alternative Transaction Level Data for a US based Research Firm
Client : US based research firm
Objective
- Generate insights from alternative data by processing, automating, and analyzing merchant data and consumer transactions data
- Skills Required: Data Management, External Vendor Data Evaluation and Analysis, Data Visualization
CRISIL's solution
- CRISIL team works on large scale processing of alternative data e.g.: data from credit and debit card transactions, POS data, and e-mail receipts
- Carry out data cleansing and parsing, harmonization, exception handling and validation
- Automation of data processing alongside optimization to ensure no manual intervention
- Create analytics-ready databases
- Migration from legacy system to Apache Spark, thus enabling flexibility to add sources, entities, features
- Build and provide ongoing support for Reports, Dashboards, and Ad Hoc analysis using Tableau
- Analysis and insights generation from dashboards
- Platform used: Apache Spark, AWS Redshift, Tableau, Alternative data from external vendors
Client impact
- Usage of transactional data for substantiation of hypothesis
- Analyze new data and signals relevant for forecasting performance drivers
- Analysis of additional external vendor data for quality and suitability for investment research purposes
Questions