Case Study: From PoC to Production
In 2018, a Dublin-based technology firm undertook the development of an AI-powered customer service platform for airlines. Andrea was engaged as Vice President to take their basic PoC to a production-ready commercial SaaS platform.
Whilst the initial proof of concept demonstrated basic functionality, the journey from prototype to production deployment at a European carrier would require substantial refinement and development effort. The initial challenges centred on data acquisition and curation. The base prototype, whilst functional, relied on a limited dataset of standardised airline Q&A documentation. To achieve production-ready capability, Andrea and the team undertook comprehensive data gathering, incorporating customer service transcripts, social media interactions, and detailed airline policy documentation. This enhanced dataset proved essential for handling the nuanced nature of genuine passenger enquiries, and fine-tuning the LLM model to respond correctly.
The integration of airline staff into the development process presented its own set of challenges. Initial scepticism amongst customer service personnel required careful management. Through structured training programmes and collaborative feedback sessions, the team successfully fostered engagement with the platform. Staff insights proved invaluable in refining the system's capabilities and operational protocols.
The programme achieved a significant milestone when, in the midst of the pandemic in 2020, a European carrier signed on to implement the system to help reduce the strain from their call centre agents. The deployment followed a measured approach, initially limited to specific query categories. This methodical implementation allowed for careful monitoring of the language model, and system optimisation. Call centre metrics demonstrated steady improvement, whilst maintaining consistent customer satisfaction levels.
The timing of this implementation proved particularly significant, preceding the adoption of large language models in commercial applications. Andrea and the project team successfully addressed complex technical challenges, secured stakeholder support, and demonstrated the practical application of conversational AI technology in a demanding customer service environment.


