To enable a fast time-to-market, we looked for an out-of-the-box solution featuring open-source industry-standard functionalities to avoid vendor lock-in.
We chose Elastic Stack, an industry-standard solution already used by Walmart, eBay, and T-Mobile. The experience layer was built in Kibana while the search layer was provided by Elastic Indexes, with document-level security via X-Pack.
Data ingestion was the biggest challenge—we needed to ingest data from a variety of sources and make it available to the user in near real-time. For this, we used Beats for logs, alongside Logstash for ingestion of business-related objects including advisor and client data.
Considering the security, we hosted the solution initially on-premises using Elastic Cloud Enterprise—a future-proof solution that enables easy upgrades. As part of the phased cloud migration, the overall solution getting migrated to Cloud using AWS EKS as a managed Kubernetes Service, AWS RDS as a fully-managed cloud database, and Elastic Cloud on AWS as a fully-managed service.