Caso de Exito Anaya

Executive Summary

This Project focuses on the strategic design of the data Architecture for the Publisher, based on Amazon Web Services environment. It entails the structure for gathering, storing, processing and usage of data using AWS. The process covers several aspects: Data Gathering, Storage, Processing, Transformation, Security and Compliance, Integration and Availability and, to end with, Scalability and Cost effectiveness.

Takeaways

Challenge:

• Systems Integration
• Change Management
• Ensuring Security and Compliance
• Development of Meaningful Use Cases

Solutions

• Assessment with all the departments within Anaya, regarding the design of the whole data platform for the company.
• Prioritization of the needs that the different departments within ANAYA have regarding data.
• Data Architecture Definition.

Results:

Creation of the first Use Case: Dashboard to analyse the consumption of digital contents made by students.

Customer needs data meaningful, secured, reachable

Many companies, including publishing companies, are in search of relevant data that points them in the right direction regarding market needs. However, the amount of data available makes difficult to extract relevant conclusions and proves handling huge volume of data is expensive and consuming.

Besides, when it comes to big companies, aligning the different data sources and properly correlating the information they provide, adds another layer of complexity and requires additional effort in designing effective architectures and strong solutions able to cover end-to-end problems.

To end with, the solution needs to be secure and compliant, as the data includes sensitive information that can’t be exposed, neither shared nor compromised at any level.

AWS supports the workload and secures the data

NEORIS started an initial data load of more than 120 million rows from more than 20 different data sources, using a DataLake built over Amazon Simple Storage Service (Amazon S3) as repository for raw and processed data.

The Partner created a hybrid solution which, through a site-to-site VPN connection, extracts data from the Data Center to AWS periodically, and is processed by a microservices’ cluster to shape the data lake.

The architecture makes use of many other AWS services, including Amazon EventBridge for scheduled and automated executions, and Amazon Elastic Container Service (Amazon ECS) for containerization. Amazon Relational Database Services (Amazon RDS) are deployed in order to support a relational data model and for Business-level aggregations.

The security model built by NEORIS makes use of AWS Identity and Access Management (AWS IAM) and features such as Parameter Store to ensure privacy and security for the final solution. AWS CloudWatch is as well enabled to ensure observability and monitoring of critical metrics and performance.

Integrated, secured, on time

The product was ready once the datalake was created and the rest of the relevant infrastructure put in place by NEORIS gathered relevant information. Not only this was accomplished on time but also the PoC, a third-party solution implemented as data analysis tool, was deployed within the scheduled dates.

This solution, and the final dashboard to be consumed by the end customer, are made available to only the customer, protecting data and privacy and the customer’s legitimate interests, without losing effectiveness on the data consumption. This was integrated with the rest of the infrastructure of ANAYA without any service loss.

The customer understands this PoC as a success and trusts NEORIS for future collaborations with AWS.