Big Data Platform MVP Development for a Global Consulting Company

Industry

Construction, Consulting, Professional Services

Technologies

Frontend (JS, HTML, CSS), Big data, Scala, Python, Hadoop, React.js, PostgreSQL, Spark

About

The Client is an international company that provides business and technology consulting services for large-scale construction projects in oil & gas, chemical, power, mining, pharmaceutical, and other sectors.

Challenge

The Client wanted to develop from scratch a complex platform to streamline the delivery of consulting services to their customers. In a long-term perspective, the platform was expected to be enriched with machine learning (ML) capabilities to provide the Client s customers with recommendations on their construction projects. The Client lacked competencies to develop the solution in-house and was looking for a reliable vendor to deliver the MVP.

Solution

VolgoTechnologies provided the Client with dedicated specialists to build the front end and the back end of the solution. Our team worked with the Client s project manager based on the Agile methodology with one or two-week sprints.

In close collaboration with the Client, VolgoTechnologies experts have prioritized the solution s functionality, based on the software requirements specification. Among the priority features were the secure storage of voluminous customer data, customer data archiving, and advanced data processing capabilities. When designing the solution architecture, the team took into account the scalability requirements and used Docker containers with Docker Swarm to achieve that.

Staging

Data Ware House

Data Ware House

Desktop Application

Results

The Client was completely satisfied with the MVP that enabled collaboration on voluminous project data and facilitated the delivery of consulting services to the Client s customers. The delivered solution is currently being enriched with machine learning capabilities.

Technologies and Tools

JavaScript, Scala, Python, React, Node.js, Nest.js, GraphQL, Apache Spark, Apache Livy, Hadoop, Delta.io, Knox