“Staying up-to-date in an ever-changing environment”
Introduction
ActiveViam has shown that its proprietary software Atoti is the leading technology to interactively analyse datasets from Gigabytes to Terabytes. Atoti can harness the largest machines of Cloud platforms and on-premise DataCenters to make all the CPUs work at a blazing speed on their Terabyte RAMs filled with client data.
Atoti is delivered to clients as a set of libraries. They are the building blocks to create their projects. This encompasses the setup of the data model: the tables and joins, the creation of new metrics and axes for analysis. It contains utility to load data into the project, and various ways of querying the data from the project.
Clients can build applications on their own. They often resort to buying consultancy from ActiveViam to build some advanced features, before integrating and maintaining it over the years, without intervention from ActiveViam teams.
In this context, ActiveViam is looking for ways to help their clients in deploying, monitoring and maintaining Atoti applications easily.
Expected Work
The goal of this internship is to prototype a system for streaming changes from BigQuery and Snowflake to Atoti in real-time.
The initial phase will study in depth the various mechanisms offered by BigQuery and Snowflake, such as Snowpipes, table metadata, as-of-date queries.
In a second phase, given a list of perimeters (subset of the data) used by the application, we will build a prototype capable of notifying which perimeter has been updated and ideally report the extent of the update – added rows, updated or deleted values.
Based on that information, we will design and implement a way to update internal components of Atoti stack.
One of the biggest challenges in this internship is the definition of real-time. Producing the notification within the 5 minutes that follow the update is a good performance. Offering this same notification under a minute is an impressive achievement. And a 1s delay would be an astonishing realisation.
This prototype will be coded in Java, the core language of ActiveViam software.
To turn the prototype into a production grade component and make it part of the Atoti solution, this internship may open up the opportunity to be continued as a standard position in the R&D team.
About ActiveViam
ActiveViam provides business users with instant insight into large volumes of fast-moving data for timely and context-aware decision-making.
Founded in 2005, ActiveViam employs over 150 people in its five offices of New-York, London, Paris and Singapore. We expect sustained growth in 2025 and will continue hiring the best talents from the top schools.
