Data Lakes with AWS

This page is currently a work in progress, please check back in later

For firms to leverage their available data, they need to have a sound data ingestion strategy available to them.

For the current project, we test out and compare across the various data lake offerings by AWS for optimum data ingestion onto the Data Lake.

Data Lakes can test out injection via a publicly available API, temporarily store the responses in local storage and then leverage data-frames (and potentially Dynamic Data-Frames) for flattening and cleaning of ingested data