Demystifying the Rivian Data Lake ArchitectureI recently encountered a technical presentation from AWS re:Invent 2023 detailing how Rivian, an electric vehicle manufacturer, uses a Data…Feb 2, 2024Feb 2, 2024
Event-driven data load from S3 to DynamoDB using AWS LambdaThis document details the technical aspects of how event-driven data pipelines can be built on AWS using services S3, DynamoDB, SNS, and…Dec 26, 2020Dec 26, 2020
Incremental Loads in HadoopIncremental load: It is a process of identifying the new records or recently updated records on the source and doing an insert else update…Jul 7, 2020Jul 7, 2020