I have experience building, designing and deploying datapipelines in aws and on prem with small amounts of data and huge amounts of data, stream and batch. I have build several application to process data in java, scala and python. I have experience with several aws services as glue, emr, ec2, lamdas, rds, efs ,s3, ebs and api gateway and much more. If you are interested please send me a message. I am sure i can help you with all the peoject and we can discuss requirements and scope.