Use Aws glue for ETL

Closed Posted 4 years ago Paid on delivery
Closed

Current ETL code is build in Informatica. All informatica mappings needs to be re-designed in AWS Glue. First a POC needs to be done. If successful, around 20 mappings needs to be developed.

More details on the requirements:

1-Simple source-filter-target mapping

2-Can we merge small files into larger files? Can transformations be done in the merging?

3-Do existing Informatica transformations require major python development to accomplish?

4-What sort of workflow capabilities does Glue have?

5-Are there any performance/capacity limitations?

6-Error logging/handling

7-What other complex capabilities exist in Glue?

POC needs to be done by Monday.

Amazon Web Services Hadoop Java NoSQL Couch & Mongo Python

Project ID: #22570360

About the project

15 proposals Remote project Active 4 years ago

15 freelancers are bidding on average $15/hour for this job

nirmalsarswat

Hi, I am an experienced developer in big data tools. I have utilizes spark, Metastore and glue for a lot of times for etl pipelines. I can surely do poc first and then do rest of mappings. Let's discuss the architectur More

$16 USD / hour
(8 Reviews)
3.8
logiclast

Hi Dear, I am AWS Glue expert. I have migrated 19TB database from xml source to postgresql database using AWS glue. The source files were generated from cobol database. AWS Glue works on their Lambda based architectu More

$40 USD / hour
(3 Reviews)
3.7
athminteam

Hi, This is Vipin, an alumnus of IIT Kanpur. I have 6+ years of experience in customized software, web and mobile app development and has expertise in Android, iOS, Python, Magento, AWS, PHP, HTML, Java, Angular and More

$12 USD / hour
(8 Reviews)
3.3
Geracimov

Hello, sir. How are you? I have just read your project description and I can help you with my experiences. Don't waste your golden time to looking for a developer! I'm new freelancer, but I will make the perfect produc More

$12 USD / hour
(2 Reviews)
2.2
rsoni4980

Hi, this is the Migration project and I already worked on this type of task. If you can make contact with me we can close this task soon. Regards, Rahul Soni 9148250559

$12 USD / hour
(0 Reviews)
0.0
gunjan4132279

Hi, Thanks for sharing your requirement and I will be more than happy to help you. Let me share with you my expertise which I have gathered for over 6 years in Informatica ETL, Hadoop & AWS : - Hadoop Ecosystem : Yarn More

$20 USD / hour
(0 Reviews)
0.0
rajashri57

Hi, I am interested to work on the project. Though I am new to freelancing, I have worked on ETL projects on my job. Looking forward to work on the project. Thanks, Rajashri

$10 USD / hour
(0 Reviews)
0.0
shanujain2312

Came across your need in ETL, would like to help on it. I had been been working with MNCs from past 4 years and had seen diversity of projects.

$10 USD / hour
(0 Reviews)
0.0
pterik

Hi. My name Vitaly. I'm ETL Informatica developer from Ukraine. I have good experience in Informatica, and I worked with AWS Glue also for migrating the data from databased. My detailed CV published on Linkedin. Please More

$13 USD / hour
(0 Reviews)
0.0
Nehag510

Hello, Warm Greetings! I am a web developer and I have 4+ years of experience in this field. My skills are PHP, HTML5, CSS3, Bootstrap, Javascript, jQuery, CMS, node js, React js, AWS, MongoDB.  So I can do your pro More

$12 USD / hour
(0 Reviews)
2.0
sunilrebel

Reasons WHY I am Fit for this project. Please find the reasons why I find this project a prefect one: 1. This project requires a dedicated person for a long time, so I am available for more than 6 months for this pro More

$12 USD / hour
(0 Reviews)
0.0
devyanikulkarni2

Hi ! I have good experience into AWS Glue ETL, data crawlers and GlueETL transformations and have recently worked on similar assignment. Please share more details to do the POC and I will provide you high quality res More

$12 USD / hour
(0 Reviews)
0.0