Hadoop Jobs

I'm looking for a skilled Python data engineer to help with several data processing tasks. The data is primarily sourced from procurement websites. Key Responsibilities: - Data cleaning and transformation - Integration of data from multiple sources - Building robust data pipelines Specific transformations required: - Data formatting - Data enrichment - Data aggregation Ideal Skills and Experience: - Proficiency in Python and data engineering tools - Experience with SQL databases, APIs, and CSV/Excel files - Strong background in data cleaning, transformation, and pipeline construction - Familiarity with procurement data is a plus Looking for someone who can efficiently handle complex data tasks and deliver clean, integrated datasets. In-house job in Kolkata preferred

Looking for an Experienced Data Engineer Project Description I am looking for a skilled Data Engineer to help design, build, and maintain reliable data pipelines and infrastructure. The work may include collecting data from different sources, cleaning and transforming it, and storing it in a database or data warehouse. You may also work with APIs, cloud services, ETL workflows, and large datasets. The ideal candidate should have strong experience with Python, SQL, data modeling, and ETL/ELT pipelines. Experience with AWS, GCP, or Azure is preferred. Knowledge of tools such as Airflow, Spark, Kafka, Snowflake, BigQuery, or Databricks would be a plus. Please include the following in your proposal: A short introduction about your Data Engineering experience Examples of similar projects ...

Swiggy Sales Data Analysis Analyzed a large Swiggy orders dataset (196K+ records) using SQL and Python. Performed data cleaning, handled missing values and outliers, and conducted exploratory data analysis to identify sales trends, customer behavior, restaurant performance, and order patterns. Created visualizations and generated actionable business insights to support data-driven decision-making. Blinkit Sales Dashboard (Power BI) Designed an interactive Power BI dashboard to analyze sales performance, product categories, outlet performance, and customer purchasing trends. Used Power Query for data transformation and DAX measures to calculate KPIs, enabling stakeholders to monitor business performance effectively. Used Car Price Prediction Built a machine learning regression model in Pyth...

Senior Data Engineer Needed for Cloud Data Pipelines and Data Warehouse We are looking for an experienced Senior Data Engineer to help design, build, improve, and maintain our data platform. The selected freelancer will work with our team to develop reliable data pipelines, integrate multiple data sources, improve data quality, and prepare analytics-ready datasets. Responsibilities: • Design and develop scalable ETL and ELT pipelines • Integrate data from APIs, databases, files, and third-party platforms • Build and optimize data warehouse models • Write efficient Python and SQL code • Configure workflow orchestration, monitoring, logging, and error handling • Troubleshoot pipeline failures and performance issues • Implement data-quality checks and va...

I’m putting together an intensive technical-skills program for an engineering college in Greater Noida and want to bring in seasoned trainers who can own three distinct tracks: Full Stack Development, Data Structures & Algorithms, and Artificial Intelligence. For the Full Stack stream I need someone who is equally comfortable running hands-on sessions in both Python/Django and Java/Spring Boot, guiding students through end-to-end project builds and deployment best practices. The DSA track must dig deep into core interview-level concepts, especially sorting & searching, graph algorithms, and dynamic programming, with plenty of white-board problem solving and live coding. In the AI track, I’m looking for a practitioner who can translate theory into practical lab ...