Data Integration Specialist, Apache Hadoop Savvy

*Title: Freelance Data Engineer* *Description:* We are seeking a talented freelance data engineer to join our team on a project basis. The ideal candidate will have a strong background in data engineering, with expertise in designing, implementing, and maintaining data pipelines and infrastructure. You will work closely with our data scientists and analysts to ensure the smooth flow of data from various sources to our data warehouse, and to support the development of analytics and machine learning solutions. This is a remote position with flexible hours. *Responsibilities:* - Design, build, and maintain scalable and efficient data pipelines to collect, process, and store large volumes of data from diverse sources. - Collaborate with data scientists and analysts to understand data requirements and implement solutions to meet their needs. - Optimize and troubleshoot existing data pipelines to improve performance and reliability. - Ensure data quality and integrity throughout the data lifecycle. - Implement monitoring and alerting systems to proactively identify and address issues. - Stay up-to-date with emerging technologies and best practices in data engineering. *Requirements:* - Bachelor's degree in Computer Science, Engineering, or a related field. - Proven experience as a data engineer or similar role, with a strong understanding of data modeling, ETL processes, and database technologies. - Proficiency in at least one programming language commonly used in data engineering (e.g., Python, Java, Scala). - Hands-on experience with cloud platforms (e.g., AWS, Google Cloud, Azure) and related services (e.g., S3, GCP BigQuery, Azure Data Lake). - Familiarity with containerization and orchestration tools such as Docker and Kubernetes. - Excellent problem-solving and communication skills. - Ability to work independently and collaborate effectively in a remote team environment. *Preferred Qualifications:* - Advanced degree in a relevant field. - Experience with real-time data processing frameworks (e.g., Apache Kafka, Apache Flink). - Knowledge of machine learning concepts and tools. - Familiarity with agile development methodologies.